Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • 15:38
    fantes opened #669
  • 09:38
    fantes edited #668
  • 09:33
    fantes synchronize #668
  • Dec 04 15:42
    fantes opened #668
  • Nov 27 10:47

    beniz on master

    detect and skip empty line in O… (compare)

  • Nov 25 13:28
    beniz edited #644
  • Nov 22 15:13
    cchadowitz-pf synchronize #657
  • Nov 22 15:07
    cchadowitz-pf synchronize #657
  • Nov 21 09:44

    beniz on master

    correct simsearch backend speci… Merge pull request #666 from fa… (compare)

  • Nov 21 09:44
    beniz closed #666
  • Nov 21 09:39

    beniz on master

    chains: avoid encoding + serial… adding move semantics around cv… raw cv mat converstion to grays… and 2 more (compare)

  • Nov 21 09:39
    beniz closed #660
  • Nov 20 12:57

    beniz on master

    Updated dlib to 19.18 Merge remote-tracking branch 'u… Fixed spdlog error and added in… and 2 more (compare)

  • Nov 20 12:57
    beniz closed #653
  • Nov 19 14:22
    cchadowitz-pf commented #653
  • Nov 19 14:20
    cchadowitz-pf synchronize #653
  • Nov 19 14:19
    cchadowitz-pf synchronize #653
  • Nov 19 10:29
    beniz synchronize #660
  • Nov 19 10:29

    beniz on chain_crops_raw_imgs

    fixed ids with raw image data a… (compare)

  • Nov 19 10:28

    beniz on master

    added mutex on tensorrt predict… Merge pull request #659 from jo… (compare)

programmeddeath1
@programmeddeath1
I'v actually run the git pull and subsequent steps through my root user. im getting " host not found in upstream "jupyter:8888" in /etc/nginx/nginx.conf:50
nginx: [emerg] host not found in upstream "jupyter:8888" in /etc/nginx/nginx.conf:50"
Iv found this in jolibrain/dd_platform_docker#1 to be possibly because of running through root user
Emmanuel Benazera
@beniz
OK, the jupyter notebook docker is sketchy because of the internal user. Definitely try not running the containers as root.
FYI, the user rights are at play when accessing the host's drive.
programmeddeath1
@programmeddeath1
Yes added the user to docker group and ran is working now. Thank you :)
Can I add my own models and codebase? or is it restricted to the existing models?
Emmanuel Benazera
@beniz
there's no restriction, but new models need to either have been trained on the platform, or brought in and made "compatible"... This last step depends on what backend you are using.
programmeddeath1
@programmeddeath1
i would like to add deepfigures-open and pdffigures2 from allenai's repo as new services for an NLP task. Is that possible?
Emmanuel Benazera
@beniz
not easily at all
same here
what can we do ? to add these
Emmanuel Benazera
@beniz
The easiest way would be to use these tools to build a dataset, and train an object detector with the platform. You'd end up with your own tables, etc... detection model
you'd need to convert PDF pages into images beforehand.
also this looks like a trivial task, you probably don't need a ResNet-101 to do that...
AJAY SAHU
@ajay01994
basic idea is to do PDF processing using the above ML repo and take out texts ,images vectors ,B box ,metadata for PDF breakdown to do further text processing and NLP tasks on the above
like in a pipeline
what do you suggest @beniz
all pdf would need to be converted into images ?
there are scanned pdf as well . so then it would require to run sandwitch lib to amke it OCR ready
*make
Emmanuel Benazera
@beniz
if you look at Figure 3 of their paper, you see they actually use standard object detection from images
they appear to provide the dataset as well, so you should be able to train your own figure detector.
ya
Emmanuel Benazera
@beniz
unless you know what you are doing, I'd use the allenlp code directly
AJAY SAHU
@ajay01994
yes that makes sense , was thinking to create PDF processing as a service
& so for text generation can we add - https://github.com/minimaxir/gpt-2-simple
AJAY SAHU
@ajay01994
if you guys help us in doing that , it would be wonderful since i am quite new to deep detect
Emmanuel Benazera
@beniz
Interesting project, indeed! We're quite busy at the moment though :) You'll sort it out, there's a lot of code ready to use with gpt-2 and allenai stuff.
AJAY SAHU
@ajay01994
Sure !
we will try :)
W8TERM3LON
@W8TERM3LON
Screenshot from 2019-12-01 14-40-51.png
Every time I try to install the gpu version it displays
ERROR: The Compose file './docker-compose.yml' is invalid because:
Unsupported config option for services.deepdetect: 'runtime'
Unsupported config option for services.gpustat_server: 'runtime'
does anybody know why it's unable to install?
W8TERM3LON
@W8TERM3LON
ok I figured it out. It was a out of date docker-compose.
W8TERM3LON
@W8TERM3LON
Screenshot from 2019-12-01 17-54-43.png
Now whenever I try to train a model this shows up
Alexandre Girard
@alx
Hi @W8TERM3LON I suppose you're using the example on this page ? https://www.deepdetect.com/platform/docs/image-classification/
in the Classification options, you should replace host and port with the following values:
host="localhost",
port=1912,
path="/api/deepdetect",
thanks for the feedback, we'll correct the platform documentation on the website
Emmanuel Benazera
@beniz
@cchadowitz-pf I had the basic CI run on your PR, and I'll run another test by hand soon when I can before merging. That's if you don't mind the delay. I appreciate your patience.
cchadowitz-pf
@cchadowitz-pf
that's awesome, thanks! not a problem. any issues come up yet?
(you're talking about #657?)
Emmanuel Benazera
@beniz
Yes #657, the CI had failed due to lack of space. Will run the dlib build by hand then add dlib to CI quickly after that.
cchadowitz-pf
@cchadowitz-pf
:+1: