Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Jeremy Barnes
    @jeremybarnes
    Or otherwise, start up the normal Docker container on the remote host (removing the localhost-only port binding so you can access it from other machines), then load up and run your notebook remotely from the host. That way the other person can connect to the same port on the remote machine to access the API.
    sniper0110
    @sniper0110
    Ok, I see. Well, I've been trying something myself, I was thinking of pushing the docker image (containing all the resources that I used to make the API) to docker hub and then pulling it from the remote machine. Can this be a solution?
    But I am having a problem when trying to push the image to docker hub, it says : (denied: requested access to the resource is denied)
    sniper0110
    @sniper0110

    @jeremybarnes , your second suggestion seems like an easy way out. I have ssh access to the remote host, I have installed docker in it. I believe you are talking about establishing a tunnel using ssh. Like on mldb website :

    ssh -f -o ExitOnForwardFailure=yes <user>@<remotehost> -L <localport>:127.0.0.1:<mldbport> -N

    So, now someone who has access to the remote host will also have access to mldb image that is on my local machine right ?

    sniper0110
    @sniper0110

    Now, that I have established a tunnel using ssh, should I use just :

    docker run --rm=true \
    -v </absolute/path/to/mldb_data>:/mldb_data \
    -e MLDB_IDS="id" \
    -p 127.0.0.1:<mldbport>:80 \
    quay.io/mldb/mldb:latest

    To access the container from the remote host?

    Jeremy Barnes
    @jeremybarnes
    Yes, that should do it
    If you want to allow anyone to connect (note: not recommended) you can use -p <mldbport>:80 instead
    that way the port 80 on the receiving machine will be open to the internet, and they won't need to connect via the SSH tunner
    tunnel
    sniper0110
    @sniper0110

    I did exactly that (I even allowed anyone to connect) and I got the following on my shell prompt :

    Aborting boot: directory mapped to /mldb_data owned by root

    Expected owner uid from MLDB_IDS is: 1001

    If the directory mapped to /mldb_data did not exist before launching MLDB,
    it is automatically created and owned by root. If this is what happened,
    please change the owner of the directory and relaunch.

    * /etc/my_init.d/05-mldb-id-mapping.sh failed with status 1

    PS : I tried to launch the container from the remote server.
    Jeremy Barnes
    @jeremybarnes
    You need to change to the directory from which you launched, and change the owner of mldb_data
    in order to avoid problems with files being owned by root, mldb needs the mldb_data directory to be owned by the current user. You can normally fix it with sudo chown $UID.$UID mldb_data in the current directory
    Gustavo Brian
    @gbrian
    Hi there!
    Nice tool, I'm trying to run KDNuggets Transfer Learning Blog Postwith my own set of images.
    After preparing images I still getting an exception during the call to inception seems that one of the images fails.
    How I can filter out those images failing withoout breaking whole process? Thanks
    François Maillet
    @mailletf
    You can wrap the call to inception in a try() SQL statement. check the "Handling errors line by line" section here: https://docs.mldb.ai/doc/#builtin/sql/ValueExpression.md.html
    Gustavo Brian
    @gbrian
    @mailletf :+1:
    sniper0110
    @sniper0110
    Hello again,
    So after creating that API by using my re-trained model of inception, I want to know something. Since all of the mldb functions that I used make REST calls, can I make REST calls from ubuntu shell to the local server to predict food using that jupyter script? If yes, then how can I do that?
    Thanks in advance :)
    Jeremy Barnes
    @jeremybarnes
    Yes you can. You can use the curl command; there are plenty of tutorials out there on how to do that.
    sniper0110
    @sniper0110
    Alright, thanks for the quick answer @jeremybarnes :D
    datascienceit
    @datascienceit

    Hello,

    I'm trying to run mldb community on kubernetes, but can't managed to pass the ssh tunnel.
    I've opened the Node port, and port-proxy to the pod, but I get rejected by mldb, what to do?

    datascienceit
    @datascienceit
    And BTW, When will the enterprise version become open-sourced?
    Rodney Degracia
    @rdegraci
    After I build the MLDB Docker container, where is that container located on the machine ?
    I am just curious to know, since I have been getting this error when I try to start hte container: MLDB (version 2017.06.20.dev-e84f8da) is starting up
    /opt/bin/mldb_runner: error while loading shared libraries: libxml++-2.6.so.2: cannot open shared object file: No such file or directory
    Perhaps I need to go into the container and fix something ?
    Rodney Degracia
    @rdegraci
    In Ubuntu, the libxml++2.6.so is located in /usr/lib and I had to edit the ldconfig config files to add /usr/lib perhaps that needs to be done to the base MLDB Docker image ?
    Rodney Degracia
    @rdegraci

    Yeah something is definitely not right, when i git checkout v2017.01.24.0 and build MLDB, it runs with no issues: docker run --rm=true -v /home/ubuntu/mldb_data:/mldb_data -e MLDB_IDS="id" -p 8080:80 quay.io/mldb/mldb:ubuntu-HEAD-5b8653bc2828f1a89e23876e2d05c9a21dd2ed6a

    MLDB (version 2017.06.20.dev-5b8653b) is starting up
    reading configuration from file: '/etc/mldb.conf'

    MLDB ready

    Looks like, perhaps, some sort of CI needs to be set up that does a build and an initial smoke test, to make sure that the latest container actually runs
    Rodney Degracia
    @rdegraci
    Anyone alive ? :)
    François-Michel L'Heureux
    @FinchPowers
    Hi @rdegraci
    Sorry for the delay
    I think the version of mldb_base we have online is too old. I'll push a new one.
    (This is the base image used to build the mldb docker)
    François-Michel L'Heureux
    @FinchPowers
    Done
    so you should run "docker pull quay.io/mldb/mldb_base:14.04" and then rebuild
    Rodney Degracia
    @rdegraci
    I'd suggest a smoke test in your build pipeline. I burned about 5 hours trying to figure out the problem ;) But thank you!
    Btw, I really like what I see about the MLDB.
    François-Michel L'Heureux
    @FinchPowers
    Sorry about that. Thanks for your feedback.
    Rodney Degracia
    @rdegraci
    I'm just about ready to tell everyone I know, to start using MLDB, to become productive immediately.
    Vladimir Venediktov
    @venediktov
    hi @mldbai , I see you guys are all together continue working on another cool product not part of RTBkit. Our team @venediktov @abushev and @mrbald would love to learn how we could integrate your product to vanilla-rtb . Perhaps there is some room for cooperation ? You can ping us on Gitter or send email to info@forkbid.com . Best , vanilla-team.
    DWSimmons
    @DWSimmons
    I'm trying to wrap my head around mldb. Correct me if I'm wrong, the database portion is analogous to key-value store. Is that correct?
    the value could be a dataset, which can be accessed through REST or SQL queries which can conceptually pass a DAG. Is that correct?
    GetGeeks
    @GetGeeks
    I am tring to get started with MLDB have I come to the right place
    GetGeeks
    @GetGeeks
    wow this is not an active place
    David Johnson
    @dmjio
    ping
    Does MLDB SQL support inner joins?
    Jeremy Barnes
    @jeremybarnes
    It does. However, I wouldn't use it for anything more than toy projects as there is no longer a team behind it to support users.
    David Johnson
    @dmjio
    @jeremybarnes interesting, did the company dissolve? Was it an acquihire?
    @jeremybarnes you wrote most of it didn't you? I'd be curious, did you create a virtual machine and a custom on-disk B-tree implementation? I'm thinking of sqlite here, was that an inspiration at all
    pratcooper
    @pratcooper
    is this group still active ? needed help to get started
    @FinchPowers Are you guys active with this ?
    Joe
    @ProGamerCode
    Hello I'm interested in modifing the source code for use with my database administration course for my masters at Syracuse University.