GREAT work fyi
I'm interested in deploying this throughout our org :Zoop:
interested in doing some paid support?
Hey Matthew, thanks for trying out ml-workspace 👍 We currently cannot provide paid support. However, we would be happy to help you set up a test instance and learn from your requirements & issues. If you like we can schedule a call soon. The ml-hub (for multiuser support) still needs a bit of documentation, so you might need some help for this at the moment.
Hey Jason, thanks a lot for the nice feedback :) Currently, we do not have planned anything in that direction as far as I know but we will discuss it. Do you have experience with Python 3.7 and know about any breaking changes or compatibility issues with libraries compared to current version 3.6?
I personally haven't found anything in 3.7 to break any of my 3.6 programs. But my usage is more intermediate, I do use it for work where I work with reviewing metadata, data flows, etc. using NetworkX and everything that I did in 3.6 worked. But beyond NetworkX, numpy, and pandas, I don't really know and couldn't say.
soo after I run docker run -p 8080:8080 mltooling/ml-workspace:latest I am not able to access Jupyter .. this is a Macbook the only thing on it is OS Mojave and I am trying to run Ml workspace.. I might mention that I am also new to docker, and I don't know if I should pass a work folder or anything to the command?
@flight505 just running
docker run -p 8080:8080 mltooling/ml-workspace:latest should be enough to test the workspace (just access http://localhost:8080). The only requirement is a working docker installation. If it is not working for you, you might try a different port e.g. docker run -p 8081:8080 mltooling/ml-workspace:latest or a restart of the docker daemon/macbook. Have you tried other docker containers? What are the logs you get?
@macshaggy We will most likely update to Python 3.7 until end of this year. There are still a few dependencies which need Python 3.6 for whatever reason, but most of the important once are working fine on 3.7.
current there's only Python2 and Python3
- Create environment:
conda create -n myenv python=3.6 - Activate environment:
source activate myenvy - Install ipykernel:
conda install ipykernel - Install kernel from environment:
python -m ipykernel install --user --name myenv --display-name "Python (myenv)"
After this, you just reload the jupyter website and the new kernel should be available
@namanUIUC Thanks for the feedback! 1) materialdarker is not preinstalled, however, once you have installed it you will be able to choose it from jupyterlab menu. 2) Within the workspace you can use the terminals to install anything you like, as explained here: https://github.com/ml-tooling/ml-workspace#extensibility For example, running
jupyter labextension install @oriolmirosa/jupyterlab_materialdarker in the terminal will install the material darker extension. In Jupyterlab there is also an UI to search and install Jupyterlab extensions (Accessible from the left menu - the puzzel piece)
I see, thanks for the help @LukasMasuch. One thing though, when I try running
jupyter labextension install @oriolmirosa/jupyterlab_materialdarker it installs perfectly but fails to build. Any comments on that? BTW here are the logs for that:Node v11.15.0
Building jupyterlab assets (build:prod:minimize)
> node /opt/conda/lib/python3.6/site-packages/jupyterlab/staging/yarn.js install --non-interactive
yarn install v1.15.2
[1/5] Validating package.json...
[2/5] Resolving packages...
[3/5] Fetching packages...
warning Pattern ["plotly-icons@latest"] is trying to unpack in the same destination "/root/.cache/yarn/v4/npm-plotly-icons-1.
3.13-31cbc2d8832df8a7ed81399ec32f03ef9043c783/node_modules/plotly-icons" as pattern ["plotly-icons@^1.1.5"]. This could resul
t in non-deterministic behavior, skipping.
info fsevents@1.2.9: The platform "linux" is incompatible with this module.
info "fsevents@1.2.9" is an optional dependency and failed compatibility check. Excluding it from installation.
[4/5] Linking dependencies...
warning "nbdime-jupyterlab > nbdime@5.0.1" has unmet peer dependency "codemirror@^5.0.0".
warning "jupyterlab-chart-editor > react-chart-editor > draft-js-export-html@1.2.0" has unmet peer dependency "immutable@3.x.
x".
warning "jupyterlab-chart-editor > react-chart-editor > draft-js-import-html@1.4.1" has unmet peer dependency "immutable@3.x.
x".
warning "jupyterlab-chart-editor > react-chart-editor > draft-js-utils@1.4.0" has unmet peer dependency "immutable@3.x.x".
warning "jupyterlab-chart-editor > react-chart-editor > react-rangeslider@2.2.0" has incorrect peer dependency "react@^0.14.0
|| ^15.0.0".
warning "jupyterlab-chart-editor > react-chart-editor > draft-js-import-html > draft-js-import-element@1.4.0" has unmet peer
dependency "immutable@3.x.x".
[5/5] Building fresh packages...
success Saved lockfile.
Done in 8.03s.
> node /opt/conda/lib/python3.6/site-packages/jupyterlab/staging/yarn.js yarn-deduplicate -s fewer
yarn run v1.15.2
$ /opt/conda/share/jupyter/lab/staging/node_modules/.bin/yarn-deduplicate -s fewer
Done in 0.52s.
> node /opt/conda/lib/python3.6/site-packages/jupyterlab/staging/yarn.js run build:prod:minimize
yarn run v1.15.2
$ cross-env NODE_OPTIONS=--max_old_space_size=4096 webpack --config webpack.prod.minimize.config.js
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
JupyterLab failed to build
Traceback (most recent call last):
File "/opt/conda/lib/python3.6/site-packages/jupyterlab/debuglog.py", line 47, in debug_logging
yield
File "/opt/conda/lib/python3.6/site-packages/jupyterlab/labextensions.py", line 105, in start
core_config=self.core_config)
File "/opt/conda/lib/python3.6/site-packages/jupyterlab/commands.py", line 378, in build
command=command, clean_staging=clean_staging)
File "/opt/conda/lib/python3.6/site-packages/jupyterlab/commands.py", line 583, in build
raise RuntimeError(msg)
RuntimeError: JupyterLab failed to build
Exiting application: jupyter
Hey Carlos, you have to perform all mounts during container startup or give the container privileged access. As you have pointed out, unprivileged containers cannot mount volumes while they are already running. So, either give the workspace privileged access (which, I think, Docker does not recommend) or mount the NAS to your host and then start the container with that location mounted.
Besides mounting, maybe it is an option to use a tool such as
Besides mounting, maybe it is an option to use a tool such as
rsync or similar to keep files on different systems in sync.
This happens on line 51 in the dockerfile
@sim-san Building full workspace image can take quite a while and might cause some build problems. If you just want to change a few things, the easiest way is to just inherit from the ml-workspace image as explained in the FAQs (https://github.com/ml-tooling/ml-workspace#faq) and do your changes. We will make it easier to configure/remove tools in the next versions. In the meantime, to remove tools from being started, you can overwrite the supervisor config (https://github.com/ml-tooling/ml-workspace/blob/develop/resources/config/supervisord.conf) and to do add/remove tools in the open-tool menu you can overwrite this file: https://github.com/ml-tooling/ml-workspace/blob/develop/resources/home/.workspace/tools/1-workspace-tools.json.
Hey Simon, do you mean the options in the MLHub's option page?
So just for understanding, you would like to be able to change the default settings so that, for example,
Right now, you can only set the default images that are shown in the options page but no other options.
So just for understanding, you would like to be able to change the default settings so that, for example,
is_mount_volume is unchecked by default?Right now, you can only set the default images that are shown in the options page but no other options.
At the moment I face a other Problem with ml-worksqace/ml-hub.
A user without admin rights on the ml-hub is not able to open the Visual Studio Code Web. I got the following errors in the log:
A user without admin rights on the ml-hub is not able to open the Visual Studio Code Web. I got the following errors in the log:
12:56:22.188 [ConfigProxy] error: 503 GET /user/test/test_vscode/static/base/images/favicon.ico?v=845272bb369e7a52ef65139fafb905e3 socket hang up
12:56:22.195 [ConfigProxy] error: 503 GET /user/test/test_vscode/static/services/contents.js?v=20191216125140 socket hang up
[I 2019-12-16 12:56:22.205 JupyterHub log:174] 200 GET /hub/error/503?url=%2Fuser%2Ftest%2Ftest_vscode%2Fstatic%2Fbase%2Fimages%2Ffavicon.ico%3Fv%3D845272bb369e7a52ef65139fafb905e3 (@172.17.0.2) 15.47ms
[I 2019-12-16 12:56:22.208 JupyterHub log:174] 200 GET /hub/error/503?url=%2Fuser%2Ftest%2Ftest_vscode%2Fstatic%2Fservices%2Fcontents.js%3Fv%3D20191216125140 (@172.17.0.2) 2.33ms
12:56:22.368 [ConfigProxy] error: 503 GET /user/test/test_vscode/static/components/marked/lib/marked.js?v=20191216125140 socket hang up
12:56:22.369 [ConfigProxy] error: 503 GET /user/test/test_vscode/static/components/codemirror/addon/runmode/runmode.js?v=20191216125140 socket hang up
2019/12/16 12:56:22 [crit] 738#0: *1804 SSL_write() failed (SSL:) while sending to client, client: 127.0.0.1, server: , request: "GET /user/test/test_vscode/static/base/js/security.js?v=20191216125140 HTTP/1.1", upstream: "http://127.0.0.1:8000/user/test/test_vscode/static/base/js/security.js?v=20191216125140", host: "192.168.1.150", referrer: "https://192.168.1.150/user/test/test_vscode/tree?"
12:56:22.372 [ConfigProxy] error: 503 GET /user/test/test_vscode/static/components/codemirror/mode/gfm/gfm.js?v=20191216125140 socket hang up
2019/12/16 12:56:22 [crit] 738#0: *1847 SSL_write() failed (SSL:) while sending to client, client: 127.0.0.1, server: , request: "GET /user/test/test_vscode/static/notebook/js/mathjaxutils.js?v=20191216125140 HTTP/1.1", upstream: "http://127.0.0.1:8000/user/test/test_vscode/static/notebook/js/mathjaxutils.js?v=20191216125140", host: "192.168.1.150", referrer: "https://192.168.1.150/user/test/test_vscode/tree?"
12:56:22.374 [ConfigProxy] error: 503 GET /user/test/test_vscode/static/notebook/js/codemirror-ipython.js?v=20191216125140 socket hang up
[I 2019-12-16 12:56:22.375 JupyterHub log:174] 200 GET /hub/error/503?url=%2Fuser%2Ftest%2Ftest_vscode%2Fstatic%2Fcomponents%2Fmarked%2Flib%2Fmarked.js%3Fv%3D20191216125140 (@172.17.0.2) 3.90ms
[I 2019-12-16 12:56:22.383 JupyterHub log:174] 200 GET /hub/error/503?url=%2Fuser%2Ftest%2Ftest_vscode%2Fstatic%2Fcomponents%2Fcodemirror%2Faddon%2Frunmode%2Frunmode.js%3Fv%3D20191216125140 (@172.17.0.2) 7.40ms
[I 2019-12-16 12:56:22.385 JupyterHub log:174] 200 GET /hub/error/503?url=%2Fuser%2Ftest%2Ftest_vscode%2Fstatic%2Fcomponents%2Fcodemirror%2Fmode%2Fgfm%2Fgfm.js%3Fv%3D20191216125140 (@172.17.0.2) 8.16ms
[I 2019-12-16 12:56:22.387 JupyterHub log:174] 200 GET /hub/error/503?url=%2Fuser%2Ftest%2Ftest_vscode%2Fstatic%2Fnotebook%2Fjs%2Fcodemirror-ipython.js%3Fv%3D20191216125140 (@172.17.0.2) 8.41ms
12:56:36.332 [ConfigProxy] error: 503 GET /user/test/test_vscode/static/components/jquery-ui/themes/smoothness/jquery-ui.min.css?v=3c2a865c832a1322285c55c6ed99abb2 socket hang up
12:56:36.334 [ConfigProxy] error: 503 GET /user/test/test_vscode/static/components/jquery-typeahead/dist/jquery.typeahead.min.css?v=7afb461de36accb1aa133a1710f5bc56 socket hang up
[I 2019-12-16 12:56:36.342 JupyterHub log:174] 200 GET /hub/error/503?url=%2Fuser%2Ftest%2Ftest_vscode%2Fstatic%2Fcomponents%2Fjquery-ui%2Fthemes%2Fsmoothness%2Fjquery-ui.min.css%3Fv%3D3c2a865c832a1322285c55c6ed99abb2 (@172.17.0.2) 7.52ms
[I 2019-12-16 12:56:36.345 JupyterHub log:174] 200 GET /hub/error/503?url=%2Fuser%2Ftest%2Ftest_vscode%2Fstatic%2Fcomponents%2Fjquery-typeahead%2Fdist%2Fjquery.typeahead.min.css%3Fv%3D7afb461de36accb1aa133a1710f5bc56 (@172.17.0.2) 8.54ms
For an admin user everything works fine. Can you help me ?
