jupyterhub/jupyterhub

Ask quick dev questions about JupyterHub, the multi-user server for Jupyter notebooks. Use discourse.jupyter.org for user questions, support, and discussion.

YuviPanda

@Yuvi:matrix.org

[m]

ah, i thought we'd use meesecksbot

or whatever that is called

Min RK

@minrk

Yeah, sure. Those are just the PRs to tell it about

(I used ghpro which is the manual predecessor to meeseeksbot, but does the same thing)

YuviPanda

@Yuvi:matrix.org

[m]

great

@minrk: shall i just merge the backport PRs myself?

Min RK

@minrk

yes, go ahead

YuviPanda

@Yuvi:matrix.org

[m]

i will do so after tests pass

Min RK

@minrk

:+1:

I will probably have to run before you finish, but might be on later tonight.

It's a holiday weekend (Monday off), so might be away for a bit

YuviPanda

@Yuvi:matrix.org

[m]

@minrk: nice! I don't plan on doing the release today anyway

it's friday night here too!

(am visiting india for a bit)

Min RK

@minrk

ah, nice!

YuviPanda

@Yuvi:matrix.org

[m]

it's so funny that the merge conflict in https://github.com/jupyterhub/jupyterhub/pull/3919#issuecomment-1146067056 is caused by the use of reorder-python-imports, whose stated goal is to reduce merge conflicts :D It's because we switched to isort ofc

Jay Leimer

@CodingJinxx

How do i migrate the database in jupyterhub using alembic

minrk

@minrk:matrix.org

[m]

jupyterhub upgrade-db will upgrade with alembic

Jay Leimer

@CodingJinxx

How can i create a migration, i can see a dbutils file that creates the alembic.ini. How can I execute it

Figured it out

minrk

@minrk:matrix.org

[m]

You can invoke any alembic command with python -m jupyterhub.dbutil alembic …

Jay Leimer

@CodingJinxx

Ah thank you, i edited it manually

Do i need to register new models somewhere?

minrk

@minrk:matrix.org

[m]

I’m not sure. If you add new models, I’d suggest using your own schema and your own setup.

Jay Leimer

@CodingJinxx

Can i not just add a model to orm.py?

Nevermind i was missing --autogenerate when creating my revision

minrk

@minrk:matrix.org

[m]

Not in a way that will be supported or sustainable across upgrades

Jay Leimer

@CodingJinxx

Oh i see

If i run my own database config, ill be able to receive future updates

Luciano Resende

@lresende

What are the requirements for a JupyterHub DB, if I have two instances (e.g. test instances) do they need to point to different dbs? same db ok? etc?

Erik Sundell

@consideRatio

I think different will be required if they are running at the same time at least

If the jupyterhub instances are running at the same time.

Min RK

@minrk

There was a proposal to add table prefixes so multiple hubs could coexist in one db, but it was never finished: jupyterhub/jupyterhub#2327

of course, with postgres/mysql, one database server can serve many databases (psql --command 'CREATE DATABASE jupyterhub-test')

Luciano Resende

@lresende

thank you

Ramon Ramirez-Linan

@rezuma

Thanks @yuvipanda ! Do I need all of this?

hub:
  extraConfig: |
    from kubernetes import client
    def modify_pod_hook(spawner, pod):
        pod.spec.containers[0].security_context = client.V1SecurityContext(
            privileged=True,
            capabilities=client.V1Capabilities(
                add=['SYS_ADMIN']
            )
        )
        return pod
    c.KubeSpawner.modify_pod_hook = modify_pod_hook

singleuser:
  uid: 0
  gid: 0
  storage:
    extraVolumes:
      - name: fuse
        hostPath:
          - path: /dev/fuse
    extraVolumeMounts:
      - name: fuse
        mountPath: /dev/fuse

Hello, I am trying to mount Goofys on the SingleUser Notebook and since it uses Fuse I need access to /dev/fuse. I this still one of the recommended approach to using Fuse?

Ramon Ramirez-Linan

@rezuma

Hello we maintain several dozens of z2jh deployment and sometimes we have different versions depending on the use case. Is there a config option that i can use to add the value of our specific release so i can quickly identify it by looking somewhere in the jlab interface? something like for instance what you get in help->about or similar

Erik Sundell

@consideRatio

Hmmm... I dont think so. You can see a jupyterhub version via /hub/api/version i think.

Not obvious that such information should be provided for security reasons. Also not sure how to expose it in a sensible way. Hmmm...

Michael

@michawu:matrix.org

[m]

Hello, I tried to install jupyterhub on kubernates with the following command:
helm upgrade --cleanup-on-fail --install jhub jupyterhub/jupyterhub --namespace jhub --create-namespace --version=1.2.0 --values config.yaml
But I've got the following error message:

Error: UPGRADE FAILED: pre-upgrade hooks failed: timed out waiting for the condition

With kubectl -n jhub get events --sort-by='{.lastTimestamp}' I've found the following messages:

5m57s Warning FailedCreatePodSandBox pod/hook-image-puller-hq5c4 Failed to create pod sandbox: rpc error: code = Unknown desc = [failed to set up sandbox container "04d4aacd7e577cd3b65aa5c19607da7a27bbc6b77a645d8b574ccd051241db71" network for pod "hook-image-puller-hq5c4": networkPlugin cni failed to set up pod "hook-image-puller-hq5c4_jhub" network: unable to allocate IP address: Post "http://127.0.0.1:6784/ip/04d4aacd7e577cd3b65aa5c19607da7a27bbc6b77a645d8b574ccd051241db71": dial tcp 127.0.0.1:6784: connect: connection refused, failed to clean up sandbox container "04d4aacd7e577cd3b65aa5c19607da7a27bbc6b77a645d8b574ccd051241db71" network for pod "hook-image-puller-hq5c4": networkPlugin cni failed to teardown pod "hook-image-puller-hq5c4_jhub" network: Delete "http://127.0.0.1:6784/ip/04d4aacd7e577cd3b65aa5c19607da7a27bbc6b77a645d8b574ccd051241db71": dial tcp 127.0.0.1:6784: connect: connection refused] 5m57s Warning FailedCreatePodSandBox pod/hook-image-puller-86mm4 Failed to create pod sandbox: rpc error: code = Unknown desc = [failed to set up sandbox container "124446411d73d3ca2bd914ab4a43d61dd1e5656bf2bb608fe26fce8ae026d0b6" network for pod "hook-image-puller-86mm4": networkPlugin cni failed to set up pod "hook-image-puller-86mm4_jhub" network: unable to allocate IP address: Post "http://127.0.0.1:6784/ip/124446411d73d3ca2bd914ab4a43d61dd1e5656bf2bb608fe26fce8ae026d0b6": dial tcp 127.0.0.1:6784: connect: connection refused, failed to clean up sandbox container "124446411d73d3ca2bd914ab4a43d61dd1e5656bf2bb608fe26fce8ae026d0b6" network for pod "hook-image-puller-86mm4": networkPlugin cni failed to teardown pod "hook-image-puller-86mm4_jhub" network: Delete "http://127.0.0.1:6784/ip/124446411d73d3ca2bd914ab4a43d61dd1e5656bf2bb608fe26fce8ae026d0b6": dial tcp 127.0.0.1:6784: connect: connection refused] 5m56s Warning FailedCreatePodSandBox pod/hook-image-awaiter-m2pgc Failed to create pod sandbox: rpc error: code = Unknown desc = [failed to set up sandbox container "08e8b9698c9464a367602df79abd5995aed67f704300bc3082fed2d4849dd750" network for pod "hook-image-awaiter-m2pgc": networkPlugin cni failed to set up pod "hook-image-awaiter-m2pgc_jhub" network: unable to allocate IP address: Post "http://127.0.0.1:6784/ip/08e8b9698c9464a367602df79abd5995aed67f704300bc3082fed2d4849dd750": dial tcp 127.0.0.1:6784: connect: connection refused, failed to clean up sandbox container "08e8b9698c9464a367602df79abd5995aed67f704300bc3082fed2d4849dd750" network for pod "hook-image-awaiter-m2pgc": networkPlugin cni failed to teardown pod "hook-image-awaiter-m2pgc_jhub" network: Delete "http://127.0.0.1:6784/ip/08e8b9698c9464a367602df79abd5995aed67f704300bc3082fed2d4849dd750": dial tcp 127.0.0.1:6784: connect: connection refused] 3m52s Warning FailedKillPod pod/hook-image-awaiter-gdgd7 error killing pod: failed to "KillPodSandbox" for "3f74aa20-9fbb-4050-8970-0fe204575859" with KillPodSandboxError: "rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod "hook-image-awaiter-gdgd7_jhub" network: Delete "http://127.0.0.1:6784/ip/cbe73be6bfd0b53fafddd0a20d7e42263edbac5c82dab0b5a6d13fa1b2867891": dial tcp 127.0.0.1:6784: connect: connection refused"

Is there someting missing in my config?

Michael

@michawu:matrix.org

[m]

:point_up: Edit: Hello, I tried to install jupyterhub on kubernetes with the following command:
helm upgrade --cleanup-on-fail --install jhub jupyterhub/jupyterhub --namespace jhub --create-namespace --version=1.2.0 --values config.yaml
But I've got the following error message:

Error: UPGRADE FAILED: pre-upgrade hooks failed: timed out waiting for the condition

With kubectl -n jhub get events --sort-by='{.lastTimestamp}' I've found the following messages:

5m57s Warning FailedCreatePodSandBox pod/hook-image-puller-hq5c4 Failed to create pod sandbox: rpc error: code = Unknown desc = [failed to set up sandbox container "04d4aacd7e577cd3b65aa5c19607da7a27bbc6b77a645d8b574ccd051241db71" network for pod "hook-image-puller-hq5c4": networkPlugin cni failed to set up pod "hook-image-puller-hq5c4_jhub" network: unable to allocate IP address: Post "http://127.0.0.1:6784/ip/04d4aacd7e577cd3b65aa5c19607da7a27bbc6b77a645d8b574ccd051241db71": dial tcp 127.0.0.1:6784: connect: connection refused, failed to clean up sandbox container "04d4aacd7e577cd3b65aa5c19607da7a27bbc6b77a645d8b574ccd051241db71" network for pod "hook-image-puller-hq5c4": networkPlugin cni failed to teardown pod "hook-image-puller-hq5c4_jhub" network: Delete "http://127.0.0.1:6784/ip/04d4aacd7e577cd3b65aa5c19607da7a27bbc6b77a645d8b574ccd051241db71": dial tcp 127.0.0.1:6784: connect: connection refused] 5m57s Warning FailedCreatePodSandBox pod/hook-image-puller-86mm4 Failed to create pod sandbox: rpc error: code = Unknown desc = [failed to set up sandbox container "124446411d73d3ca2bd914ab4a43d61dd1e5656bf2bb608fe26fce8ae026d0b6" network for pod "hook-image-puller-86mm4": networkPlugin cni failed to set up pod "hook-image-puller-86mm4_jhub" network: unable to allocate IP address: Post "http://127.0.0.1:6784/ip/124446411d73d3ca2bd914ab4a43d61dd1e5656bf2bb608fe26fce8ae026d0b6": dial tcp 127.0.0.1:6784: connect: connection refused, failed to clean up sandbox container "124446411d73d3ca2bd914ab4a43d61dd1e5656bf2bb608fe26fce8ae026d0b6" network for pod "hook-image-puller-86mm4": networkPlugin cni failed to teardown pod "hook-image-puller-86mm4_jhub" network: Delete "http://127.0.0.1:6784/ip/124446411d73d3ca2bd914ab4a43d61dd1e5656bf2bb608fe26fce8ae026d0b6": dial tcp 127.0.0.1:6784: connect: connection refused] 5m56s Warning FailedCreatePodSandBox pod/hook-image-awaiter-m2pgc Failed to create pod sandbox: rpc error: code = Unknown desc = [failed to set up sandbox container "08e8b9698c9464a367602df79abd5995aed67f704300bc3082fed2d4849dd750" network for pod "hook-image-awaiter-m2pgc": networkPlugin cni failed to set up pod "hook-image-awaiter-m2pgc_jhub" network: unable to allocate IP address: Post "http://127.0.0.1:6784/ip/08e8b9698c9464a367602df79abd5995aed67f704300bc3082fed2d4849dd750": dial tcp 127.0.0.1:6784: connect: connection refused, failed to clean up sandbox container "08e8b9698c9464a367602df79abd5995aed67f704300bc3082fed2d4849dd750" network for pod "hook-image-awaiter-m2pgc": networkPlugin cni failed to teardown pod "hook-image-awaiter-m2pgc_jhub" network: Delete "http://127.0.0.1:6784/ip/08e8b9698c9464a367602df79abd5995aed67f704300bc3082fed2d4849dd750": dial tcp 127.0.0.1:6784: connect: connection refused] 3m52s Warning FailedKillPod pod/hook-image-awaiter-gdgd7 error killing pod: failed to "KillPodSandbox" for "3f74aa20-9fbb-4050-8970-0fe204575859" with KillPodSandboxError: "rpc error: code = Unknown desc = networkPlugin cni failed to teardown pod "hook-image-awaiter-gdgd7_jhub" network: Delete "http://127.0.0.1:6784/ip/cbe73be6bfd0b53fafddd0a20d7e42263edbac5c82dab0b5a6d13fa1b2867891": dial tcp 127.0.0.1:6784: connect: connection refused"

Is there someting missing in my config?

Ramon Ramirez-Linan

@rezuma

Not obvious that such information should be provided for security reasons. Also not sure how to expose it in a sensible way. Hmmm...

I actually decided to use Kubernetes Python sdk to create a way to automatically create documentation for deployed Jupyterhubs. I have most of the fields that I need except for the Container Image that the singleuser notebook is using. I can get that from the singleuser pod when is running (jupyter-<user>) but there may be moments where no such pod is running. Is there any other place in Kubernetes where that info is kept?

Marcel Wallschläger

@mwallschlaeger

hi everyone i'm using the helm chart to run jupyterhub on kubernetes everything works like charm. I only have a question regarding system package installation on running user jupyter containers. is there a way to set the default password for the jupyter/... containers ?

Mohamed Elhayany

@Melhaya

Hi there,

I am using jupyterhub/ltiauthenticator to authenticate Jupyter sessions inside docker containers from a MOOC platform, which seems to work without any issues.

Currently, I would like to use LTI to communicate back a "score" from Jupyter (e.g. a number resulting from the execution of a cell) that would enter the platform grading system.

Does anyone have hints in the direction of achieving this sort of functionality (perhaps as a jupyter service in the config file) or a script that can be used to do so?

Your help is highly appreciated! Thanks :)

vasa

@vasa47

Hi I am using custom authenticator in my app. after successful authentication in CustomeLoginHandler(BaseHandler) ... redirection to next_url goes to again login page .. Any help would be much appreciated

Coimirceoir MacDohmnull

@CoimirceoirMD_twitter

Hello,

We've installed Jupyter under Ubuntu 20.04 LTS and are encountering an odd error when attempting to add a new code snippet

Uncaught (in promise) TypeError: this.codeSnippetList is not iterable
at hn.duplicateNameExists (CodeSnippetService.js:113:36)
at Qn.updateSnippet (CodeSnippetEditor.js:264:53)
at Qn.saveChange (CodeSnippetEditor.js:244:18)
at Object.qe (react-dom.production.min.js:52:317)
at Je (react-dom.production.min.js:52:471)
at en (react-dom.production.min.js:53:35)
at Yr (react-dom.production.min.js:100:68)
at Xr (react-dom.production.min.js:101:380)
at react-dom.production.min.js:113:65
at Ae (react-dom.production.min.js:292:189)

We've done as much debugging as we're able at the moment and would like to know if anyone has encountered (and solved) what this error might indicate.

blavoie

@blavoie:matrix.org

[m]

Anyone in the mood to discuss containerized python-poetry jupyter projects?

Angus Hollands

@agoose77:matrix.org

[m]

Abstractly , yes 😉

langdonholmes

@langdonholmes

Does anyone know how to mark a profileList option as "unavailable" once the required resources are consumed? In our profileList, we have a GPU server that consumes our one and only GPU. However, if someone else selects that server while the GPU is already in use, Kubernetes seems to look for a different GPU node for about 60 seconds before failing and the JupyterHub interface is pretty non-responsive during this time. We are looking for a more graceful way to inform users that the GPU is already in use. I imagine there is a simple solution on the Kubernetes side of things... some way to tell Kubernetes not to bother searching for a different GPU node?
EDIT: This is a Z2JH deployment on a bare metal server.
Config is here: https://github.com/langdonholmes/as-alesl-nlp.dyn.gsu.edu/blob/main/config.yaml

Where communities thrive

People

Repo info

Activity