These are chat archives for ipython/ipython

24th
Apr 2015
Min RK
@minrk
Apr 24 2015 00:16
The validator can only run on in-memory notebooks. When a notebook is read, it may be converted from another version, in which case the orig_nbformat key is populated.
This key is used to show warnings about the fact that a notebook has been upgraded from the version on disk.
It may be that the key should be removed from the schema, since it is not part of the notebook file format.
Dale Jung
@dalejung
Apr 24 2015 13:35
pew
oops, wrong chan. testing gitter irc bridge
Kyle Kelley
@rgbkrk
Apr 24 2015 16:52
Feel like I need to continue hating myself for the way cross origin websockets are configured
Kyle Kelley
@rgbkrk
Apr 24 2015 18:35
I'm on the path then I suppose
Paul Ivanov
@ivanov
Apr 24 2015 18:39
heads up: just got an alert that a major power failure is affecting UC Campus
Kyle Kelley
@rgbkrk
Apr 24 2015 18:43
@ssanderson just want to say thank you again for ipython/ipython#6861 ;) Just started using it
Scott Sanderson
@ssanderson
Apr 24 2015 18:44
@rgbkrk awesome!
(I justed added basically the same thing to JupyterHub as well btw)
s/justed/just
(jupyter/jupyterhub#238)
Kyle Kelley
@rgbkrk
Apr 24 2015 19:46
Conda apparently sticks kernels in ~/.conda/share/jupyter
jovyan@92d4e35e99af:~/.conda/share/jupyter$ ls kernels/
ir
It seems like its not picking up the Julia kernel logo/PNG, which got installed in ~/.ipython/kernels
The kernel itself is picked up, but I get a 404 on the image
@Carreau can I have you take a look at a setup?
Min RK
@minrk
Apr 24 2015 20:03
@rgbkrk what do you mean by 'sticks kernels' there?
How did you install the kernel?
Kyle Kelley
@rgbkrk
Apr 24 2015 20:03
the kernel specs for the R kernel end up in ~/.conda/share/jupyter
Min RK
@minrk
Apr 24 2015 20:04
How did you install it?
Kyle Kelley
@rgbkrk
Apr 24 2015 20:04
Which I installed using the R channel with conda
@asmeurer ^
That one gets picked up fine
Min RK
@minrk
Apr 24 2015 20:06
Installing with conda, it makes sense to put it there.
Kyle Kelley
@rgbkrk
Apr 24 2015 20:06
It's the Julia kernel, installed via RUN julia -e 'Pkg.add("IJulia")'that's mucked up
Min RK
@minrk
Apr 24 2015 20:06
That's the only place conda writes to
What's the problem, though?
Kyle Kelley
@rgbkrk
Apr 24 2015 20:06
For some reason the kernel spec is picked up but the logo isn't
Min RK
@minrk
Apr 24 2015 20:06
oh, weird
for Julia or R?
Kyle Kelley
@rgbkrk
Apr 24 2015 20:06
Julia
Min RK
@minrk
Apr 24 2015 20:06
which is in .ipython/kernels?
Kyle Kelley
@rgbkrk
Apr 24 2015 20:07
Sent you a link to the running server
yeah
oh yeah and terminals don't work either
;)
Just saw you tried to load one
I posted an issue about that
[W 20:06:56.980 NotebookApp] 404 GET /terminals (169.229.158.53) 1.09ms referer=None
[E 20:07:00.149 NotebookApp] Uncaught exception
    Traceback (most recent call last):
      File "/opt/conda/lib/python3.4/site-packages/tornado/http1connection.py", line 236, in _read_message
        delegate.finish()
      File "/opt/conda/lib/python3.4/site-packages/tornado/httpserver.py", line 269, in finish
        self.delegate.finish()
      File "/opt/conda/lib/python3.4/site-packages/tornado/web.py", line 1898, in finish
        self.execute()
      File "/opt/conda/lib/python3.4/site-packages/tornado/web.py", line 1918, in execute
        **self.handler_kwargs)
      File "/opt/conda/lib/python3.4/site-packages/tornado/websocket.py", line 127, in __init__
        **kwargs)
      File "/opt/conda/lib/python3.4/site-packages/tornado/web.py", line 176, in __init__
        self.clear()
      File "/opt/conda/lib/python3.4/site-packages/tornado/web.py", line 280, in clear
        self.set_default_headers()
      File "/opt/conda/lib/python3.4/site-packages/IPython/html/base/handlers.py", line 209, in set_default_headers
        self.set_header("Access-Control-Allow-Origin", self.allow_origin)
      File "/opt/conda/lib/python3.4/site-packages/tornado/websocket.py", line 375, in _disallow_for_websocket
        if self.stream is None:
    AttributeError: 'TermSocket' object has no attribute 'stream'
Min RK
@minrk
Apr 24 2015 20:08
Tornado version?
Kyle Kelley
@rgbkrk
Apr 24 2015 20:09
I'm running with ipython notebook --ip=* --NotebookApp.allow_origin='*' --no-browser by the way, as well as the ipython notebook config from docker demo images
uhhh
tornado==4.1
Min RK
@minrk
Apr 24 2015 20:09
IPython version?
Kyle Kelley
@rgbkrk
Apr 24 2015 20:09
Should be 3.1
Min RK
@minrk
Apr 24 2015 20:10
3.1 stable, or 3.x branch?
Kyle Kelley
@rgbkrk
Apr 24 2015 20:10
Stable
I'm trying to rely on conda as much as I can here
Min RK
@minrk
Apr 24 2015 20:10
hm
Crap, we keep losing power on campus
Bas Nijholt
@basnijholt
Apr 24 2015 20:20
Is it possible with IPython.parallel to run engines on the local machine and over ssh at the same time?
Min RK
@minrk
Apr 24 2015 20:21
@basnijholt yes
you can add engines in as many ways as you like, at any time.
Bas Nijholt
@basnijholt
Apr 24 2015 20:23

So I should add
c.IPClusterEngines.engine_launcher_class = 'SSH' c.LocalControllerLauncher.controller_args = ["--ip='*'"] c.ControllerLauncher.controller_args = ["--ip='*'"] c.SSHEngineSetLauncher.engines = { 'hpc1': 28, 'hpc2': 28}

and c.IPClusterStart.controller_launcher_class = 'LocalControllerLauncher' c.IPClusterStart.engine_launcher_class = 'LocalEngineSetLauncher' to my config?

Min RK
@minrk
Apr 24 2015 20:24
That would be one way to do it, sure.
You can leave out the controller_launcher_class, since that's setting the default
Bas Nijholt
@basnijholt
Apr 24 2015 20:25
Ah, so I could also start two clusters?
Min RK
@minrk
Apr 24 2015 20:25
What that will do is ipcluster start will spawn local engines, but a later call to ipcluster engines will add engines with SSH to the running cluster.
@basnijholt no
I think ipcluster start and ipcluster engines having different launchers is confusing, so what I would do is leave out the engine_launcher_class from config, so that ipcluster engines starts local engines as well.
Then, if you want to add engines with ssh, you would do: ipcluster engines --engines=SSH
So it's only SSH on request
Kyle Kelley
@rgbkrk
Apr 24 2015 20:27
Big storm?
Min RK
@minrk
Apr 24 2015 20:27
No, there was smoke coming out of one of the campus substations.
Blue skies.
Kyle Kelley
@rgbkrk
Apr 24 2015 20:27
Wowsers
Min RK
@minrk
Apr 24 2015 20:28
Might be people stealing copper wires again. That happened last year, causing a big-ish explosion.
Kyle Kelley
@rgbkrk
Apr 24 2015 20:28
oops I killed that notebook server
back on
Sitting with @asmeurer now, it looks like the IRKernel or IRDisplay packages are out of date, and one of them needs a release
Bas Nijholt
@basnijholt
Apr 24 2015 20:33
@minrk where do I specify the username and server if I start with ipcluster engines --engines=SSH?
Kyle Kelley
@rgbkrk
Apr 24 2015 20:34
I'm just whittling down issues with the setup while I talk to Aaron
Min RK
@minrk
Apr 24 2015 20:38
@basnijholt leave the configuration of the SSH launcher in ipcluster_config
Just not the line that makes it the default launcher.
At least that's what I would do.
Bas Nijholt
@basnijholt
Apr 24 2015 20:40
So ipcluster engines --engines=SSH --profile=ssh, if I have my details in profile_ssh/ipcluster_config?
Min RK
@minrk
Apr 24 2015 20:41
Sure. Make sure you pass the same --profile=ssh to every command.
Bas Nijholt
@basnijholt
Apr 24 2015 20:42
OK. I left out #c.IPClusterEngines.engine_launcher_class = 'SSH'
and now get
ipcluster engines --profile=ssh
2015-04-24 22:41:07.976 [IPClusterEngines] IPython cluster: started
2015-04-24 22:41:07.976 [IPClusterEngines] Starting engines with [daemon=False]
2015-04-24 22:41:07.977 [IPClusterEngines] Starting 32 Engines with LocalEngineSetLauncher
2015-04-24 22:41:16.727 [IPClusterEngines] ERROR | 
            Engines shutdown early, they probably failed to connect.

            Check the engine log files for output.

            If your controller and engines are not on the same machine, you probably
            have to instruct the controller to listen on an interface other than localhost.

            You can set this by adding "--ip='*'" to your ControllerLauncher.controller_args.

            Be sure to read our security docs before instructing your controller to listen on
            a public interface.
Min RK
@minrk
Apr 24 2015 20:42
And your controller is running and your local engines are connected?
Bas Nijholt
@basnijholt
Apr 24 2015 20:44
ah I should have done:ipcluster start --profile=ssh and then ipcluster engines --engines=SSH --profile=ssh.
Min RK
@minrk
Apr 24 2015 20:44
yes
Bas Nijholt
@basnijholt
Apr 24 2015 20:44
It works, thanks!
Min RK
@minrk
Apr 24 2015 20:44
yay!
Kyle Kelley
@rgbkrk
Apr 24 2015 20:57
Ok, the Julia kernel logo not displaying was a space in the name issue
"julia $(VERSION.major).$(VERSION.minor)"*debugdesc)
I don't know if it's an IPython bug or an IJulia bug
I copied the julia 0.3 kernel directory to .ipython/kernels/julia and the logo now comes up
Min RK
@minrk
Apr 24 2015 20:59
space in the filename?
The filename of the logo file is part of the spec
oh, space in the kernelspec folder name?
Kyle Kelley
@rgbkrk
Apr 24 2015 21:02
yes
The last q, space in the kernelspec folder name
I'm digging through the repos to find it now
Min RK
@minrk
Apr 24 2015 21:05
I think we are going to exclude spaces from valid kernelspec directory names, so we don't have to deal with URL escaping.
Kyle Kelley
@rgbkrk
Apr 24 2015 21:22
ok, I'll update my PR to IJulia then.
It's URL escaped when it tries to grab the logo
Min RK
@minrk
Apr 24 2015 21:24
If we don't forbid it formally, trusting us to get URL escaping right seems like a bad plan.