These are chat archives for thunder-project/thunder
pip install thunder-python, but then
thunderjust does start. When do I need to start the cluster? Thanks!
@nvladimus to your second question: in general, no, you could always just ssh up to a cluster with Thunder and Spark already installed, in which case you don't really need anything (not even Thunder) beyond an ssh client. You do need Spark to be installed locally, or at least have access to Spark's ec2.py script, in order to launch an AWS cluster with the thunder-ec2 script.
I unfortunately do not know enough about the ipython notebook setup to be able to speak to that with any authority - my guess would be that you should be able to ssh into the cluster, launch the notebook server on the cluster using the cluster's installation of Thunder and Spark, and then connect to that running notebook from your local browser. In which case again you shouldn't have to install anything on your local machine. But hopefully somebody else who uses the notebook routinely would be able to confirm this?
spark-janeliagitter with some notes on how to use Thunder on the local cluster, if that's what you're looking for