These are chat archives for thunder-project/thunder
@wolfbill have you got thunder and it's dependencies installed on your local machine?
Running Spark and thunder on Amazons EC2 (which is a cloud computing service) is the easiest way to launch a large cluster.
The first thing that you need to do is set up an account and your security credentials with amazon web services (AWS) - detailed instructions on how to do this are provided here: http://thunder-project.org/thunder/install_ec2.html
Once you have followed these instructions and have:
you can then launch a cluster on EC2 with thunder and spark installed by typing:
thunder-ec2 -k mykey -i ~/mykey.pem -s <number-of-nodes> launch <cluster-name>
where mykey is the name of your keypair file
and you insert the number of nodes and you give your cluster a name