These are chat archives for thunder-project/thunder

21st
Jan 2016
Sundeep Teki
@sundeepteki
Jan 21 2016 16:03

@freeman-lab Hi Jeremy, I'm trying to install thunder on ec2. Everything works fine except at the last stage and thunder does not install. See error log below.

Spark AMI: ami-35b1885c
Searching for existing cluster testcluster...
Found 1 master(s), 2 slaves
Waiting for instances to start up...
Waiting 160 more seconds...

[Generating cluster's SSH key on master]
[success]
[Transferring cluster's SSH key to slaves]
[success]
[Deploying files to master]
[success]
[Installing Spark (may take several minutes)]
[success]
[Downloading Anaconda]
[success]
[Installing Anaconda]
[success]
[Updating Anaconda libraries]
[success]
[Copying Anaconda to workers]
[success]
[Installing Thunder]
[SSH failure, returning error]

Traceback (most recent call last):
File "/Users/sundeepteki/Applications/anaconda/envs/py26/lib/python2.6/site-packages/thunder/utils/ec2.py", line 542, in <module>
install_thunder(master, opts)
File "/Users/sundeepteki/Applications/anaconda/envs/py26/lib/python2.6/site-packages/thunder/utils/ec2.py", line 207, in install_thunder
ssh(master, opts, "cd thunder && git checkout %s" % tagOrHash)
File "/Users/sundeepteki/Applications/anaconda/envs/py26/lib/python2.6/site-packages/thunder/utils/ec2.py", line 301, in ssh
raise Exception(stdout)
Exception: error: pathspec 'v0.6.0' did not match any file(s) known to git.

i've tried it with latest spark version (as per @sophie63's earlier messages) but that doesn't work either. any solutions? thanks for your help.
Joe Baines-Holmes
@bainzo
Jan 21 2016 20:09
@sundeepteki , have you tried adding the argument, --thunder-version='0.5.1'? I've been having a similar problem (CF #246).
Jeremy Freeman
@freeman-lab
Jan 21 2016 20:11
@sundeepteki and @bainzo i think i just missed something when pushing the latest version, there should be an easy fix for this, will figure it out later today
Joe Baines-Holmes
@bainzo
Jan 21 2016 20:13
Cheers
Sundeep Teki
@sundeepteki
Jan 21 2016 21:35
@freeman-lab thanks! look forward to the fix.