These are chat archives for thunder-project/thunder

11th
Aug 2015
Matt Valley
@mtv2101
Aug 11 2015 18:38
has anyone here tried to integrate thunder/spark into a Torque HPC environment?
Matt Valley
@mtv2101
Aug 11 2015 18:57
I see the discussion with @AlexandreLaborde was on a similar topic. Any specific advice for spark/torque integration would be very useful. We (neural coding at the Allen institute) are just starting to look into this so we have no specific hang-ups yet.
Jeremy Freeman
@freeman-lab
Aug 11 2015 18:57
oh hey @mtv2101 ! great meeting you at the course =)
i don’t know of anyone who’s played with Spark on Torque, I believe @AlexandreLaborde was using a system with Sun Grid Engine
a quick google doesn’t bring up anything on Spark + Torque, but i’d be happy to chat with whoever manages the cluster
the strategy for SGE may apply similarly
Matt Valley
@mtv2101
Aug 11 2015 19:27
It was great meeting you too - and please let me know if/when you are free in Seattle before Friday Harbor. At minimum beers can be had.
I'm discussing torque/spark with our sysadmin to see if he had any experience - I'll let you know if he anticipates any complications