These are chat archives for thunder-project/thunder
sparkcluster, in Janelia it is in standalone mode. As far as
thunderis concerned, they are both the same. You would need a Jupyter notebook and a way to get a spark context in it, which might be different then how it is done in Janelia. Is this the part you need help with?
import numpy print(numpy.__file__) def test1(x): import numpy return numpy.__file__ data = sc.range(10).map(test1).collect() print(data)