images.map(lambda v: v - gaussian_filter(v))
spark
cluster, in Janelia it is in standalone mode. As far as thunder
is concerned, they are both the same. You would need a Jupyter notebook and a way to get a spark context in it, which might be different then how it is done in Janelia. Is this the part you need help with?
import numpy
print(numpy.__file__)
def test1(x):
import numpy
return numpy.__file__
data = sc.range(10).map(test1).collect()
print(data[0])
export PYSPARK_PYTHON=/groups/svoboda/home/moharb/anaconda2/envs/py35/bin/python