images.map(lambda v: v - gaussian_filter(v))
spark
cluster, in Janelia it is in standalone mode. As far as thunder
is concerned, they are both the same. You would need a Jupyter notebook and a way to get a spark context in it, which might be different then how it is done in Janelia. Is this the part you need help with?
import numpy
print(numpy.__file__)
def test1(x):
import numpy
return numpy.__file__
data = sc.range(10).map(test1).collect()
print(data[0])
export PYSPARK_PYTHON=/groups/svoboda/home/moharb/anaconda2/envs/py35/bin/python
Hi
We are trying to connect hive tables from python on windwos,while connecting facing issues.We are sending our full details please help on this.
we installed python version 2.7.15 and anaconda version 2.7.14
We installed below packages
pip install sasl
pip install thrift
pip install thrift-sasl
pip install PyHive
we written the below code to connect hive tables from python script
from pyhive import hive
conn = hive.Connection(host="172.16.17.196", port=10000, username="mapr", database="default")
cursor = conn.cursor()
cursor.execute("SHOW DATABASES")
for result in cursor.fetchall():
use_result(result)
We are getting below error
==========================
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "C:\Users\mapr\Anaconda2\lib\site-packages\pyhive\hive.py", line 64, in connect
return Connection(args, *kwargs)
File "C:\Users\mapr\Anaconda2\lib\site-packages\pyhive\hive.py", line 162, in init
self._transport.open()
File "C:\Users\mapr\Anaconda2\lib\site-packages\thrift_sasl__init__.py", line 79, in open
message=("Could not start SASL: %s" % self.sasl.getError()))
thrift.transport.TTransport.TTransportException: Could not start SASL: Error in sasl_client_start (-4) SASL(-4): no mechanism available: Unable to find a callback: 2
hello all, if you ready to secure your data then take through Information security management system(ISO 27001) Certification with Certivatic just click ISO Certification in UAE for more details.
Thanks for this discussion, whenever I get doubt i tried to research in thread for solution and i got some helpful tips. regards