These are chat archives for thunder-project/thunder

2nd
Aug 2015
Kyle Ellefsen
@kyleellefsen
Aug 02 2015 19:58
This message was deleted
Kyle Ellefsen
@kyleellefsen
Aug 02 2015 20:06

@freeeman-lab I'm trying to download the files located on http://datasets.codeneuro.org/. I've downloaded spark and thunder. I launch pyspark in the spark folder/bin/pyspark.cmd. When I run the following code, I get an error:

from thunder.utils.context import ThunderContext
tsc=ThunderContext(sc)
bucket = "s3n://neuro.datasets/"
path = "challenges/neurofinder/00.00/"
images = tsc.loadImages(bucket + path + 'images', recursive=True, startIdx=0, stopIdx=100)

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\Python27\lib\site-packages\thunder\utils\context.py", line 195, in loadImages
    confFilename=confFilename)
  File "C:\Python27\lib\site-packages\thunder\rdds\fileio\imagesloader.py", line 99, in fromStack
    jsonBuf = reader.read(dataPath, filename=confFilename)
  File "C:\Python27\lib\site-packages\thunder\rdds\fileio\readers.py", line 485, in read
    key = self.__getSingleMatchingKey(dataPath, filename=filename)
  File "C:\Python27\lib\site-packages\thunder\rdds\fileio\readers.py", line 467, in __getSingleMatchingKey
    keys = self.__getMatchingKeys(dataPath, filename=filename)
  File "C:\Python27\lib\site-packages\thunder\rdds\fileio\readers.py", line 429, in __getMatchingKeys
    conn = boto.connect_s3(**self.awsCredentialsOverride.credentialsAsDict)
  File "C:\Python27\lib\site-packages\boto\__init__.py", line 141, in connect_s3
    return S3Connection(aws_access_key_id, aws_secret_access_key, **kwargs)
  File "C:\Python27\lib\site-packages\boto\s3\connection.py", line 190, in __init__
    validate_certs=validate_certs, profile_name=profile_name)
  File "C:\Python27\lib\site-packages\boto\connection.py", line 569, in __init__
    host, config, self.provider, self._required_auth_capability())
  File "C:\Python27\lib\site-packages\boto\auth.py", line 987, in get_auth_handler
    'Check your credentials' % (len(names), str(names)))
boto.exception.NoAuthHandlerFound: No handler was ready to authenticate. 1 handlers were checked. ['HmacAuthV1Handler'] Check your credentials

Do I need to have some kind of authentication to access the files? I'm running Python2.7.10 on Windows 7.