Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Wouter de Bie
    @wouterdebie
    ravwojdyla: busy here :)
    Rafal Wojdyla
    @ravwojdyla
    @wouterdebie sorry - did not see your message in the storm of all the other messages :D
    Chris Beelby
    @cmbeelby
    i'm trying to install snakebite[kerberos] and i dont have the SASL library so I'd like to compile it locally, but i'm not sure which one (maybe any? seems unlikely) I need ?
    I've found Cyrus SASL and GNU SASL for example . can i take any ?
    Rafal Wojdyla
    @ravwojdyla
    @cmbeelby go with Cyrus-SASL
    Chris Beelby
    @cmbeelby
    thanks. so to be clear, other libraries wont work. the package is meant to work with Cyrus-SASL
    Rafal Wojdyla
    @ravwojdyla
    snakebite pulls python sasl which says Cyrus-SASL bindings for Python
    Chris Beelby
    @cmbeelby
    ok , cool. thanks for the link. I am having a very hard time getting working links to cyrus sasl code
    pedrorjbr
    @pedrorjbr
    Hello guys! I have some questiona about how spotify manage their squad teams. I don't know if it is here is a good place to ask. If not, is there any channel or someone that works in Spotify that can help me?
    Rafal Wojdyla
    @ravwojdyla
    @pedrorjbr this channel is focused on snakebite.
    pedrorjbr
    @pedrorjbr
    OK @ravwojdyla
    No problem
    Wouter de Bie
    @wouterdebie
    pedrorjbr: I don't think there's a special spotify channel though..
    pedrorjbr: there is a #spotify on freenode though
    Kirk Leon Guerrero
    @kirklg
    hey guys, I've been playing with making snakebite py3 compatible, and I noticed it doesn't support the command put, is this something that was intentionally left out, or a future feature? Thank you!
    Rafal Wojdyla
    @ravwojdyla
    @kirklg that is something that was not implemented - there is issue for it - would be awesome to have it tho.
    Kirk Leon Guerrero
    @kirklg
    @ravwojdyla thank you, I was just wondering, I don't mind adding it to snakebite.
    Wouter de Bie
    @wouterdebie
    2.9.0 released!
    Alan Collins
    @alanc0llins
    Hello
    Rafal Wojdyla
    @ravwojdyla
    @alanc0llins sup?
    Alan Collins
    @alanc0llins
    Can you speak Portuguese?
    Rafal Wojdyla
    @ravwojdyla
    @alanc0llins no, sorry - we have polish, English and Dutch
    Alan Collins
    @alanc0llins
    What's this group ?
    Wow Ok
    @ravwojdyla could you give me a hint on how to be a successful developer?
    Rafal Wojdyla
    @ravwojdyla
    @alanc0llins I'm sorry, this channel is
    focused on snakebite. That said there is loads of materials from Spotify available on the Internet, which might be interesting for you.
    florentvaldelievre
    @florentvaldelievre
    Hello Guys, I was wondering if snakebite supports s3? snakebite ls 's3a:///tmp' returns invalidPathException
    I have tried to set fs.defaultFS=s3a://.. It means that when I hdfs dfs -ls '/tmp' it lists what's on s3 in /tmp folder.
    However, when i snakebite ls '/tmp' it list files on HDFS ( I was hoping it would list whats on s3 because ive changed fs.DefaultFS to s3). Do you have any idea ?
    Wilber Hernandez
    @wilberh
    @florentvaldelievre - looks like snakebite repo got forked by Internet Archive (https://archive.org/) via https://github.com/kirklg/snakebite/tree/feature/python3. The original contributer @wouterdebie left Spotify a while ago. "...And Spotify doesn't run HDFS anymore. They've moved to Google Cloud Platform where everything is stored in GCS and doesn't require the hadoop client or snakebite anymore." per @wouterdebie. New repo is, https://github.com/internetarchive/snakebite-py3
    Pustik41
    @Pustik41
    Hi guys, iI use snakebite-py and try to connect to HDFS via AutoConfigClient, but have an error:
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/snakebite/rpc_sasl.py", line 109, in connect initiate.token = self.sasl.process() TypeError: None has type NoneType, but expected one of: bytes
    Pustik41
    @Pustik41
    Additional info i use client.ls(["/"]) and it returns generator object HAClient._ha_gen_method.<locals>.wrapped, but if I put it in list list(client.ls(["/"])) get this error
    Pustik41
    @Pustik41
    2020-10-14 05:56:29,403 ERROR project.cmdlineutil: Error running tool: Traceback (most recent call last):
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/cmdlineutil/init.py", line 228, in run
    self._run_impl(args, *kwargs)
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/changecontrolstatisticsreporter/imhotepdataset/main.py", line 216, in _run_impl
    raise e
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/changecontrolstatisticsreporter/imhotepdataset/main.py", line 211, in _run_impl
    self.build_index()
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/changecontrolstatisticsreporter/imhotepdataset/main.py", line 196, in build_index
    self.get_indexes_sizes()
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/changecontrolstatisticsreporter/imhotepdataset/main.py", line 162, in get_indexes_sizes
    for x in client.ls(['/']):
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/snakebite/client.py", line 1549, in wrapped
    yield next(results)
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/snakebite/client.py", line 174, in ls
    recurse=recurse):
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/snakebite/client.py", line 1223, in _find_items
    fileinfo = self._get_file_info(path)
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/snakebite/client.py", line 1351, in _get_file_info
    return self.service.getFileInfo(request)
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/snakebite/service.py", line 43, in <lambda>
    rpc = lambda request, service=self, method=method.name: service.call(service_stub_class.dict[method], request)
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/snakebite/service.py", line 49, in call
    return method(self.service, controller, request)
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/google/protobuf/service_reflection.py", line 283, in <lambda>
    self._StubMethod(inst, method, rpc_controller, request, callback))
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/google/protobuf/service_reflection.py", line 300, in _StubMethod
    method_descriptor.output_type._concrete_class, callback)
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/snakebite/channel.py", line 489, in CallMethod
    self.get_connection(self.host, self.port)
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/snakebite/channel.py", line 251, in get_connection
    sasl_connected = self.sasl.connect()
    File "/mnt/kubernetes/sandbox/data-governance--change-control-statistics-reporter/lib/python3.6/site-packages/snakebite/rpc_sasl.py", line 109, in connect
    initiate.token = self.sasl.process()