by

Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    bamarek18
    @bamarek18
    is this published in maven ? I fail to resolve
    Martin Krasser
    @krasserm
    bamarek18
    @bamarek18
    @krasserm thanks
    bamarek18
    @bamarek18
    https://github.com/akka/akka-persistence-cassandra#migrations-from-06-to-07 "you should be able to", what do they mean? Simple copy-from copy-to between tables doesnt work
    @krasserm would you have any tips on how to proceed with that?
    bamarek18
    @bamarek18
    Im sorry, wrong channel
    Ben Fradet
    @BenFradet
    Hey there, would streamz work with a SQS Camel endpoint?
    Martin Krasser
    @krasserm
    Yeah, it should.
    Ben Fradet
    @BenFradet
    thanks, I'm currently giving it a go, I'll report my findings :+1:
    Martin Krasser
    @krasserm
    Please do that, thanks!
    Ben Fradet
    @BenFradet
    getting ssl handshake exception at the moment
    Martin Krasser
    @krasserm
    Jeremy Lyman
    @maarek
    How do I join the reply() in the Java builder dsl?
    I'm playing with an example from a camel jetty connector and Source did not seem to work, so I was going to try to use Flow in order to send the response but I'm not sure how a reply works when a Flow -> Flow -> Broadcaster -> Some Sinks.
    Jeremy Lyman
    @maarek
    How does that work with a Shape?
    Martin Krasser
    @krasserm
    Can you elaborate please?
    Jeremy Lyman
    @maarek
    One second let me throw this in a gist
    I have the Flow source defined from camel-jetty
    Then I create a graph using the graph dsl
    Do I join reply when I create the source flow? Or would it be an extra broadcast connector? I'm pretty new to Akka streams so I might be confused on how the request response works here.
    Martin Krasser
    @krasserm
    So you have to join reply at the end of your transformations
    or, when using a graph builder, pipe the transformation result directly back to the source flow
    Jeremy Lyman
    @maarek
    Do you know what that would look like in the graph builder?
    I guess that's what the error is. Im trying to look at the documentation for the streams now.
    Would it be a bidirectional flow then?
    Martin Krasser
    @krasserm
    Just a second, I'm taking a closer look at your example ...
    Jeremy Lyman
    @maarek
                b.from(httpShape)
                        .via(greetingShape)
                        .viaFanOut(broadcaster)
                        .toInlet(httpShape.in());
                b.from(broadcaster)
                        .to(esShape);
                b.from(broadcaster)
                        .to(loggerSinkShape);
    Martin Krasser
    @krasserm
    This looks good.
    Jeremy Lyman
    @maarek
    This seems to pipe it back as you said
    By attaching the inlets.
    Martin Krasser
    @krasserm
    I didn't manage to get your example running
    Jeremy Lyman
    @maarek
    :thumbsup:
    It's missing some code?
    :)
    Martin Krasser
    @krasserm
    imports, base class, ...
    Jeremy Lyman
    @maarek
    Yep :P
    So with jetty camel it seems like Flow works but Source does not work
    Martin Krasser
    @krasserm
    yes, jetty endpoints create in-out message exchanges
    Jeremy Lyman
    @maarek
    When I used receiveBody, jetty would reply back with 200 echo but it would never stream.
    How do you recognize that with other camel endpoints? :P
    Martin Krasser
    @krasserm
    look at the docs
    Jeremy Lyman
    @maarek
    Lol
    Thanks for helping out with the sample above. Glad it's working finally.
    Martin Krasser
    @krasserm
    You're welcome
    Martin Krasser
    @krasserm
    @/all just released version 0.8.1 (with a fix for #37)
    Martin Krasser
    @krasserm
    @/all there's now a Streamz 0.9-M1 release with dependencies to FS2 0.10.0-M3, cats 0.9.0 and cats-effect 0.3. You can find the links to the 0.9.x documentation at https://github.com/krasserm/streamz/blob/master/README.md#streamz-09x
    XING Yun
    @BigFatDog
    Hello, how can I read a large and static Dask DataFrame into streamz? The DataFrame has a time attribute that spans about 1 month. I want to put a small part of the DataFrame into streamz firstly, and later read data in hour/minute steps per second. Any hints on this?
    Martin Krasser
    @krasserm
    You first need to be able to load a Dask DataFrame into a JVM application. I've never worked with Dask nor do I know a library that loads Dask or Pandas data frames into a JVM application. Given that you find such a library (or have some other Java/Scala code that can read the data frame directly) you need to write a custom Akka Streams Source or a custom FS2 Stream for "loading" the read data into Streamz.