by

Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Gavin Bisesi
    @Daenyth
    fwiw
    streamz.timed_window let me see where that comes from. I'm most familiar with the akka/fs2 layer
    Gregory Nwosu
    @gregnwosu
    im so sorry im in wrong chat
    theres a python library called streamz
    Gavin Bisesi
    @Daenyth
    ahh
    yeah I wondered about the underscores :D
    Tristan Lohman
    @gatorcse
    I am converting an akka source to an fs2 stream. The toStream() method takes an implicit materializer. What is being run with this materializer, is it just running the things in the Source, or is it also running everything in that fs2 stream, and everything that follows? Basically, I’m using a db library that uses Akka, and I was going to just grab the actor system from that driver and create a materializer out of it and pass that in to the toStream method, but I want to make sure that is safe. Also, this is probably obvious, but I have no idea how akka streams or any of that works, nor do I need anything with the materialized value, just the streamed elements.
    Martin Krasser
    @krasserm
    The materializer is only needed for Source internals. It is not used in the downstream in the FS2 part (created with toStream()). Creating an ActorMaterializer from the available actor system is safe.
    Gavin Bisesi
    @Daenyth
    @gatorcse note that the materializer has a lifecycle, so you should construct it at the start of your app
    "db library that uses akka" if that's slick+alpakka I have a snippet for streaming straight from slick
    Tristan Lohman
    @gatorcse
    it’s reactivemongo
    @Daenyth I create the mongo client instance in a resource, and then inside use I grab the underlying actor materializer (the driver client instance exposes it).
    Gavin Bisesi
    @Daenyth
    If they expose it for you I'd expect them to be responsible for shutdown
    You might also look at fs2-mongo iirc if you're not married to that library
    Tristan Lohman
    @gatorcse
    eh, I kinda already am. My client uses it everywhere. Plus I already know how to use it. I’m mostly doing simple calls and wrapping with IO.fromFuture(IO { …}) everywhere, but I have a few instances where I need to stream the change event stream.
    Gotta finish up that native cats mongo driver I’m workin on...
    Juan José Morales
    @juanux
    Hi. Do you know if there is a problem with this project in meaven. I'm unable to add it to my project due Not foud. Any help please?
    Juan José Morales
    @juanux
    I am using '' libraryDependencies += "com.github.krasserm" %% "streamz-converter" % "0.10-M2" // uses FS2 1.0.0 ''
    Juan José Morales
    @juanux
    Solved. Problem with buils.sbt config
    Gavin Bisesi
    @Daenyth
    @juanux Can you file a ticket?
    I need to get the proper release up, I just haven't had time lately :(
    Gavin Bisesi
    @Daenyth
    @/all 0.11-RC1 is now out for 2.11,2.12,2.13, built on cats-effect and fs2 2.x.
    There's a potential bug which I could use help smoking out (#70). Once I fix that or confirm it's a test problem, I'll release 0.11 final
    Oh and I should note the resolver changed
    I'll edit that into the release notes
    Milan van der Meer
    @milanvdm
    @Daenyth For https://github.com/krasserm/streamz/pull/74#pullrequestreview-352467850
    Im a bit confused on that comment.
    Flow[A, B, M] => F[(M, Pipe[F, A, B])] - This is already the case except that the M is at the end of the signature
    Flow[A, B, Future[M]] => F[(F[M], Pipe[F, A, B])] - Do you mean that AkkaStreams also has a case where it is Future[M] for a Flow? I also don't think you can have F[M] in there since as far as I understand, you need to execute the Pipe first before F[M] can be materialized.
    Gavin Bisesi
    @Daenyth
    ah I missed it
    The readme doesn't include the M is why I got confused
    the order of the two in the tuple doesn't matter
    I wish the doc page was done with tut/mdoc but here we are
    a bit busy right now but I'll try to answer any other questions later today
    Milan van der Meer
    @milanvdm
    Sure, take your time :)
    Milan van der Meer
    @milanvdm
    @Daenyth Kind reminder ;)
    Gavin Bisesi
    @Daenyth
    Appreciated - I will try to make time for it today
    Gavin Bisesi
    @Daenyth

    minor update: I have it built locally but need to find time to do the annoying bintray UI poking.

    PRs very welcome for sbt-bintray setup

    Milan van der Meer
    @milanvdm
    @Daenyth Can I help out with something to get the PR merged? :)
    Gavin Bisesi
    @Daenyth
    oof
    I think it is merged, I just need to publish it
    it's manual steps in bintray
    I'll try to make some time to get it done today
    if you have experience setting up sbt-bintray publishing, a PR for that would be appreciated
    should be visible in bintray, please ping me if anything's not working right
    Gavin Bisesi
    @Daenyth
    Released 0.31-RC1 as well with the Mat safety changes
    Milan van der Meer
    @milanvdm
    Thanks a bunch for the effort! :)
    Luka Jacobowitz
    @LukaJCB
    maybe I’m looking in the wrong place, but I can’t find the binary here: https://bintray.com/krasserm/maven/streamz
    did the group id change?
    Luka Jacobowitz
    @LukaJCB
    oh okay read the release notes I guess :smile: