DataFrameinto a JVM application. I've never worked with Dask nor do I know a library that loads Dask or Pandas data frames into a JVM application. Given that you find such a library (or have some other Java/Scala code that can read the data frame directly) you need to write a custom Akka Streams
Sourceor a custom FS2
Streamfor "loading" the read data into Streamz.
a dataframe like
symbol timestamp bid ask
0 GBPUSD 2019-08-13 14:40:27.702121+00:00 1.20804 1.20821
0 AUDUSD 2019-08-13 14:40:27.710115+00:00 0.68072 0.68087
streamz.timed_windowlet me see where that comes from. I'm most familiar with the akka/fs2 layer
toStream()method takes an implicit materializer. What is being run with this materializer, is it just running the things in the Source, or is it also running everything in that fs2 stream, and everything that follows? Basically, I’m using a db library that uses Akka, and I was going to just grab the actor system from that driver and create a materializer out of it and pass that in to the
toStreammethod, but I want to make sure that is safe. Also, this is probably obvious, but I have no idea how akka streams or any of that works, nor do I need anything with the materialized value, just the streamed elements.