These are chat archives for akkadotnet/AkkaStreams

29th
Sep 2018
AndreSteenbergen
@AndreSteenbergen
Sep 29 2018 06:39
For anyone who is interested in some throw away code to migrate Kafka topic to another, with order of timestamps, I created a gist. It also demonstrates how I am using the eof handling to stop the current stream: https://gist.github.com/AndreSteenbergen/700a25c862e291486c1e351b588f79ff
I like the fact there are so many standard things in the streams package you can easily perform the pipes and filters design pattern to come up with a solution that works. There is so much available it is sometimes hard to find what you are looking for, but it's there already.
AndreSteenbergen
@AndreSteenbergen
Sep 29 2018 09:53
I have a flow: Flow<MessageAndMeta<TKey, TValue>, DeliveryReport<TKey, TValue>, Task> How do I turn this into a Sink<MessageAndMeta<TKey, TValue>, Task>, but I want to keep the original Task.
AndreSteenbergen
@AndreSteenbergen
Sep 29 2018 10:31
I just updated the PR.
Marc Piechura
@marcpiechura
Sep 29 2018 12:35
We have some overloads which let you decide which materialized value you want to keep. For details see https://getakka.net/articles/streams/modularitycomposition.html#materialized-values
AndreSteenbergen
@AndreSteenbergen
Sep 29 2018 15:49
My question was based on the kafka source. It used a toMaterialized, changing that function to use To method did the trick. I first had keep left as notused, using to I got the task.
Marc Piechura
@marcpiechura
Sep 29 2018 15:50
Alright, haven’t looked into the source ;-)
AndreSteenbergen
@AndreSteenbergen
Sep 29 2018 15:50
Np. I just saw your answer, wanted to let you know what was going on.
Marc Piechura
@marcpiechura
Sep 29 2018 16:19
👍
AndreSteenbergen
@AndreSteenbergen
Sep 29 2018 22:10
@marcpiechura In the gist I create a graph based on a number of partitions in my kafka source. I thought I could reuse this graph. I made a dictionary based on max partition count. But only 1 stream moved through the stream, all others invocations were completed from the start. Am I mistaken a graph can be reused, or am I doing something wrong?