mensfeld on master
Remove rake dependency (#676) (compare)
mensfeld on 2.0-wip
jobs queue specs (compare)
mensfeld on 2.0-wip
Is there any way in karafka to add more than one consumer in the same group(Routing), also can i build an app that consumer X will not start until consumer Y and consumer Z finishes consuming message with the same key?
Well you can have as many consumers in a group as you want :) but not sure if I get the question
can i build an app that consumer X will not start until consumer Y and consumer Z finishes consuming message with the same key?
That is kinda against the idea of Kafka message log data distribution but it can be done if you introduce intermediate trigger topics and make it event driven
Hi everyone! new to Karafka here. Does anyone know why producers are called Responders instead of Producers? I have used Racecar before, and they used to call it Producers. So I am just curious.
Because I was stupid :) Responders won't be available in 2.0. They were designed to create a more complex "responses" based on events, where you would propagate data to several topics and they ensured consistency of delivery with error and correctness tracking.
is there any way, in Karafka, to produce a message once several related messages have been consumed ?
If you mean "product after batch is done" then yes. If you mean producing in regards to consumption of different topics/partitions data, then this might be tricky
Well you can have as many consumers in a group as you want?
Hi, I faced problem with karafka. "Karafka does not restart dead PG connections". Solution at here https://github.com/karafka/karafka/wiki/Problems-and-Troubleshooting#why-karafka-does-not-restart-dead-pg-connections
Anyone have idea for handle this error? I want to retry message which is faced with PG Connection issue. Let's say if consumed message and process is fail with PG connection. Program must reconnect to PG and then retry old message.