These are chat archives for spring-cloud/spring-cloud

29th
Apr 2016
Arghanil
@Arghanil
Apr 29 2016 20:46
Is this the right room to talk on spring-cloud-stream as well?
Dave Syer
@dsyer
Apr 29 2016 20:46
Yes
Arghanil
@Arghanil
Apr 29 2016 20:59
Great.
I am using spring-cloud-stream-binder-kafka. I see the behavior is like create a Kafka topic if needed, or try to increase its partition count to the desired number.
ensureTopicCreated
But in enterprise environment it's risky because it creates a new topic with partition and replication factor which doesn't match with the norms already there
Kafka hardly has any auth
Arghanil
@Arghanil
Apr 29 2016 21:04
What I noticed is, if the existing topic has say 10 partitions, and in the binder param I mention 3, the stream-binder is able to overwrite the partition number to 3!
Now we are also struggling to figure out an easy way to delete any topic
Kafka doesn't start up
So any time there is a faulty topic, we have to nuke kafka or leave the topic as is
Arghanil
@Arghanil
Apr 29 2016 21:10
It looks as if a dangerous behavior and any mistake is an expensive one. Could there be at least some config to stop creation of topic if it doesn't exist?
Dave Syer
@dsyer
Apr 29 2016 21:15
They sound like good questions
Ping @m
Marius Bogoevici
@mbogoevici
Apr 29 2016 21:18
@Arghanil we can add a flag to disable topic creation
(need to go pretty soon but could you please file a GitHub issue?)
Arghanil
@Arghanil
Apr 29 2016 21:19
yes, I will. Thank you.
Dave Syer
@dsyer
Apr 29 2016 21:19
That's the man
Marius Bogoevici
@mbogoevici
Apr 29 2016 21:20
thanks
you can delete a topic administratively
also, Kafka doesn’t support reducing the number of partitions on a topic (http://kafka.apache.org/documentation.html#basic_ops_add_topic) but in any case we can disable automatic reconfiguration
Arghanil
@Arghanil
Apr 29 2016 21:23
We have bad experience with that. The topics get marked for deletion. Then when trying to restart kafka, it crashes.
Marius Bogoevici
@mbogoevici
Apr 29 2016 21:24
ok, please mention that in the filed bug
what Kafka version are you using?
Arghanil
@Arghanil
Apr 29 2016 21:28
0.9 :worried:
sorry 0.8
Marius Bogoevici
@mbogoevici
Apr 29 2016 21:29
ok, thanks :) need to go but looking forward to the issue and we will add a setting for 1.0.0.GA - thanks for using spring-cloud-stream!
Arghanil
@Arghanil
Apr 29 2016 21:30
alright
Matt Benson
@mbenson
Apr 29 2016 21:50
@dsyer in case you're still here, I am finding that request.getPathInfo() is returning null and causing an NPE with the recent changes we made to ResourceController, after you modified my original code, which I note would still work
Arghanil
@Arghanil
Apr 29 2016 21:55
@mbogoevici Created this one spring-cloud/spring-cloud-stream#504
Marius Bogoevici
@mbogoevici
Apr 29 2016 21:56
@Arghanil Cool, thanks, labeled it for GA.