Hello everyone! :D
Hey @edenhill great to see you here :)
For the life of me I can't get the broker address to change from 127.0.0.1 :(
private function initialize(array $brokers)
{
$conf = new ConsumerConf();
$conf->set('metadata.broker.list', implode(',', $brokers));
$consumer = new Consumer($conf);
$consumer->addBrokers(implode(',', $brokers));
$this->setConsumer($consumer);
}
didn't work with just ->addBrokers(), tried the metadata.broker.list too, still tries to go to 127.0.0.1 :( :(
Nobody seems to be around - I've raised this bug - arnaud-lb/php-rdkafka#92
You shouldn't use addBrokers, config is enough
let me remove addBrokers()
Can you print the string you set?
No change - yes here's the string.
$conf = new ConsumerConf();
$conf->set('metadata.broker.list', 'xx.xx.xx.xx:9092');
$consumer = new Consumer($conf);%3|1479475193.723|ERROR|rdkafka#consumer-1| 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused
Ah, 127.0.0.1 is coming from the broker. Check its advertised.listener config
interesting, do you think ti's talking to remote broker
but broker isn't listening on external IP ?
suggestion on how I can run sniffer on remote server, on specific port ? to check incoming traffic
I'm running kafka using this docker IMG - https://hub.docker.com/r/wurstmeister/kafka/
aha
docker-compose.yml was set to this .. tweaking
KAFKA_ADVERTISED_HOST_NAME: 127.0.0.1
I'm able to connect to the broker now, that ENV var becomes advertised.host.name
still some issues, but this is good progress - thanks @edenhill
👍
I'm replacing another tech stack with a kafka solution, I need to learn kafka FAST! what's your suggestions on best places to learn from ?
@edenhill this is what's being set in server.properties
#advertised.listeners=PLAINTEXT://your.host.name:9092
it's commented out ..
but these are at the end of the file
port=9092
create.topics=users:1:1
advertised.host.name=xx.xx.xx.xx
advertised.port=9092
Make sure that host and port is reachable from the client
And I believe.. Host.name was replaced by advertised.listeners
indeed, i am on kafka 0.10
so i removed advertised.host/port, advertised.listeners=PLAINTEXT://<my ip>:9092
however when kafka boots, it doesn't fully finish booting, just hangs there (after making the topic)
Maybe it fails to reach other brokers, or zk
Only have 1 broker, this one
it can access ZK
@edenhill which versions of kafka does php-rdkafka support? README says
PHP-rdkafka is a thin librdkafka binding providing a working PHP 5 / PHP 7 Kafka 0.8 / 0.9 client.
does this mean 0.10 is not supported ?
It supports all >=0.8 versions
That's good to hear
@edenhill can you help me find out what version of the kafka protocol my PHP ext is using?
also does the Producer class require access to remote zookeeper?
$rk = new RdKafka\Producer($conf);