ci/dockercloud check might be in PR: jenkinsci/remoting-kafka-plugin#77 ?
Hello everyone,
I have an issue with the Remoting Kafka Plugin on my Jenkins instance (Jenkins ver. 2.176.2).
I have installed the plugin in the Jenkins-Master and the connection to the zookeeper and kafka are sucessfull.
I created manually a node and the launch ist not working, it says "This agent is offline because Jenkis failed to lauch the agent process on it".
I have downloaded the JAR file from here https://repo.jenkins-ci.org/releases/io/jenkins/plugins/remoting-kafka/remoting-kafka-agent/, Version 2.0.1 and I have tried to execute the JAR from my local machine
java -jar remoting-kafka-agent.jar -name node-name -master http://jenkins.url/ -secret XXYY -kafkaURL XXX.YY.ZZZ.XXX:PPPP -noauth
However this doesn't work either. The console output says at the end
[kafka-producer-network-thread | producer-2] WARN org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-2] Connection to node -1 (/XXX.YY.ZZZ.XXX:PPPP) could not be established. Broker may not be available.
[Channel reader thread: node-name] WARN org.apache.kafka.clients.NetworkClient - [Consumer clientId=consumer-2, groupId=jenkins.url.-1.node-name-id] Connection to node -1 (/XXX.YY.ZZZ.XXX:PPPP) could not be established. Broker may not be available.
I don't find anything in the logs of kafka and also not in the Sys logs of jenkins Master.
Do you have an idea how can I approach the poblem? Thanks. María
the server.properties has no listeners property.
I believe I am missing the properties KAFKA_LISTENERS and KAFKA_ADVERTISED_LISTENERS as env variables in my statefulset yaml.
Which value should have these two properties in my case?
Hello @longngn,
I have set both properties to the following:
- name: KAFKA_LISTENERS
value: 'PLAINTEXT://localhost:9092'
- name: KAFKA_ADVERTISED_LISTENERS
value: 'PLAINTEXT://<kafka-ip>:9092'However the same problem still persists (see my comment from Sept 4th).
The configuration of the plugin inside the Jenkins-Master says that connection to the zookeeper and kafka are both successful... So I assume that my Jenkins-Master connects properly to the Kafka.
Can you assist us on this? We are stucked...
Thanks,
María
Hi @longngn, thanks for the fast reply.
I downloaded the kafka binaries and followed this quickstart: https://kafka.apache.org/quickstart
I am able to create a topic and I can see it as well when I run the list topic command. The Jenkins <-> Kafka connection seem to work properly.
When I try to execute the java -jar command from my jenkins-master container I get following error:
[Thread-1] WARN org.apache.kafka.clients.NetworkClient - [Consumer clientId=consumer-1, groupId=<jenkins-url>.-1.kafka1-id] 1 partitions have leader brokers without a matching listener, including [<jenkins-url>.-1.kafka1-topic-0]
Do you have any idea how can I approach this problem?
Thanks a lot,
María
