These are chat archives for arnaud-lb/php-rdkafka

29th
Oct 2018
abduraappf
@abduraoof_gitlab
Oct 29 2018 05:38
Hello
am configuring kafka-elasticsearch-connecter
while running i got this error
ERROR Stopping due to error (org.apache.kafka.connect.cli.ConnectStandalone:122)
how to filx
Paweł Niedzielski
@steveb_gitlab
Oct 29 2018 08:22
@abduraoof_gitlab this doesn't seem remotely related to php-rdkafka library, or even librdkafka driver. This looks like a connector issue. You're better off asking in Kafka chats or support forums.
As for the stacktrace you've pasted - there seems to be a library missing. Have you installed your dependencies?
abduraappf
@abduraoof_gitlab
Oct 29 2018 08:23
@steveb_gitlab Okay. Thanks
Paweł Niedzielski
@steveb_gitlab
Oct 29 2018 08:24
And btw @abduraoof_gitlab , that stacktrace was helpful. You should provide it when asking for help, since Java dev should be able to tell you exactly what is missing.
tambach
@tambach
Oct 29 2018 12:19
Hi, cann someone help me and tell me what does this error mean or how can i correct it?
%3|1540815054.724|ERROR|rdkafka#producer-1| [thrd:db-migration2:9092/0]: db-migration2:9092/0: Receive failed: Disconnected
Paweł Niedzielski
@steveb_gitlab
Oct 29 2018 12:35
@tambach check if the Kafka server is still running. What was your script doing when it happened? Was it some sort of a long-running script?
tambach
@tambach
Oct 29 2018 12:40
i have checked and its running. yes, my script gets data from mysql and these table are too big, so it needs long time, is there any way to make it better?
Paweł Niedzielski
@steveb_gitlab
Oct 29 2018 12:53
@tambach well clearly your connection got dropped due to inactivity (I mean process was occupied with acquiring data from MySQL, so it didn't communicate with Kafka, and it decided to free the connection). If you cannot split the query into smaller chunks, then either connect to Kafka only after you have the data, or check the connection and reconnect.
tambach
@tambach
Oct 29 2018 13:04
is there any way to change configuration and make bigger the waiting time?
karavzeka
@karavzeka
Oct 29 2018 13:09
@steveb_gitlab I thought rdkafka able to reconnect automatically.
@tambach try to put simple message without any sql queries.
and try to ping kafka server from server where your code works.
I think it's somthing with network. Or just kafka or zookeeper fell down
Paweł Niedzielski
@steveb_gitlab
Oct 29 2018 13:33
@karavzeka I would thought so too, hence I've asked if Kafka is still online. It did look like a timeout or network issue. Judging by server names, it looks like Docker environment.
tambach
@tambach
Oct 29 2018 15:07
i have this kind of issues, do you know how to solve?
penJDK 64-Bit Server VM warning: INFO: os::commit_memory(0x0000000080000000, 2147483648, 0) failed; error='Cannot allocate memory' (errno=12)
#

There is insufficient memory for the Java Runtime Environment to continue.

Native memory allocation (mmap) failed to map 2147483648 bytes for committing reserved memory.

tambach
@tambach
Oct 29 2018 15:13
i was tryng to delete all the topics but they are not deleted instead of this they are "marked for deletion"
Paweł Niedzielski
@steveb_gitlab
Oct 29 2018 15:53
@tambach well, you're running out of memory :)
tambach
@tambach
Oct 29 2018 16:58
yeah, and i delete all the logs and it still works