Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • Jan 15 18:45
    ismailsimsek synchronize #3122
  • Jan 15 11:38
    ismailsimsek synchronize #3122
  • Jan 14 23:34
    Naros closed #3125
  • Jan 14 23:01
    roldanbob edited #3125
  • Jan 14 23:01
    roldanbob opened #3125
  • Jan 14 21:25
    morozov synchronize #2946
  • Jan 14 19:48
    morozov synchronize #2946
  • Jan 14 18:50
    gunnarmorling closed #3119
  • Jan 14 17:58
    ismailsimsek synchronize #3122
  • Jan 14 17:48
    Naros closed #3123
  • Jan 14 17:39
    Naros closed #3124
  • Jan 14 17:39
    Naros opened #3124
  • Jan 14 17:27
    morozov synchronize #3119
  • Jan 14 16:56
    gunnarmorling closed #3121
  • Jan 14 16:39
    Naros opened #3123
  • Jan 14 15:35
    ismailsimsek synchronize #3122
  • Jan 14 15:32
    ismailsimsek edited #3122
  • Jan 14 15:30
    ismailsimsek edited #3122
  • Jan 14 15:29
    ismailsimsek opened #3122
  • Jan 14 15:13
    Naros synchronize #3118
Gunnar Morling
@gunnarmorling
thx!
Payam
@pysf
@Naros Thank you so much! Please let me know if you need logs on different levels(Trace, Debug) or other details.
I also attached the docker-compose.yml file to the issue.
Chris Cranford
@Naros
Thanks @pysf, I believe we have all we need from what you've provided but if that changes we'll let you know on the jira. Thanks for the report!
Gunnar Morling
@gunnarmorling
all, updated the roadmap a bit for Debezium 1.8: https://twitter.com/gunnarmorling/status/1450734810402537475
Anisha Mohanty
@ani-sha
Hey all, Is it for me, or is JIRA out of service?
Naresh Kumar
@naresh-chaudhary

Hi team, I am getting the below error after whitelisting a new table in mysql connector (version 1.1Final)

org.apache.kafka.connect.errors.ConnectException: Encountered change event for table dominus.payment whose schema isn't known to this connector
    at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:230)
    at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:207)
    at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:536)
    at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1095)
    at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:943)
    at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:580)
    at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:825)
    at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.kafka.connect.errors.ConnectException: Encountered change event for table dominus.payment whose schema isn't known to this connector
    at io.debezium.connector.mysql.BinlogReader.informAboutUnknownTableIfRequired(BinlogReader.java:794)
    at io.debezium.connector.mysql.BinlogReader.handleUpdateTableMetadata(BinlogReader.java:768)
    at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:519)
    ... 5 more

@MrTrustworthy you also faced similar issue earlier, what is the resolution here?

2 replies
Jiri Pechanec
@jpechane
@gunnarmorling MongoDB is green -, the PR is ready for review debezium/debezium#2818
Gunnar Morling
@gunnarmorling
@jpechane woohoo
will take a look tomorrow
isn't this supported for MySQL and Oracle now?
I see changes to the Oracle parser, but doc updates only for MySQL
@jpechane speaking of docs, something like ColumnImpl should neither face up in docs of the actual option nor in actual user docs; it's an implementation detail and no one will know what this is about
Jiri Pechanec
@jpechane
@gunnarmorling debezium/debezium#2837
Gunnar Morling
@gunnarmorling
applied, thx!
Jiri Pechanec
@jpechane
@/all Debezium is moving to https://debezium.zulipchat.com Please continue with your discussion topics there as this channel will no longer be monitored.
/all Debezium is moving to https://debezium.zulipchat.com Please continue with your discussion topics there as this channel will no longer be monitored.
Jiri Pechanec
@jpechane
test
test
@jpechane Debezium Community migrated to https://debezium.zulipchat.com/
Test
@jpechane Debezium Community migrated to https://debezium.zulipchat.com/
Sungho Hwang
@sgc109
@gunnarmorling I created a Jira issue for the first time. Does it make sense? https://issues.redhat.com/projects/DBZ/issues/DBZ-4191
1 reply
Jiri Pechanec
@jpechane
@sgc109 Debezium Community migrated to https://debezium.zulipchat.com/
Jiri Pechanec
@jpechane
@Naros Debezium Community migrated to https://debezium.zulipchat.com/
akshay kushal
@akshay2305_twitter
Hi Team,
Jiri Pechanec
@jpechane
@akshay2305_twitter Debezium Community migrated to https://debezium.zulipchat.com/
Rotem Adhoh
@rotem-ad
Hey guys, I’m trying to open a Jira issue and nothing happens when I click the “Create” button. Not sure what to do..
Jiri Pechanec
@jpechane
@rotem-ad Debezium Community migrated to https://debezium.zulipchat.com/
Davit Beradze
@dberadze_twitter

Hello, the 1.7 and 1.8 version gets :

Error: Could not find or load main class org.apache.kafka.connect.cli.ConnectDistributed

I run with the default config
docker run -it --name connect -p 8083:8083 -e GROUP_ID=1 -e CONFIG_STORAGE_TOPIC=my-connect-configs -e OFFSET_STORAGE_TOPIC=my-connect-offsets -e ADVERTISED_HOST_NAME=192.100.100.100 debezium/connect

what is the wrong?

Jiri Pechanec
@jpechane
@dberadze_twitter Debezium Community migrated to https://debezium.zulipchat.com/
Waqas Dilawar
@waqasdilawar
@gunnarmorling Hi dear, I'm trying to expose metrics of Kafka Connector using this docker-compose file (https://github.com/debezium/debezium-examples/blob/main/monitoring/docker-compose.yml), but I'm confusing myself with this line (KAFKA_OPTS=-javaagent:/kafka/etc/jmx_prometheus_javaagent.jar=8080:/kafka/etc/config.yml). Can you please tell me what I'm supposed to replace here? Btw I can access logs in JConsole but it's neither working in the browser nor in Prometheus without this line.
Jiri Pechanec
@jpechane
@waqasdilawar Debezium Community migrated to https://debezium.zulipchat.com/
Jiri Pechanec
@jpechane
@blcksrx Debezium Community migrated to https://debezium.zulipchat.com/
yashpreetmsft
@yashpreetmsft

@jpechane

Hi Jiri, I wanted to use kafka connect in different machines( with different IP's) , I started zookeeper, server and kafka connect with debezium and realised the connectors I connect in 1st machine is syncing with the other machine, I can't figure out why ( I am using same DB from SQL Server in org), is it because of CDC of same DB or there could be some other reason?

I am using advertised.host.name as localhost should I change it too... I am using distributed mode configuration... Is there any article that I can follow to use different machines in Debezium and sync data accordingly.. ( I want to use more than 1 machines for fault tolerence and scaling.)

Any help will be really appreciated, thanks in advance :)

Jiri Pechanec
@jpechane
@yashpreetmsft Debezium Community migrated to https://debezium.zulipchat.com/
Jiri Pechanec
@jpechane
@zxxz Debezium Community migrated to https://debezium.zulipchat.com/
1 reply
@zxxz Debezium Community migrated to https://debezium.zulipchat.com/
Phil
@philipsamuel
Hey @jpechane - is there a way to pass ‐Dlog4j2.formatMsgNoLookups=True in kafka connect to prevent zero-day vulnerability for log4j
Jiri Pechanec
@jpechane
@philipsamuel Debezium Community migrated to https://debezium.zulipchat.com/
Gunnar Morling
@gunnarmorling
Jiri Pechanec
@jpechane
@gunnarmorling Debezium Community migrated to https://debezium.zulipchat.com/
Gunnar Morling
@gunnarmorling
Kafka Connect does not use log4j 2.x
Jiri Pechanec
@jpechane
@gunnarmorling Debezium Community migrated to https://debezium.zulipchat.com/
RadioGuy
@RadioGuy
Is debezium-postgres 1.4.x impacted by CVE-2021 security vulnerability with log4j ?
Also does it use jms appender by any chance ?
Jiri Pechanec
@jpechane
@RadioGuy Debezium Community migrated to https://debezium.zulipchat.com/
RadioGuy
@RadioGuy
Is debezium-postgres 1.4.x impacted by CVE-2021 security vulnerability with log4j ?
Also does it use jms appender by any chance ?
Jiri Pechanec
@jpechane
@RadioGuy Debezium Community migrated to https://debezium.zulipchat.com/
hkokay
@h_kokay_twitter
@jpechane I'm trying to execute an ad-hoc snapshot. I inserted a record into the signal table but the snapshot does not get triggered. I'm using Postgres RDS as the source.
GitHubZhangH
@GitHubZhangH
image.png