Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • 19:25
    jpechane opened #3012
  • 18:03
    jpechane edited #2818
  • 13:42
    jpechane edited #3005
  • 11:01
    jpechane ready_for_review #3005
  • 10:46
    jpechane synchronize #3005
  • 10:29
    jpechane synchronize #3005
  • 10:11
    jpechane synchronize #3005
  • 00:30
    Naros synchronize #3011
  • 00:13
    Naros opened #3011
  • Dec 02 23:00
    shichao-an opened #3010
  • Dec 02 20:15
    gunnarmorling closed #3007
  • Dec 02 18:54
    Naros opened #3009
  • Dec 02 18:30
    Naros labeled #3008
  • Dec 02 18:30
    Naros opened #3008
  • Dec 02 18:30
    Naros labeled #3008
  • Dec 02 18:30
    Naros labeled #3008
  • Dec 02 17:52
    Naros opened #3007
  • Dec 02 14:41
    Naros synchronize #3006
  • Dec 02 14:07
    Naros opened #3006
  • Dec 02 13:57
    jpechane synchronize #3005
Jiri Pechanec
@jpechane
@gunnarmorling Yes
Gunnar Morling
@gunnarmorling
ok, cool; I'll send out an email then to announce this change
only impact for folks really would be to adjust their own local names to point to main rather than master
Payam
@pysf
Hey everybody, I am receiving NullPointerException on MySQL connector, The issue blocked the whole process on my side. I am not sure if it is a misconfiguration or a bug. I would appreciate any comments on that.
https://issues.redhat.com/browse/DBZ-4166
Chris Cranford
@Naros
Hi @pysf you mention that another table works, does the other table have a _ in its name?
Payam
@pysf
@Naros Yes the other table name is cached_products.
Gunnar Morling
@gunnarmorling
@Naros hey; can you send a reminder to the ML about the chat room change scheduled for tomorrow (as a reply to your original one)
Chris Cranford
@Naros
@gunnarmorling Yep, was going to do that around mid-day but I can do it now if you'd like.
Hi @pysf my apologies I didn't see you added the full log to the issue; okay I see the problem; looks like the parsing error allows the connector to proceed due to database.history.skip.unparseable.ddl=true; so we need to fix the grammar bug you've illustrated, thanks!
That's why you get the NPE
I don't believe normally that's a problem during streaming but I don't think we intended there to be CREATE TABLE syntax problems during snapshot like we do streaming.
Gunnar Morling
@gunnarmorling
@Naros any time which suits you
thx!
Payam
@pysf
@Naros Thank you so much! Please let me know if you need logs on different levels(Trace, Debug) or other details.
I also attached the docker-compose.yml file to the issue.
Chris Cranford
@Naros
Thanks @pysf, I believe we have all we need from what you've provided but if that changes we'll let you know on the jira. Thanks for the report!
Gunnar Morling
@gunnarmorling
all, updated the roadmap a bit for Debezium 1.8: https://twitter.com/gunnarmorling/status/1450734810402537475
Anisha Mohanty
@ani-sha
Hey all, Is it for me, or is JIRA out of service?
Naresh Kumar
@naresh-chaudhary

Hi team, I am getting the below error after whitelisting a new table in mysql connector (version 1.1Final)

org.apache.kafka.connect.errors.ConnectException: Encountered change event for table dominus.payment whose schema isn't known to this connector
    at io.debezium.connector.mysql.AbstractReader.wrap(AbstractReader.java:230)
    at io.debezium.connector.mysql.AbstractReader.failed(AbstractReader.java:207)
    at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:536)
    at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1095)
    at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:943)
    at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:580)
    at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:825)
    at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.kafka.connect.errors.ConnectException: Encountered change event for table dominus.payment whose schema isn't known to this connector
    at io.debezium.connector.mysql.BinlogReader.informAboutUnknownTableIfRequired(BinlogReader.java:794)
    at io.debezium.connector.mysql.BinlogReader.handleUpdateTableMetadata(BinlogReader.java:768)
    at io.debezium.connector.mysql.BinlogReader.handleEvent(BinlogReader.java:519)
    ... 5 more

@MrTrustworthy you also faced similar issue earlier, what is the resolution here?

2 replies
Jiri Pechanec
@jpechane
@gunnarmorling MongoDB is green -, the PR is ready for review debezium/debezium#2818
Gunnar Morling
@gunnarmorling
@jpechane woohoo
will take a look tomorrow
isn't this supported for MySQL and Oracle now?
I see changes to the Oracle parser, but doc updates only for MySQL
@jpechane speaking of docs, something like ColumnImpl should neither face up in docs of the actual option nor in actual user docs; it's an implementation detail and no one will know what this is about
Jiri Pechanec
@jpechane
@gunnarmorling debezium/debezium#2837
Gunnar Morling
@gunnarmorling
applied, thx!
Jiri Pechanec
@jpechane
@/all Debezium is moving to https://debezium.zulipchat.com Please continue with your discussion topics there as this channel will no longer be monitored.
/all Debezium is moving to https://debezium.zulipchat.com Please continue with your discussion topics there as this channel will no longer be monitored.
Jiri Pechanec
@jpechane
test
test
@jpechane Debezium Community migrated to https://debezium.zulipchat.com/
Test
@jpechane Debezium Community migrated to https://debezium.zulipchat.com/
Sungho Hwang
@sgc109
@gunnarmorling I created a Jira issue for the first time. Does it make sense? https://issues.redhat.com/projects/DBZ/issues/DBZ-4191
1 reply
Jiri Pechanec
@jpechane
@sgc109 Debezium Community migrated to https://debezium.zulipchat.com/
Jiri Pechanec
@jpechane
@Naros Debezium Community migrated to https://debezium.zulipchat.com/
akshay kushal
@akshay2305_twitter
Hi Team,
Jiri Pechanec
@jpechane
@akshay2305_twitter Debezium Community migrated to https://debezium.zulipchat.com/
Rotem Adhoh
@rotem-ad
Hey guys, I’m trying to open a Jira issue and nothing happens when I click the “Create” button. Not sure what to do..
Jiri Pechanec
@jpechane
@rotem-ad Debezium Community migrated to https://debezium.zulipchat.com/
Davit Beradze
@dberadze_twitter

Hello, the 1.7 and 1.8 version gets :

Error: Could not find or load main class org.apache.kafka.connect.cli.ConnectDistributed

I run with the default config
docker run -it --name connect -p 8083:8083 -e GROUP_ID=1 -e CONFIG_STORAGE_TOPIC=my-connect-configs -e OFFSET_STORAGE_TOPIC=my-connect-offsets -e ADVERTISED_HOST_NAME=192.100.100.100 debezium/connect

what is the wrong?

Jiri Pechanec
@jpechane
@dberadze_twitter Debezium Community migrated to https://debezium.zulipchat.com/
Waqas Dilawar
@waqasdilawar
@gunnarmorling Hi dear, I'm trying to expose metrics of Kafka Connector using this docker-compose file (https://github.com/debezium/debezium-examples/blob/main/monitoring/docker-compose.yml), but I'm confusing myself with this line (KAFKA_OPTS=-javaagent:/kafka/etc/jmx_prometheus_javaagent.jar=8080:/kafka/etc/config.yml). Can you please tell me what I'm supposed to replace here? Btw I can access logs in JConsole but it's neither working in the browser nor in Prometheus without this line.
Jiri Pechanec
@jpechane
@waqasdilawar Debezium Community migrated to https://debezium.zulipchat.com/
Jiri Pechanec
@jpechane
@blcksrx Debezium Community migrated to https://debezium.zulipchat.com/
yashpreetmsft
@yashpreetmsft

@jpechane

Hi Jiri, I wanted to use kafka connect in different machines( with different IP's) , I started zookeeper, server and kafka connect with debezium and realised the connectors I connect in 1st machine is syncing with the other machine, I can't figure out why ( I am using same DB from SQL Server in org), is it because of CDC of same DB or there could be some other reason?

I am using advertised.host.name as localhost should I change it too... I am using distributed mode configuration... Is there any article that I can follow to use different machines in Debezium and sync data accordingly.. ( I want to use more than 1 machines for fault tolerence and scaling.)

Any help will be really appreciated, thanks in advance :)

Jiri Pechanec
@jpechane
@yashpreetmsft Debezium Community migrated to https://debezium.zulipchat.com/
Jiri Pechanec
@jpechane
@zxxz Debezium Community migrated to https://debezium.zulipchat.com/
1 reply
@zxxz Debezium Community migrated to https://debezium.zulipchat.com/