apache-kafka-connect

I've read http://debezium.io/docs/connectors/mysql/ but I could not find any info about whether debezium can be configured so that changes from 2 (or more) tables could be written to the same, single kafka topic? It seems to me that it is always 1 table -> 1 topic. Yes, use Single Message Transforms , per the link you identified. You can use regular expressions (regex) to map the tables to the topic required. Both io.debezium.transforms.ByLogicalTableRouter or org.apache.kafka.connect.transforms.RegexRouter should do the trick. There's an example of the latter in this post here : "transforms":

We are trying to write back the values from a topic to a postgres database using the Confluent JDBC Sink Connector. connector.class=io.confluent.connect.jdbc.JdbcSinkConnector connection.password=xxx tasks.max=1 topics=topic_name auto.evolve=true connection.user=confluent_rw auto.create=true connection.url=jdbc:postgresql://x.x.x.x:5432/Datawarehouse value.converter=io.confluent.connect.avro.AvroConverter value.converter.schema.registry.url=http://localhost:8081 key.converter=io.confluent.connect.avro.AvroConverter key.converter.schema.registry.url=http://localhost:8081 We can read the value

I am trying to use kafka connect as sink. Our db are kerberized, I am not able to figure out how we can specify kerberos in the connection,url rather than user pass when i try to form the connection.url as jdbc:db2://<host>:<port>/database;userKerberos=true it fails saying invalid url. My question is how we can use kerberos in kafka connect rather than specifying user and pass? Other question is when I give even user/pass it throw below error A communication error occurred on the connection's underlysing socker. Connection reset ERRORCODE=-4499, SQLSTATE=08001 来源： https://stackoverflow.com

I can see this has been discussed a few times here for instance but I think the solutions are out of date due to breaking changes in Elasticsearch. I'm trying to convert a long/epoch field in my Json in my Kafka topic to an Elasticsearch date type which is pushed through the connector. When I try to add a dynamic mapping, my Kafka connect updates fail because Im trying to apply two mappings to a field, _doc and kafkaconnect. This was a breaking change around version 6 I believe where you can only have one mapping per index. { "index_patterns": [ "depart_details" ], "mappings": { "dynamic