Write a custom Kafka connect single message transform

五迷三道 提交于 2021-01-24 11:47:45

问题


I have configured a kafka connect Mongodb sink and I want to transform the message by implementing some custom logic.

Is Kafka connect limited to in-built SMTs (or) is it possible to write a custom SMT. If not how can I achieve this? through streams?


回答1:


Is Kafka connect limited to in-built SMTs

No, it is not. You can create your own and add them to your plugin path

Transformations are compiled as JARs and are made available to Kafka Connect via the plugin.path specified in the Connect worker’s properties file. Once installed, the transforms can be configured in the connector properties.

https://www.confluent.io/blog/kafka-connect-single-message-transformation-tutorial-with-examples

Example repo https://github.com/confluentinc/kafka-connect-insert-uuid



来源:https://stackoverflow.com/questions/57604283/write-a-custom-kafka-connect-single-message-transform

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!