kafka connector HTTP/API source

主宰稳场 提交于 2020-05-30 03:33:05

问题


I am actually aware on how to capture data from any data source, such as a specific API (e.g HTTP GET request) and ingest them in specific kafka connector.

{
    "name": "localfileSource", 
    "config": {
        "connector.class": "FileStreamSourceConnector",
        "tasks.max": "1",
        "file": "test.txt",
        "topic": "connectSource"
    }
}

I would need something similar to this(FileStreamSourceConnector), that can be used with API sources.


回答1:


You can always build your own connectors, to stream from http source in a set of intervals is relatively simple.

I am aware that you may have solved your problems, a naive implementation can be found: https://github.com/pegerto/kafka-connect-http

Regards.



来源:https://stackoverflow.com/questions/46568940/kafka-connector-http-api-source

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!