问题
I am actually aware on how to capture data from any data source, such as a specific API (e.g HTTP GET request) and ingest them in specific kafka connector.
{
"name": "localfileSource",
"config": {
"connector.class": "FileStreamSourceConnector",
"tasks.max": "1",
"file": "test.txt",
"topic": "connectSource"
}
}
I would need something similar to this(FileStreamSourceConnector
), that can be used with API sources.
回答1:
You can always build your own connectors, to stream from http source in a set of intervals is relatively simple.
I am aware that you may have solved your problems, a naive implementation can be found: https://github.com/pegerto/kafka-connect-http
Regards.
来源:https://stackoverflow.com/questions/46568940/kafka-connector-http-api-source