How to set group.id for consumer group in kafka data source in Structured Streaming?

后端 未结 4 748
一整个雨季
一整个雨季 2020-12-06 03:11

I want to use Spark Structured Streaming to read from a secure kafka. This means that I will need to force a specific group.id. However, as is stated in the documentation th

4条回答
  •  醉梦人生
    2020-12-06 03:37

    Now with spark3.0, you can specify group.id for kafka https://spark.apache.org/docs/latest/structured-streaming-kafka-integration.html#kafka-specific-configurations

提交回复
热议问题