This is an old question but none of the answers resolved my problem. I am using Azure HDInsight for my Spark cluster and Event Hub for Kafka message broker.
For examp