How to use Flink's KafkaSource in Scala?

Question

I\'m trying to run a simple test program with Flink\'s KafkaSource. I\'m using the following:

• Flink 0.9
• Scala 2.10.4
• Kafka 0.8.2.1

Answer 1

object FlinkKafkaStreaming {
    def main(args: Array[String]) {
    val env = StreamExecutionEnvironment.getExecutionEnvironment
    val properties = new Properties()
    properties.setProperty("bootstrap.servers", "localhost:9092")
   // only required for Kafka 0.8
   properties.setProperty("zookeeper.connect", "localhost:2181")
   properties.setProperty("group.id", "flink-kafka")
   val stream = env.addSource(new FlinkKafkaConsumer08[String] 
  ("your_topic_name",new SimpleStringSchema(), properties))   
  stream.setParallelism(1).writeAsText("your_local_dir_path")
  env.execute("XDFlinkKafkaStreaming")
  }
}

---

In order to test you may do as below:

1. Run flink demo first;
2. Run Kafka_Proudcer;

---