Spark Structured Streaming - Processing each row

Question

I am using structured streaming with Spark 2.1.1. I need to apply some business logic to incoming messages (from Kafka source).

essentially, I need to pick up the messa

Answer 1

try ForeachWriter, In ForeachWriter process() method receives single row from data frame. and you can process the data as you want. https://spark.apache.org/docs/latest/api/java/org/apache/spark/sql/ForeachWriter.html