pysprak - microbatch streaming delta table as a source to perform merge against another delta table - foreachbatch is not getting invoked

Question

I have created a delta table and now I\'m trying to perform merge data to that table using foreachBatch(). I\'ve followed this example. I am running this code in dataproc image