Running scheduled Spark job

Question

I have a Spark job which reads a source table, does a number of map / flatten / reduce operations and then stores the results into a separate table we use for reporting. Cur

Answer 1

Recommended Schedulers :

• Airbnb airflow
• Apache Oozie
• Apache Nifi
• Cron job (least recommended)