Running arbitrary python code in worker nodes in PySpark with Spark Arrow

Question

I need to implement a pyspark application that can run some arbitrary python function code in parallel on the worker nodes. After doing some reading I think I\'ve come up wi