dask, joblib, ipyparallel and other schedulers for embarrassingly parallel problems
问题 This is a more general question about how to run "embarassingly paralllel" problems with python "schedulers" in a science environment. I have a code that is a Python/Cython/C hybrid (for this example I'm using github.com/tardis-sn/tardis .. but I have more such problems for other codes) that is internally OpenMP parallalized. It provides a single function that takes a parameter dictionary and evaluates to an object within a few hundred seconds running on ~8 cores ( result=fun(paramset,