joblib: Parallel always was stuck in the end

一曲冷凌霜 提交于 2019-12-23 15:51:06

问题


My Parallel uses:

sdf = Parallel(n_jobs=3, verbose=1, pre_dispatch='1.5*n_jobs')(delayed(char_etl)(x,k1,k2,k3) for x in X)

X, which is a list .char_etl, is a string match function.

Versions that I'm using are: python 2.7.11, centos 6.7, joblib 0.11

Every time was stuck,like this:

[Parallel(n_jobs=3)]: Done 89 tasks | elapsed: 10.9s
[Parallel(n_jobs=3)]: Done 258 tasks | elapsed: 46.8s
[Parallel(n_jobs=3)]: Done 552 tasks | elapsed: 1.7min
[Parallel(n_jobs=3)]: Done 902 tasks | elapsed: 2.7min
[Parallel(n_jobs=3)]: Done 997 out of 1000 | elapsed: 2.9min remaining: 0.5s
Thanks.

来源:https://stackoverflow.com/questions/43586223/joblib-parallel-always-was-stuck-in-the-end

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!