Train multiple different sklearn models in parallel

本小妞迷上赌 提交于 2019-12-22 13:53:23

问题


Is it possible to train in parallel multiple different sklearn models?

For example, I'd like to train one SVM, one RandomForest and one Linear Regression model at the same time. The desired output would be a list of objects returned by the .fit method.


回答1:


Is it possible to train in parallel multiple different sklearn models?

Training multiple models?
YES.

Training multiple models in true-[PARALLEL] scheduling fashion?
NO.

Training one particular model, using some sort of low-level, fine-grain ( if not directly silicon-wired ) sorts of vectorisation / ILP-parallelism and improved temporal-locality and effects of cache-coherence?
YES,
already deployed, if resources and low-level code permit, yet these levels are principally constrained by low ratio of work-package payload v/s overheads - ref. re-formulated Amdahl's Law so as to respect both the overheads, resources ( on lower end of the time-scale ) and indivisible atomicity of some sorts of processing-sprint(s) ( on the upper end of the time-scale .. exactly due to the indivisible implementation of the atomic processing-segments so common in the sklearn ML-processing pipelines ).

Training different models in a "just"-[CONCURRENT] scheduling fashion?
YES.
Using a smart distributed-system infrastructure, not a few SLOCs :o)



来源:https://stackoverflow.com/questions/47980936/train-multiple-different-sklearn-models-in-parallel

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!