How do I parallelize a simple Python loop?

后端 未结 13 1577
北荒
北荒 2020-11-22 11:54

This is probably a trivial question, but how do I parallelize the following loop in python?

# setup output lists
output1 = list()
output2 = list()
output3 =          


        
13条回答
  •  醉话见心
    2020-11-22 12:24

    from joblib import Parallel, delayed
    import multiprocessing
    
    inputs = range(10) 
    def processInput(i):
        return i * i
    
    num_cores = multiprocessing.cpu_count()
    
    results = Parallel(n_jobs=num_cores)(delayed(processInput)(i) for i in inputs)
    print(results)
    

    The above works beautifully on my machine (Ubuntu, package joblib was pre-installed, but can be installed via pip install joblib).

    Taken from https://blog.dominodatalab.com/simple-parallelization/

提交回复
热议问题