I have a python application that grabs a collection of data and for each piece of data in that collection it performs a task. The task takes some time to complete as there i
If you can easily partition and separate the data you have, it sounds like you should just do that partitioning externally, and feed them to several processes of your program. (i.e. several processes instead of threads)