Python multiprocessing - Debugging OSError: [Errno 12] Cannot allocate memory

Question

I\'m facing the following issue. I\'m trying to parallelize a function that updates a file, but I cannot start the Pool() because of an OSError: [Errno 12

Answer 1

We had this a couple of time. According to my sys admin, there is "a bug" in unix, which will raise the same error if you are out of memory, of if your process reach the max file descriptor limit.

We had a leak of file descriptor, and the error raising was [Errno 12] Cannot allocate memory#012OSError.

So you should look at your script and double check if the problem is not the creation of too many FD instead