问题
I have been trying to manage the memory usage of Dask on a single local machine. For some reason, the default Dask Client() and LocalCluster() scheduler always seem to break, however Dask works great without specifying the scheduler and thus the default scheduler works the best for my purposes, however I am finding almost no documentation on this default scheduler let alone how to set a RAM limit on it. All of the information is for their specialized distributed client which does not seem to work. Does anyone know what/where the default scheduler documentation can be found or what they are even using as the default scheduler (as I cannot even find that information on their site/documentation). Or if not, has anyone found a solution to limit the RAM usage without using Client()?
Cheers
回答1:
in order to control the memory-limit in my local dask cluster i use the following set up:
ncores = 2
cluster = LocalCluster(n_workers=ncores, threads_per_worker=1,memory_limit =8e9)
client=Client(cluster)
来源：https://stackoverflow.com/questions/52998272/dask-memory-management-with-default-scheduler