dask-memusage
dask-memusage copied to clipboard
Explain requirement for Distributed, and how to use LocalCluster
If you want 8 worker processes:
from dask.distributed import Client, LocalCluster
cluster = LocalCluster(n_workers=8, threads_per_worker=1, memory_limit=None)
Client(cluster)