distributed
distributed copied to clipboard
dask
A distributed task scheduler for Dask
Tornado 6.2 was just released and we're hitting a few errors on CI. So far, the only thing I observed was a deprecation warning that is converted to an error....
**What happened**: `make_current` and `clear_current` appear to be deprecated in Tornado 6.2, which causes errors in tests, since warnings are treated as errors. Though it's my mistake that I left...
This came out of @martindurant's suggestion in #6804 
According to the `pytest` docs, `tmpdir` and `tmpdir_factory` are considered legacy (see: https://docs.pytest.org/en/7.1.x/how-to/tmp_path.html#the-tmpdir-and-tmpdir-factory-fixtures). Replacing them with `tmp_path` and `tmp_path_factory` would enable us to use standard `pathlib.Path` objects.
This PR adds a table of basic statistics (max, min, mean) for the worker metrics (CPU, memory, # of file descriptors, etc.) to the Workers tab of the dashboard: ...
Sometimes we want to retry a task on another worker if it appears to be taking a long time. One approach would be to specify a timeout when submitting the...
Implementation of `dask job submit`. This is intended to consume a python script as: ```python dask job submit ``` There are potentially two different usage patterns we are anticipating: -...
Earlier today I wanted to upload a performance report to an S3 bucket but then noticed that `performance_report(...)` doesn't have a `storage_options` parameter. This isn't a huge deal as one...
In https://github.com/dask/distributed/issues/6774, I manually went through the CI dashboard and identified taxonomies of test failures that were similar/the same across many tests. I have a feeling it would be valuable...
**What happened**: Running the [` ncempy` DM file reader](https://openncem.readthedocs.io/en/latest/ncempy.io.html#module-ncempy.io.dm) with ` on_memory=True` in ` distributed` futures causes `BufferError: cannot close exported pointers exist` errors, while running it with other methods...
