distributed icon indicating copy to clipboard operation
distributed copied to clipboard

Modernization of asyncio infrastructure / Deprecate Tornado

Open fjetter opened this issue 4 years ago • 1 comments

This is an issue to track efforts towards some modernization efforts of our asyncio infrastructure.

Very roughly this is about

  • Addressing all warnings triggered by py3.10
  • Slowly migrating away from tornado
  • Deal with anti-patterns around our usage of futures, tasks and callbacks, e.g. for better exception handling

Related issues

  • [x] https://github.com/dask/distributed/issues/6048
  • [x] https://github.com/dask/distributed/issues/6050
  • [x] https://github.com/dask/distributed/issues/6049
  • [x] https://github.com/dask/distributed/issues/6051

fjetter avatar Apr 01 '22 13:04 fjetter

I'd strongly recommend migrating to anyio, which can be done incrementally. Here's a page listing some of the productivity and correctness benefits!

Once you're fully migrated, it would also be easy to add Trio support - at that point, it's purely a "turn on the tests" exercise. See also discussion in https://github.com/dask/distributed/issues/6201.

Zac-HD avatar Aug 08 '25 22:08 Zac-HD