Logan Adams

Reverts #7085 which pinned the transformers version due to likely breaking changes from https://github.com/huggingface/transformers/pull/36335, fixes introduced in https://github.com/huggingface/transformers/pull/36455 Error: ``` RuntimeError: Failed to import transformers.models.vision_encoder_decoder.modeling_vision_encoder_decoder because of the following error...

Add `pyproject.toml` with legacy build backend to keep most logic in `setup.py`

2

- [ ] Test all build cases this needs to support. - [x] Test Windows builds/support. - `Successfully built deepspeed-0.16.5+1d869d1f-cp311-cp311-win_amd64.whl` - [x] Confirm pre-compiling ops - works with `--no-build-isolation` -...

[Roadmap] DeepSpeed Roadmap Q1 2025

6

This is a living document! For each item here, we intend to link the PR/issue for discussion. This is DeepSpeed's first attempt at a public roadmap and will be updated...

Fix - Update DeepSpeed to be PEP517 compliant, update to `pyproject.toml`

1

We need to update DeepSpeed to be compliant with [PEP 517](https://peps.python.org/pep-0517/) as well as for handling of [future changes to pip](https://github.com/pypa/pip/issues/11457).

- [ ] Update transformers versions - [ ] Unskip zero-shot tests - [ ] Fix second issue with updated transformers

Updating to transformers versions beyond v4.43.4 causes issues with the CI tests in the legacy mode. The bloom tests fail with: ``` FAILED test_non_persistent_deployment.py::test_single_GPU[None-50050-False-28080-fp16-1-False-False-1-True-False-ds_config0-text-generation-bigscience/bloom-560m-query3-non-persistent] - ValueError: not enough values to...

Updating to transformers versions beyond v4.42.4 causes issues with the CI tests in the legacy mode. The zero-shot-image-classification tests fail with: ``` FAILED test_non_persistent_deployment.py::test_single_GPU[None-50050-False-28080-fp16-1-False-False-1-True-False-ds_config0-zero-shot-image-classification-openai/clip-vit-base-patch32-query6-non-persistent] - ValueError: Attempting to cast a...