shrinath-suresh

FSDP - TypeError: load_state_dict() got an unexpected keyword argument 'strict'

2

### System Info ``` - `transformers` version: 4.22.0.dev0 - Platform: Linux-5.4.0-1072-aws-x86_64-with-debian-buster-sid - Python version: 3.7.10 - Huggingface_hub version: 0.8.1 - PyTorch version (GPU?): 1.12.0+cu102 (True) - Tensorflow version (GPU?): not...

bloom-7b inference - RuntimeError: expected scalar type Half but found Float

3

### System Info ```Shell Copy-and-paste the text below in your GitHub issue - `Accelerate` version: 0.12.0 - Platform: Linux-5.15.0-1020-aws-x86_64-with-glibc2.31 - Python version: 3.9.4 - Numpy version: 1.23.3 - PyTorch version...

Training diffusers examples using torch FSDP

2

### Describe the bug I am able to run the current diffuser examples as specified in the readme steps https://github.com/huggingface/diffusers/tree/main/examples/text_to_image https://github.com/huggingface/diffusers/tree/main/examples/unconditional_image_generation Would like to know if the examples can be...

Llamacpp with cpp backend

1

## Description Benchmarking LLM deployment with CPP Backend ## Setup and Test 1. Follow the instructions from [README.md](https://github.com/pytorch/serve/blob/cpp_backend/cpp/README.md) to set up the environment 2. Download the [TheBloke/Llama-2-7B-Chat-GGML](https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML) model. ``` cd...

## What changes are proposed in this pull request? Lightning 2.0 fixes ## How is this patch tested? Existing unit tests should pass [bert_inference.txt](https://github.com/mlflow/mlflow-torchserve/files/11117937/bert_inference.txt) [bert_model.txt](https://github.com/mlflow/mlflow-torchserve/files/11117938/bert_model.txt) [cifar_inference.txt](https://github.com/mlflow/mlflow-torchserve/files/11117939/cifar_inference.txt) [cifar_model.txt](https://github.com/mlflow/mlflow-torchserve/files/11117940/cifar_model.txt) [iris_inference.txt](https://github.com/mlflow/mlflow-torchserve/files/11117941/iris_inference.txt) [iris_model.txt](https://github.com/mlflow/mlflow-torchserve/files/11117942/iris_model.txt) [iris_torchscripted_inference.txt](https://github.com/mlflow/mlflow-torchserve/files/11117943/iris_torchscripted_inference.txt)...

## What changes are proposed in this pull request? Fix for [comment](https://github.com/mlflow/mlflow-torchserve/pull/97#discussion_r1067638179) ## How is this patch tested? Existing UTs ## Release Notes ### Is this a user-facing change? -...