Duc Anh Le

Feature Request: Optimization for large models

9

Hello, I have a very large model (>2GB) which I would like to optimize using this library. Unfortunately I cannot shrink my model under 2GB. Therefore while using the optimization,...

get_fp32_state_dict_from_zero_checkpoint with fixed weights in pipeline

2

Hello, I have a pipeline that looks as follows: Input --> `Part A` --> `Part B` --> output What I want to achieve now is that I first set `A`...

DeepSpeed and Illegal Instruction

1

Hello, I am currently trying to run a training on a SLURM environment. The IT-support of the cluster I am using is currently working on it (let's call it `cluster...

Embedding with T5-Encoder

1

Hello, thanks for this amazing framework. I wanted to ask since I am interested in generating embeddings, is the usage of the `T5EncoderModel` integrated? As far as I can tell,...