khalil

All DeepSpeed Stag have the same memory footprint.

1

### System Info ```Shell - `Accelerate` version: 0.27.2 - Platform: Linux-5.15.0-92-generic-x86_64-with-glibc2.35 - Python version: 3.10.13 - Numpy version: 1.26.3 - PyTorch version (GPU?): 2.2.0 (True) - PyTorch XPU available: False...

How to load the new model weight

1

I am trying to extend Mistral 7B, I've try the code of extending the model. It's work fine but when I am trying to load the model with the new...

[Feature] Add DiscoPOP algorithm

2

I've read this paper recently https://arxiv.org/abs/2406.08414, I am wandering if I can work on adding this algorithm to the framework, I want to implement for myself, but I can add...

Alghafa benchmark

7

This is a continue process of adding the AlGhafa benchmark, within this request I've add the BoolQ and OpenBookQ