Xinghao Wang

Question about reproducing Fig.1

1

Hi! Thanks for the great work! Been playing with the code today and trying to reproduce Figure 1 in the paper, and here's what I got.  I noticed that...

False device placement when use with quantization_config

2

### System Info ```Shell - `Accelerate` version: 0.31.0 - Platform: Linux-5.4.0-148-generic-x86_64-with-glibc2.31 - `accelerate` bash location: /remote-home/xhwang/anaconda3/envs/gloq/bin/accelerate - Python version: 3.10.14 - Numpy version: 1.26.4 - PyTorch version (GPU?): 2.3.0+cu121 (True)...