Cheng Zhang

icon indicating a website link https://chengzhang-98.github.io/blog/

icon company Imperial College London icon location London icon location PhD student at Imperial College London.

Results 1 issues of Cheng Zhang

How to properly evaluate W6A6 models using checkpoint from the mode zoo

2 comment

Dear author, may I ask how to evaluate the W6A6 opt model using the provided [ChenMnZ/OmniQuant](https://huggingface.co/ChenMnZ/OmniQuant/tree/main), `act_shifts`, and `act_scales` ? Here is my command ```bash python main.py --model $PATH_TO_MY_OPT_CHECKPOINT \...