vupjing comments

Repositories
Issues
Comments

Results 1 comments of


                                            vupjing

why some prompt doesn't work, the hidden_states will be nan after GemmaModel.forward

@pengchongjin the hardware is a 3080ti laptop (16G VRAM), windows, (torch / 2.1.1+cu118), ( torchvision / 0.16.1+cu118) using the below command in 7b/quant. >python run.py --ckpt e:\ai\models\gemma\gemma-7b-it-quant.ckpt --variant 7b --device...