Yibo Peng
Yibo Peng
算法考试前抱个佛脚（居然还是同校学长的博客hhh
``` 100%|██████████████████████████████████████████████████████████████████████████████████████| 3676/3676 [04:18
1. In the llama3 model, the harness fetches the data type from model config, so the dtype for the `key` and `value` values passed into `linear_q4_0.quantize_key_value` defaults to bf16. However,...
Hi there, I tried on my arc a770 machine, my env setting is: ```bash transformers=4.31.0 ----------------------------------------------------------------- Name: ipex-llm Version: 2.1.0b20240421 ``` I first downloaded the Salesforce/blip2-opt-6.7b to my machine ```bash...
If you need to run the all-in-one benchmark, please first configure the environment using https://github.com/liu-shaojun/ipex-llm/tree/3f20072736ebe2caae6793a8c1a7c092b9627ba5/python/llm/example/GPU/PyTorch-Models/Model/llava (which uses LLaVA version 1.1.1); support for LLaVA v1.2 and transformers 4.36 in the benchmark...
updated @hkvision