belle9217

Results 10 comments of belle9217

我用base v100 32G都能OOM

对啊,base v100 32G 都能OOM

我也遇到这个问题,请问你的问题解决了吗

yes,i have the same error use the command: m_eval --model hf --model_args pretrained=dc3.5-7b-32k --tasks mmlu --device cuda:4 --batch_size 8 --num_fewshot 5 --output_path ./eval_out --use_cache ./eval_cache_mmlu

@dz1iang yes,it works,that is all I need.

> qwen2 huggingface model 评测结果有问题 ![image](https://private-user-images.githubusercontent.com/30854283/349072092-2ca04925-78e8-4829-8878-a4c7eac8b773.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjU2MTI3MTYsIm5iZiI6MTcyNTYxMjQxNiwicGF0aCI6Ii8zMDg1NDI4My8zNDkwNzIwOTItMmNhMDQ5MjUtNzhlOC00ODI5LTg4NzgtYTRjN2VhYzhiNzczLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MDYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTA2VDA4NDY1NlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTg5NWNiNWRkNjNkZGRiYTQ5NTE3ZmM1ZDY1NTVhMTZhYzVmZjlkNzVlNDNkN2MwZDgxZTZkYmIyNDEzNmJkOTYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.8l1u3TFWPmn2JiZK5KgKMd91nVfPjZCGtppJ8yhpOks) 我得到的也是这个结果,请问您解决了吗