Jinxing Pan
Jinxing Pan
可以改成这样 
I didnt check which case should not use weights_only=True. I just add it in all of the torch.load. Hope it will help.
Is this OK? I haven't use pre-commit tools brefore. I do it by myself lol.
I found that not all of the `torch.load` are compatible with `weights_only=True`. Some of them should be set to `weights_only=False` explicitly instead.
@microsoft-github-policy-service agree
> 您好,想问一下,您最后复现成功LLaVA_v1.5_7b的性能吗?因为我最近也在实验,并不能完全复现到它的效果,是有什么其他trick吗? @snowpine-max Check this #523. It may help you reproduce the performence.
same issue too.
I've check that once again. The problem still exists.
> i also notice this problem, however, when i check the code in [69b7b5e](https://github.com/open-compass/VLMEvalKit/commit/69b7b5ed9d8fcdc2b8ac3f48e9974a38111a92b1). I found that it only modified three parts: > > 1. Modify various log records, such...
> I can confirm the issue on commit [9f21ee8](https://github.com/open-compass/VLMEvalKit/commit/9f21ee8a8251f735d241e7009d507b6bbedcd1b2). `"perception","reasoning","OCR","artwork","celebrity","code_reasoning","color","commonsense_reasoning","count","existence","landmark","numerical_calculation","position","posters","scene","text_translation" "1342.2684073629453","301.42857142857144","130.0","112.0","125.88235294117646","62.5","151.66666666666669","106.42857142857143","93.33333333333333","185.0","138.5","40.0","115.0","140.1360544217687","150.75","92.5" ` The counting score is 93.3. The counting score is 155 in a reference experiment ([haotian-liu/LLaVA#927](https://github.com/haotian-liu/LLaVA/issues/927)). The score of...