Guochen Yan

Question about reproducing test accuracy on citation datasets

3

Hi, I have read your paper, downloaded the code, and ran it without any changes (I follow the same hyperparameters and random seeds). But I found that I can't reproduce...

[Bug] on agieval_gen_617738, pyarrow.lib.ArrowInvalid: Could not convert '$5$;$10$' with type str: tried to convert to int64

2

### 先决条件 - [x] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。 - [x] 错误在 [最新版本](https://github.com/open-compass/opencompass) 中尚未被修复。 ### 问题类型 我正在使用官方支持的任务/模型/数据集进行评估。 ### 环境 {'CUDA available': True, 'CUDA_HOME': '/usr/local/cuda:/usr/local/cuda', 'GCC': 'gcc (Ubuntu 7.5.0-6ubuntu2) 7.5.0', 'GPU...

This project is excellent and efficient! Will it support the Ascend NPU? I directly downloaded this project in the 910B cluster and performed codegen with the hf backend. The model...