Need Complete Example for Running Evaluation

[AOoligei]

Hi! The current example (local_BGE_local_LLM.py) is too simplified - it only shows a basic query without any evaluation.

Could you provide a complete example that shows:

• How to load and evaluate on actual datasets (e.g., ComplexTR)
• How to calculate metrics (accuracy, F1, etc.)

Basically, how do I reproduce the paper's results?

Thanks!

[AIcling]

Hi, thanks for your helpful suggestion! I’ve already provided a more detailed and complete implementation in the reproduce/ folder. You can follow the instructions in reproduce/README.md to run evaluations on the datasets. If you find anything unclear or incorrect, please feel free to discuss further with us. We’d be glad to improve it together. Wishing you success in your experiments!