Treemann issues

Repositories
Issues
Comments

Results 3 issues of


                                            Treemann

Interesting Problems of Accuracy & Inference Speed with run_eval_needle.sh

Hi, I prepared the `pg19` dataset and ran `run_eval_needle.sh` with different settings of parameters. I have some questions about the experiment results and hope someone could help. **Device: NVIDIA V100/A100...

Fix logging issue in llama.py

Segmentation fault during evaluation

Hi, I could train the model, but met segmentation fault during evaluation. Did anyone meet similar problem? > CUDA_VISIBLE_DEVICES=0 leaderboard/scripts/run_evaluation.sh > 4.24.3-0+++UE4+Release-4.24 518 0 > Disabling core dumps. > leaderboard/leaderboard/leaderboard_evaluator.py...