Jiajun Zhu
Jiajun Zhu
btw, i also cannot get high passkey retrieval accuracy when finishing the finetuning of llama 7B with length 8192. generally the accuracies are 0.5.
my mistake for `python3 passkey_retrival` for Llama 7B. the results should be right. but the problem of low accuracy for longlora-llama-7b with length 8192 remains.
any updates related to this enhancement? I think llama adapter is really influential with more than 5k stars and such enhancement will be very useful. 😃