cdx
cdx
Hi, I solved this by pip uninstall transformer-engine
> > Hi, I solved this by pip uninstall transformer-engine > > 完美，困扰我好久了，终于解决了 不用谢😁
Hi, The raw data size mentioned in Table 7 in [our paper](https://arxiv.org/pdf/2309.09530.pdf) (51.2 GiB) is copied from Table 1 in the Pile paper: [https://arxiv.org/pdf/2101.00027.pdf](https://arxiv.org/pdf/2101.00027.pdf). I downloaded the data from Hugging...
Hi, **Regarding the evaluation** You can implement the evaluation code using the lm-eval-harness framework. We have provided pre-templatized input instructions and output completions for each domain-specific task on Hugging Face:...
Hi, we are currently working on the next version of AdaptLLM at [Instruction-Pretrain](https://huggingface.co/instruction-pretrain/finance-Llama3-8B), with plans to release the evaluation code by then, please stay tuned.
请问你有load llama3 instruct要求的template吗？
Q1: How to get the scores through GPT-Neo-2.7B? By calculating the task metric score of each input concatenation of prompt + testing input, see Section 3.2. Q2: In which procedure,...
You may refer to Section 3.4 to see how we get the score after tuning the prompt retriever.
Training is in Section 3.3, you may refer to the provided code as well.