what's the difference of theColossalAI\examples\language\llama2 and ColossalAI\applications\Colossal-LLaMA-2

[SeekPoint]

🐛 Describe the bug

can we run both of it with the same dataset like RedPajama-Data-1T-Sample

Environment

No response

[TongLi3701]

Hi, there are some differences between \examples\language\llama and ColossalAI\applications\Colossal-LLaMA-2.

• \examples\language\llama: this script is mainly for testing the performance of ColossalAI, focusing on the training speed therefore we provide benchmark examples for testing speed.
• ColossalAI\applications\Colossal-LLaMA-2 : this is the pipeline for training our own model Colossal-LLaMa-2, which provide the full training instructions so that u can reproduce our training process.

We do recommend using ColossalAI\applications\Colossal-LLaMA-2 cuz we already validate its performance.