Tong Li
Hi Modas, You will need to install the package inside folder https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat using `pip install .` Then you will have module `coati`. I will close this issue, if you have...
Could you use `pip list` to check if your current env has `coati`?
If you install successfully, you should be able to see `coati` installed in your environment. Please make sure you are in the right environment. I suggest creating a new environment...
Hi, there are some differences between `\examples\language\llama` and `ColossalAI\applications\Colossal-LLaMA-2`. * `\examples\language\llama`: this script is mainly for testing the performance of ColossalAI, focusing on the training speed therefore we provide benchmark...
Hi @YeAnbang , is this ready to review? Should I review https://github.com/hpcaitech/ColossalAI/pull/5148 this first?
Could you please try to downgrade the version of transformers? For example, 4.33.3. There is an update of transformers in 4.36.xx.
Hi @Desperado-Jia , One tests are failing, please have a check. Thanks.
Hi @Desperado-Jia, there are some conflicts in this file, please address this first.
We are still working on the pipeline. Once we validate the process, we will release.
Hi, Yes, we are planning to open-source the data processing toolkit for the whole community.