Hongjian Song comments

Results 5 comments of


                                            Hongjian Song

@daodao97 , 在prompt的最后，用中文加一句“请用中文回答问题”可解。尝试过用英文改Prompt，都不行。但是用中文改prompt，测了10几个问题都是返回的中文。

Hi @carmocca , can https://github.com/Lightning-AI/lit-parrot/pull/171 save some RAM while pretraining and fine-tuning？

Hi @carmocca , I am not familiar with that, so I am afraid I can't port the change from `lit-parrot` to `lit-llama` here.

I also faced this problem while I tried to tine-tune lora on multiple GPUs with FSDP.

Same here! Even I have installed pybind11, it still raises this error.