stceum

Add DPO support for DeepSpeed-Chat

1

Considering the advantages of [DPO(Direct Preference Optimization)](https://arxiv.org/abs/2305.18290) as being "stable, performant, and computationally lightweight, eliminating the need for fitting a reward model, sampling from the LM during fine-tuning, or performing...

- 一种可能更好的输入密码的方式。 之前：（需要密码，该密码可能存在于 bash/zsh/... 历史记录中）： ```shell $ ipgw config account add -u xxxxxxx -p xxx...xxx # 可能不安全 ``` 现在： ```shell $ ipgw config account add -u xxxxxxx Enter Password: #...

Got following error in current code: ```bash ... File "/bala/bala/bala/site-packages/lmppl/__init__.py", line 3, in from .ppl_recurrent_lm import LM File "/bala/bala/bala/site-packages/lmppl/ppl_recurrent_lm.py", line 129 model_inputs = {k: v.to(self.device) for k, v in model_inputs.items()}...