user2311717757

Results 1 comments of user2311717757

ppo训练时出现问题：UserWarning: KL divergence is starting to become negative: -233.50

![FFA71931-01A2-445E-85AF-8E6726D5AF6E](https://github.com/shibing624/MedicalGPT/assets/129850873/fdcb6487-6ddc-4576-81d3-dec37c85a16a) 我打印了actor模型的回复，如果忽略警告会导致actor模型无法生成内容