Ko Sung comments

Repositories
Issues
Comments

Results 3 comments of


                                            Ko Sung

[Questionnaire] Which model do you want to support in mmdeploy?

TSM/TSN... mmaction2 tensorrt

[WIP][Feature] DPO

@amulil 请问现在有DPO训练的模型指标对比吗？我想参考这个实现[RLHF-V](https://arxiv.org/abs/2312.00849) code: https://github.com/RLHF-V/RLHF-V, https://github.com/thunlp/Muffin

internlm2_20b_qlora_msagent_react_e3_gpu8训练时如何添加自己的词汇表呢？

直接在config中定义好新加的special token，传到dataset和model中，model 需要resize_embedding ``` for special_token in special_tokens: if special_token not in tokenizer.get_vocab(): tokenizer.add_tokens([special_token], special_tokens=True) print(f'After adding special tokens, Vocabulary Size: {len(tokenizer)}') ```