MiniCPM icon indicating copy to clipboard operation
MiniCPM copied to clipboard

请问embedding模型和rerank模型怎么finetune,用的FlagEmbedding的吗?

Open LIUKAI0815 opened this issue 1 year ago • 1 comments

LIUKAI0815 avatar Sep 05 '24 13:09 LIUKAI0815

+1

ericxk avatar Sep 06 '24 02:09 ericxk

我们是使用的Openmatch框架进行训练https://github.com/Kaguya-19/OpenMatch 您可以将weighted_mean pooling hack进FlagEmbedding/Sentence Transformer/unilm等框架进行适配

Kaguya-19 avatar Sep 10 '24 03:09 Kaguya-19

@ericxk @LIUKAI0815 我们现已支持Sentence Transformers库,详见https://huggingface.co/openbmb/MiniCPM-Embedding

Kaguya-19 avatar Sep 24 '24 12:09 Kaguya-19