MOSS icon indicating copy to clipboard operation
MOSS copied to clipboard

请问 moss-moon-003-sft-plugin 和 moss-moon-003-sft 的推理方式是一样的吗

Open fade-color opened this issue 2 years ago • 7 comments

没有看到moss-moon-003-sft-plugin相关的推理代码,这个插件功能是如何打开或关闭的呢,还是直接推理即可,感谢

fade-color avatar Apr 21 '23 03:04 fade-color

插件需要跟后端交互时调取api,将api返回结果concat之后再发送给推理,需要修改moss inference demo

piglaker avatar Apr 21 '23 03:04 piglaker

@fade-color plugin的推理和sft不太一样,需要将meta instruction中相应的插件改为enabled并给出API接口,在调用MOSS推理时格式如下:

<|Human|>: ...<eoh>
<|Inner Thoughts|>: ...<eot>
<|Commands|>: ...<eoc>
<|Results|>: ...<eor>
<|MOSS|>: ...<eom>

我们稍后会给出使用plugin的例子

txsun1997 avatar Apr 21 '23 03:04 txsun1997

好的好的,respect!

fade-color avatar Apr 21 '23 04:04 fade-color

插眼,等待更新~

milk-bottle-liyu avatar Apr 21 '23 10:04 milk-bottle-liyu

期待更新。

Ch3nYe avatar Apr 22 '23 12:04 Ch3nYe

期待更新!

cjrzh avatar Apr 23 '23 08:04 cjrzh

期待更新!

firdota avatar Apr 25 '23 07:04 firdota

@fade-color @milk-bottle-liyu @Ch3nYe @cjrzh @firdota 插件版MOSS使用说明已经更新到README

txsun1997 avatar Apr 26 '23 05:04 txsun1997