xtuner icon indicating copy to clipboard operation
xtuner copied to clipboard

custom system/prompt template support?

Open HeegonJin opened this issue 1 year ago • 3 comments

How can we add our custom system/prompt template rather than model default template?

HeegonJin avatar Jul 24 '24 04:07 HeegonJin

You can already edit the system templates for each model. Uninstall tuner. Then got clone this repo then pip install e . Something like that. Then you have the source files. Then edit the system prompt python file. For your model. They are all contained in one file I saw yesterday.

mylesgoose avatar Aug 18 '24 21:08 mylesgoose

xtuner/utils/templates.py

mylesgoose avatar Aug 18 '24 21:08 mylesgoose

@mylesgoose I’ve been doing it the same way, but editing the source can be cumbersome for users. It would be helpful to have a built-in feature for this.

HeegonJin avatar Aug 19 '24 02:08 HeegonJin