xtuner
xtuner copied to clipboard
custom system/prompt template support?
How can we add our custom system/prompt template rather than model default template?
You can already edit the system templates for each model. Uninstall tuner. Then got clone this repo then pip install e . Something like that. Then you have the source files. Then edit the system prompt python file. For your model. They are all contained in one file I saw yesterday.
xtuner/utils/templates.py
@mylesgoose I’ve been doing it the same way, but editing the source can be cumbersome for users. It would be helpful to have a built-in feature for this.