Can I teach alpaca.cpp new material?

[ImanSharaf]

I recently came across the alpaca.cpp open source project and I'm interested in using it for my own purposes. I was wondering if it's possible to teach the alpaca.cpp model new material by providing a large documentation, and if so, what would be the best approach to do that?

[kajuberdut]

Splitting your question up a bit:

1. Are there tools in anitmatter15's fork of alpaca.cpp (this repository) that help you train new weights into alpaca: No.
2. Are there ways to train new weights that could be used with alpaca.cpp (and the version in this repository): Maybe.

There are some early-ish guides on how to do the the training: Video tutorial: https://youtu.be/LSoqyynKU9E Another repository that has code to help with this: https://github.com/tloen/alpaca-lora#training-finetunepy

If you can then plug the new values directly into the releases from this repository and use them, you would have to test it, I haven't yet seen anybody do that but it's inevitable.