Can this handle classification models, e.g. MNLI?
For example, a model like this: https://huggingface.co/aloxatel/bert-base-mnli
If so, how would I do inference on it?
@okpatil4u implemented classification here https://github.com/skeskinen/bert.cpp/issues/11 I don't know if they ever made the changes public
@okpatil4u implemented classification here #11 I don't know if they ever made the changes public
Here is the bert classification model with ggml: https://github.com/yilong2001/berts.cpp
@okpatil4u implemented classification here #11 I don't know if they ever made the changes public
Here is the bert classification model with ggml: yilong2001/berts.cpp
Excellent, thank you! Could you share with me briefly any instructions to try it?