bert.cpp icon indicating copy to clipboard operation
bert.cpp copied to clipboard

Can this handle classification models, e.g. MNLI?

Open redthing1 opened this issue 2 years ago • 3 comments

For example, a model like this: https://huggingface.co/aloxatel/bert-base-mnli

If so, how would I do inference on it?

redthing1 avatar Jun 05 '23 02:06 redthing1

@okpatil4u implemented classification here https://github.com/skeskinen/bert.cpp/issues/11 I don't know if they ever made the changes public

skeskinen avatar Jun 05 '23 12:06 skeskinen

@okpatil4u implemented classification here #11 I don't know if they ever made the changes public

Here is the bert classification model with ggml: https://github.com/yilong2001/berts.cpp

yilong2001 avatar Nov 13 '23 14:11 yilong2001

@okpatil4u implemented classification here #11 I don't know if they ever made the changes public

Here is the bert classification model with ggml: yilong2001/berts.cpp

Excellent, thank you! Could you share with me briefly any instructions to try it?

redthing1 avatar Nov 13 '23 21:11 redthing1