xtuner icon indicating copy to clipboard operation
xtuner copied to clipboard

llava-phi3-mini conversion to gguf format

Open nakoeni opened this issue 1 year ago • 1 comments

How can I convert from Llama LLM or official LLaVA format or HuggingFace LLaVA format to gguf format?

nakoeni avatar Jun 10 '24 17:06 nakoeni

@nakoeni I'm sorry, the conversion process is rather cumbersome, so we haven't provided that for now.

hhaAndroid avatar Jun 19 '24 06:06 hhaAndroid