picollm
picollm copied to clipboard
Published
5 months ago
•
Picovoice
Picovoice
On-device LLM Inference Powered by X-Bit Quantization
Results
2
picollm issues
Sort by
recently updated
recently updated
newest added
These models are amazing and ideally suited for picovoice llm. Would be good to get this in picovoice format or a transform code that can convert these models in hf...
Please add the latest [Phi-3.5-mini-instruct](https://huggingface.co/microsoft/Phi-3.5-mini-instruct) model to PicoLLM, which is much better than Phi-2.
enhancement