gapsong

icon company @fraunhoferhhi icon location Berlin icon location Exploring LLM Quantization with XAI. Feel free to check out my repositories and contact me for more information.

Results 1 issues of gapsong

Question: How to convert quantized model output to a .safetensor file for Hugging Face?

1 comment

Hello, First of all, thank you for this great work! I'm trying to build upon your idea and require a .safetensor file for use with the Hugging Face ecosystem. I've...