Salvatore Sanfilippo
Salvatore Sanfilippo
Merged! Thank you, great work. IMHO only two things that can be improved are: - show help on '?' - on comments for some reason the 'selection' box is smaller...
Thanks @nicpottier! Yes I still use iconping regularly, the change looks very useful, I'll install XCode in order to try it and merge. Thanks.
Hello @mp911de, yep we are going in the direction you said, I had no time to update the spec but is similar to what you suggested. I'll try to update...
Hello, these questions don't only apply to Jedis, but more broadly to the Redis Cluster clients ecosystem. I had the chance to think about these issues in the past, even...
That's great! Thank you so much.
> Definitely. Awesome. Than it's time to implement the missing quantization formats in gguflib :)
Just pardon me if I add that I follow closely the scene of Local LLMs on Reddit and other places, and people look with a huge interest to MLX and...
@awni one of the main contributions I tried to provide with gguflib was documenting the format. AFAIK the only description is in the comments of gguflib here: https://github.com/antirez/gguf-tools/blob/main/gguflib.c#L529 There you...
P.S. if the goal is to show the final user loading the model the GGUF actual quantization, I would not trust much the "MOSTLY_" defines stated in the GGUF file...
If you want a to_f16 method, I can do it right now.