hub-docs icon indicating copy to clipboard operation
hub-docs copied to clipboard

Update the `GGUF usage with llama.cpp` doc page

Open julien-c opened this issue 2 years ago • 4 comments

there's now way cleaner syntax than https://huggingface.co/docs/hub/en/gguf-llamacpp to load a model from HF in llama.cpp

julien-c avatar Apr 26 '24 14:04 julien-c

This is resolved by https://github.com/huggingface/hub-docs/pull/1280 right?

cakiki avatar Jul 01 '24 20:07 cakiki

hmm no only partly i think

https://huggingface.co/docs/hub/en/gguf-llamacpp is still sub-optimal imo.

cc @Vaibhavs10, and also cc @ngxson who opened https://github.com/huggingface/huggingface.js/pull/778 which is the same command(s) but "in-product" (on the Hub) vs. in a doc

julien-c avatar Jul 02 '24 08:07 julien-c

Good catch, will open a PR today to update and ask for everyone's reviews! 👍

Vaibhavs10 avatar Jul 02 '24 08:07 Vaibhavs10

Opened a PR to discuss: https://github.com/huggingface/hub-docs/pull/1326

cc: @ngxson - I wasn't able to add you as a reviewer, but please feel free to review

Vaibhavs10 avatar Jul 03 '24 10:07 Vaibhavs10

@julien-c now it can be closed I guess :smiley_cat:

cakiki avatar Sep 18 '24 08:09 cakiki

yes we can close but @Vaibhavs10 @ngxson i would still add how to install (recommend brew etc) to that doc page WDYT?

Closing in the meantime

julien-c avatar Sep 18 '24 08:09 julien-c