Jonathan Jordan comments

Repositories
Issues
Comments

Results 3 comments of


                                            Jonathan Jordan

Is there support for loading a sharded gguf file ?

Prototype: https://github.com/abetlen/llama-cpp-python/commit/0e67a832bdda3d7e73cbcb162e93d5455503ca57 Will test and open PR if it works.

Is there support for loading a sharded gguf file ?

PR opened: https://github.com/abetlen/llama-cpp-python/pull/1457

Is there support for loading a sharded gguf file ?

> i would appreciate this feature! currently, i do something very hacky like below and it works (once all files are downloaded), but it's pretty clunky Well, my PR has...