Utkarsh Tyagi

Results 3 comments of Utkarsh Tyagi

The error you're encountering is due to the split_torch_state_dict_into_shards function not being available in huggingface-hub version 0.20.3. This function is included starting from version 0.23.0. To resolve this issue, update...

I am getting some errors related to vulkan shaders as well > [ 2%] Generate vulkan shaders > /bin/sh: 1: vulkan-shaders-gen: not found > make[2]: *** [ggml/src/CMakeFiles/ggml.dir/build.make:123: ggml/src/ggml-vulkan-shaders.hpp] Error 127...

The error was introduced in this commit: [vulkan : cmake integration (](https://github.com/ggerganov/llama.cpp/commit/17eb6aa8a992cda37ee65cf848d9289bd6cad860)https://github.com/ggerganov/llama.cpp/pull/8119[)](https://github.com/ggerganov/llama.cpp/commit/17eb6aa8a992cda37ee65cf848d9289bd6cad860) The repo compiles for the commit before it: [metal : template-ify some of the kernels (](https://github.com/ggerganov/llama.cpp/commit/c917b67f06c42d8ca8391b9bc73f5fe62c83bf70)https://github.com/ggerganov/llama.cpp/pull/8447[)](https://github.com/ggerganov/llama.cpp/commit/c917b67f06c42d8ca8391b9bc73f5fe62c83bf70)