BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard

I can't download the model

Open xXRagn0kXx opened this issue 4 months ago • 2 comments

When I try to download the model to compile it, it stays in this state:

(miniconda-bitnet-p3_9) bitnet@BitNet:~/BitNet$ hf download microsoft/BitNet-b1.58-2B-4T-gguf --local-dir models/BitNet-b1.58-2B-4T Fetching 3 files: 0%| | 0/3 [00:00<?, ?it/s] Downloading 'ggml-model-i2_s.gguf' to 'models/BitNet-b1.58-2B-4T/.cache/huggingface/download/f28pn7v36EcygdlMWvHpzrkkz6A=.4221b252fdd5fd25e15847adfeb5ee8888650 6ba50b8a34548374492884c2162.incomplete' (resume from 1074878023/1187801280)

ggml-model-i2_s.gguf: 0%|▏ | 3.12M/1.19G [00:19<08:44, 2.26MB/s]

Image

xXRagn0kXx avatar Sep 02 '25 13:09 xXRagn0kXx

I have tried other download tools but nothing

(miniconda-bitnet-p3_9) bitnet@BitNet:~/BitNet$ export HF_HUB_ENABLE_HF_TRANSFER=1 (miniconda-bitnet-p3_9) bitnet@BitNet:~/BitNet$ hf download microsoft/BitNet-b1.58-2B-4T-gguf --local-dir models/BitNet-b1.58-2B-4T Downloading '.gitattributes' to 'models/BitNet-b1.58-2B-4T/.cache/huggingface/download/wPaCkH-WbT7GsmxMKKrNZTV4nSM=.4e3e1a539c8d36087c5f8435e653b7dc694a0da6.incomplete' .gitattributes: 1.64kB [00:00, 7.39MB/s] Download complete. Moving file to models/BitNet-b1.58-2B-4T/.gitattributes Downloading 'README.md' to 'models/BitNet-b1.58-2B-4T/.cache/huggingface/download/Xn7B-BWUGOee2Y6hCZtEhtFu4BE=.67c672f98a229cfae21e2333f2b961099a0c448c.incomplete' README.md: 8.83kB [00:00, 15.2MB/s] Download complete. Moving file to models/BitNet-b1.58-2B-4T/README.md Downloading 'ggml-model-i2_s.gguf' to 'models/BitNet-b1.58-2B-4T/.cache/huggingface/download/f28pn7v36EcygdlMWvHpzrkkz6A=.4221b252fdd5fd25e15847adfeb5ee88886506ba50b8a34548374492884c2162.incomplete' ggml-model-i2_s.gguf: 0%|▏ | 3.12M/1.19G [00:39<3:30:31, 93.8kB/s]

xXRagn0kXx avatar Sep 10 '25 09:09 xXRagn0kXx

Huggingface download cli doesn't update download bar in real time. It will update it after certain percentage. This was happend to me also when first time downloading the model through this. So don't worry about that. It will takes time depending upon you download speed.

Alternate option is to download model through huggingface website through browser then move the model into models folder -> <model_name> folder.

ArrivedAditya avatar Sep 21 '25 12:09 ArrivedAditya