BitNet

BitNet copied to clipboard

Results about others supported 1-bit models ?

2

Do you test the others 1-bit models from Hugginface ? bitnet_b1_58-large bitnet_b1_58-3B Llama3-8B-1.58-100B-tokens Falcon3 Family | 1B-10B What are the results in inference ? I personnaly use Falcon3-10B-Instruct-1.58bit.gguf and results...

lbarasc

need .exe

2

need .exe

windkwbs

Inconsistent capitalization for BitnetForCausalLM caused error in /utils/convert-hf-to-gguf-bitnet.py

4

Caused #178 most likely Code was looking for `BitNetForCausalLM`, name in `convert-hf-to-gguf-bitnet.py` was: https://github.com/microsoft/BitNet/blob/fd9f1d6e46b476d449417d49851f50a569165835/utils/convert-hf-to-gguf-bitnet.py#L952 `BitNetForCausalLM` vs. `BitnetForCausalLM`

qjtdsqqm94akkyysgjdqo3hx1jn6l17

`include/bitnet-lut-kernels.h` missing from repository, build fails

2

I've been following gpt4.1 instructions to build BitNet from source, but I'm unable to proceed because `include/bitnet-lut-kernels.h` is missing from both the main repository and my local clone. The build...

snake-speak

https://github.com/werruww/bitnet-run-good/blob/main/Untitled225%20(2).ipynb

werruww

Does it support distributed inference? I want to deploy large models on an XPU cluster. like cpu cluster

3

Does it support distributed inference? I want to deploy large models on an XPU cluster. like cpu cluster

kotaking

Fix chrono template

3

Fix: chrono-template and llama.cpp to run 1bit llm in Win11

frankyemm

Model only outputs G repeatedly in interactive mode with ggml-model-i2_s.gguf

9

When I run `run_inference.py` in interactive mode using the provided `ggml-model-i2_s.gguf` from Hugging Face, the model only outputs the character `G` in a loop, no matter what prompt I use....

ksic180586

Building on Windows11 Failed with missing ClangCL

1

When I build by executing `python setup_env.py -md models/BitNet-b1.58-2B-4T -q i2_s`: > Project "E:\Bitnet\BitNet\build\CMakeFiles\4.0.0-rc2\VCTargetsPath.vcxproj" on node 1 (default targets). > C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\MSBuild\Microsoft\VC\v170\Microsoft.CppBuild.targets(456,5): error MSB8020: The build tools...

RealHacker

ERROR: Could not open requirements file: [Errno 2] No such file or directory: '3rdparty/llama.cpp/requirements/requirements-convert_legacy_llama.txt

4

Hi I get the below error 

anunay1