BitNet

BitNet copied to clipboard

Thank you for the excellent work! Are there any plans for multimodal support (i.e. images)?

abrichr

Guidance on how to generate something useful

1

Thank you for sharing the model and how to install everything. Worked flawlessly! 🚀 I was wondering if you could provide more guidance on prompts. Prompts that work well with...

alanderex

``` $ sudo bash -c "$(wget -O - https://apt.llvm.org/llvm.sh)" --2024-10-18 10:42:38-- https://apt.llvm.org/llvm.sh Resolving apt.llvm.org (apt.llvm.org)... 199.232.198.49, 199.232.194.49, 2a04:4e42:4c::561, ... Connecting to apt.llvm.org (apt.llvm.org)|199.232.198.49|:443... connected. HTTP request sent, awaiting response... 200...

rebroad

The current revision bf11a49 fails to build: Cannot find source file: ../../../../include/bitnet-lut-kernels.h

6

``` CMake Error at 3rdparty/llama.cpp/ggml/src/CMakeLists.txt:1324 (add_library): Cannot find source file: ../../../../include/bitnet-lut-kernels.h Tried extensions .c .C .c++ .cc .cpp .cxx .cu .mpp .m .M .mm .ixx .cppm .ccm .cxxm .c++m .h...

yurivict

Make the coverage table more readable with both dark and light theme

1

lfoppiano

How to install on Mac?

3

Could the Linux installation be followed for Mac usage?

anu43

Model conversion from HF to GGUF crashes due to lack of memory

3

This was for the 8B param model in the instructions - quickly ran through the 32GB RAM on my Linux PC. Is there someplace that pre-converted GGUF versions of these...

philtomson

Add Metal support for I2_S

1

This PR supports both prefilling and decoding function for I2_S

Eddie-Wang1120

How to set the EOS Token?

1

I didn't see the specified location for the EOS Token. Could you please tell me how to set the number of tokens in the output field? If it's too long,...

lxmliu2002

I found that the output gguf models are not in `chat mode` already? Isn't it? I want to build an agent framework with BitNet,but the model is limited. : (

ElinLiu0