BitNet

BitNet copied to clipboard

direct cpp compilation on aarch64-ostl-linux-gcc failed

5

tried to compile the routines unsuccefully would you please hlp ? (bitnet-cpp) triumph@triumph-HP-Z6-G5-Workstation-Desktop-PC:~/github/BitNet/src$ $CC aarch64-ostl-linux-gcc: fatal error: no input files bitnet-cpp) triumph@triumph-HP-Z6-G5-Workstation-Desktop-PC:~/github/BitNet/src$ $CC ggml-bitnet-mad.cpp ggml-bitnet-lut.cpp -I ../include -I ../3rdparty/llama.cpp/ggml/include/ -I...

danilopau

Question. why cmake just use one core to compile, its so slow ?

1

I ran this command, found its very slow, just use one core to compile the project. python setup_env.py -md models/Llama3-8B-1.58-100B-tokens -q i2_s then i changed the code in setup_env.py as...

YouUpDay

Minor Read Me Mistake?

1

Unless you did this on purpose, in your example you write: Daniel went back to the the the garden Did you purposely write three the's in a row or was...

DataJuggler

Hi folks! First of all, congrats on this fantastic research result! I managed to run Llama3-8B-1.58-100B-tokens on a relatively small Amazon EC2 instance. **Instance Family:** c6g (ARM) **Instance Size:** xlarge...

giusedroid

Real-Time BitNet LLM Response on a Web Interface with Node.js and Socket.io

3

A web interface designed for submitting queries and viewing real-time responses through a user-friendly UI. Built with Node.js for the frontend and a Python Socket server for backend processing, the...

stackblogger

The codegen for TL2 was a bit difficult to reason about since the C++ code was directly embedded as a Python string. With this PR, I've added a simple Jinja2...

JCGoran

Extremely slow

3

Extremely slow in CPU mode

seghier

Install/build process should check and assert the requirements (e.g. clang compiler versions)

6

The readme states some requirements about python, cmake and clang version. Currently the install/build process does not check if the clang version requirement is satisfied and ubuntu e.g. come with...

bmerkle

Failed at `setup_env.py` gitstatus_query_p9k_

4

Hi! I'm using: - Ubuntu 24.04 - clang version 18.1.8 - python 3.9.19 with pyenv (2.4.1) - cmake 3.28.3 When I execute the command after downloading the model from Hugging...

joseph-pq

Add Jupyter notebook example for Bitnet.cpp

1

Set by step process to run inferencing using Bitnet in a Jupyter Notebook environment.

swaroski