BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard

Can this be built to work from a Windows 10 Enviornment?

Open goNextIdeas opened this issue 9 months ago • 4 comments

I have spent several days trying to get this to work. I have tried everything under the sun and no matter what it just does not work. At the end even when everything builds properly with no errors, it responds by GGGGG or @@@@@@

What am I missing here? Has anybody been able to get this to work on a windows system?

goNextIdeas avatar May 19 '25 19:05 goNextIdeas

can you provide more details? it should be ok to work on windows

sd983527 avatar May 20 '25 02:05 sd983527

I have succesfully built it and you can too! Just ask Chatgpt

xennon-sudo avatar Jun 23 '25 08:06 xennon-sudo

I have succesfully built it and you can too! Just ask Chatgpt

Can you please provide the fix that chatgpt gave to you?

Abdalnablse10 avatar Jun 23 '25 10:06 Abdalnablse10

  ENV DEBIAN_FRONTEND=noninteractive  

Update & install system dependencies

RUN apt-get update && apt-get install -y
wget
curl
git
cmake
build-essential
python3
python3-pip
python-is-python3
ca-certificates
&& rm -rf /var/lib/apt/lists/*  

Install LLVM

NOTE: Uncomment this if you actually want to install LLVM.

RUN bash -c "$(wget -O - https://apt.llvm.org/llvm.sh)"

 

Clone BitNet

RUN git clone --recursive https://github.com/microsoft/BitNet.git  

Copy everything from the local directory (where Dockerfile is) into the BitNet directory in the container

COPY . /BitNet   WORKDIR /BitNet  

Install Python dependencies

RUN pip install --upgrade pip &&
pip install -r requirements.txt  

Hugging Face CLI setup

RUN pip install huggingface_hub  

Optional: HF token

ARG HF_TOKEN RUN huggingface-cli login --token $HF_TOKEN || true  

Download the model into ./models/

RUN huggingface-cli download tiiuae/Falcon3-7B-Instruct-1.58bit-GGUF --local-dir models/  

Run BitNet preprocessing script

RUN python utils/codegen_tl1.py --model bitnet_b1_58-3B --BM 160,320,320 --BK 64,128,64 --bm 32,64,32  

Build the project

RUN mkdir -p build && cd build && cmake .. && make -j$(nproc)  

Default command

CMD ["python", "app.py"]

xennon-sudo avatar Jul 07 '25 11:07 xennon-sudo