BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard
Published 8 months ago • verified publisher icon microsoft

Only getting "G"

Open Zuzupy opened this issue 9 months ago • 5 comments

I setup the Conda environment and even reinstalled the model but all I get is "G" as an output?

Image

Zuzupy avatar May 01 '25 05:05 Zuzupy

Intresting, I've never seen that. What device are you working with ?

Simar-malhotra09 avatar May 02 '25 18:05 Simar-malhotra09

Intresting, I've never seen that. What device are you working with ?

Arch Linux/Zen kernal, no supported GPU (not that I think it works with one yet?) My CPU is an i5-2400

Do you need any other information?

Zuzupy avatar May 03 '25 05:05 Zuzupy

I am also facing this issue in my ubuntu system, cpu i5 11 gen

rishh09 avatar May 05 '25 13:05 rishh09

Facing the same issue on a Debian 12.10 system (very old hp pavilion laptop, intel dual-core cpu, 4Gb ram ddr2, just testing how low-specs we can go).

I am attaching a script I used for setup.

linux-setup.sh.txt

P.S: I am not able to reproduce it on Debian under WSL on a modern system

yoisel avatar May 13 '25 00:05 yoisel

It seems that the CPU should support avx2 instructions. My PC is I5-3570, which does not support avx2. I installed it several times and had the same problem. I created the corresponding docker image and installed it on my office's I5-10500, but GGGG was output in the same way. I recompiled bitnet.cpp and it worked fine. Note that lm studio will not work if avx2 is not supported either.

OIOST avatar May 18 '25 07:05 OIOST