Benjamin Wegener
Benjamin Wegener
@microsoft-github-policy-service agree
@microsoft-github-policy-service agree
got the same Error building on android. try that: ``` rm -rf build && mkdir build && cd build CC=clang CXX=clang++ cmake .. make ```
https://github.com/Benjamin-Wegener/BitNet/commit/561bbf12a268e3f5a6437a418748d6c044ba70fa its not tested so far, will comment if successful
then close the issue please 😊
https://github.com/microsoft/BitNet/pull/242
A new GGML_OP (GGML_OP_BITNET_MUL_MAT) was added in ggml.h. Every tensor in llama.cpp has an op field; when the graph is built, any weight matrix that is BitNet-quantized (type GGML_TYPE_Q2_0, Q3_0,...
https://github.com/microsoft/BitNet/issues/240
https://github.com/Blinue/Magpie/pull/1108
do you know what the last working commit was? and do you have specific information about the freezing issue? --- UPDATE: tested with qwen2.5-1.5b-instruct-q2 (downloaded with maid, compiled from source),...