Yida Liu
Yida Liu
Not able to build with my Rpi 4 4GB running ubuntu 22.10 ``` I llama.cpp build info: I UNAME_S: Linux I UNAME_P: aarch64 I UNAME_M: aarch64 I CFLAGS: -I. -O3...
I trie to run `convert-pth-to-ggml.py` script on my Pi and found it always OOM. But running in Mac seems okay. ``` # convert the 7B model to ggml FP16 format...
@octoshrimpy What I did 1. Run convert ggml to get the f16 model weights on Mac 2. Copy the f16 model weights to Pi 3. quantize on Pi