vit.cpp
vit.cpp copied to clipboard
staghado
Inference Vision Transformer (ViT) in plain C/C++ with ggml
It would be nice if we can try this out on Android. I followed instructions from https://github.com/ggerganov/ggml I tried it and seems that we need to remove `-march=native` from CMakeLists.txt...
converter ```python python convert-pth-to-ggml.py --model_name vit_large_patch14_clip_336.openai --ftype 1 ``` runner ```python ./bin/vit -t 4 -m ../ggml-model-f16.gguf -i ../assets/tench.jpg ```  Any idea?
https://github.com/staghado/vit.cpp/blob/a4841f6eeabb91c917e94b8f8f8d4f9e01043fbc/vit.cpp#L268 This looks like a bug. The very first time when {i,j,k,jj}={0,0,0,0} only C[0] is calculated while C[1], C[2], C[3], C[4] are uninitialized. But later in the code d0, d2,...
Hello, Thank you very much for your great project. I'm trying to replace the multiplication of Q and K in your project with my own matrix multiplication process, but I've...
main.cpp fix Initialize GGML timer before first use to prevent divide‑by‑zero crash on Windows ggml_time_us() divides by timer_freq, which is set in ggml_time_init(). When main() called ggml_time_us() before that initialization,...
