llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

My develoopment fork of llama.cpp. For now working on RK3588 NPU backend

Results 2 llama.cpp issues
Sort by recently updated
recently updated
newest added

almost-ish working RoPE support. There is one problem with this: ``` src0: (64,16,2,1) src1: (2,1,1,1) out: (64,16,2,1) Shape([1, 1, 2, 64]) pre rope ttnn Always | FATAL | Mismatched tensor...

ggml