zcxo

./bin/main_qwen_npu fail

2

你好！ 请教如下问题如何解决： 执行如下命令失败： phone:/data/local/tmp/mllm/bin # ls -l ../qnn-lib/ total 42968 -rwxrwxrwx 1 root root 1561544 2024-08-23 16:52 libQnnHtp.so -rwxrwxrwx 1 root root 624648 2024-08-23 16:52 libQnnHtpOptraceProfilingReader.so -rwxrwxrwx 1 root root...

merged "0001-Use-KleidiAI-Int4-Matmul-micro-kernels-in-llama.cpp.patch" to latest llama.cpp FAIL

3

Dear ARM-software : I am excited and pleasantly surprised to see that ARM has officially launched the KleidiAI solution for inference! I have tried this solution and it has indeed...