quic-zhanweiw

Results 6 comments of quic-zhanweiw

Performance decreated between tag b1500 and b2581 on Windows ARM64 PC

@ReinForce-II It seems the performance issue is due to the function 'ggml_compute_forward()' was called twice in function 'ggml_graph_compute_thread()'. It was just called once in previous code. May we avoid this?...

Performance decreated between tag b1500 and b2581 on Windows ARM64 PC

Thanks @ReinForce-II for your update! In the latest Llama.cpp code, after add the patch below, the performance issue disappeared. May you help check the reason? ``` diff --git a/ggml.c b/ggml.c...

suppress=True will cause a 1-second delay when pressing Ctrl, ALT, and other keys separately, such as running the ALT key in games

Are there any solution for this issue?

Chat session in Playground does not refresh.

I met the same issue with langflow 1.2.0, but langflow 1.1.1 doesn't have this issue.

在Windows ARM64设备上跑"llm_demo.exe", 在推理时CPU频率维持在40%左右。

即使设置成20个线程，也是一样的结果。

Support ARM64EC on Windows

I can compile openssl v3.4.0 to ARM64EC successfully with the configuration 'no-asm'. But I think it will impact the openssl performance obviously. Hope can support ARM64EC officially with assembly code...