llama-cpp-python icon indicating copy to clipboard operation
llama-cpp-python copied to clipboard
verified publisher icon abetlen

Request to publish CUDA builds for v0.3.2 to GitHub Releases

Open lsorber opened this issue 1 year ago • 3 comments

Could you kindly trigger the CUDA build for v0.3.2 and publish them to GitHub Releases? Thank you 🙏!

lsorber avatar Dec 05 '24 21:12 lsorber

0.3.4 is here :) https://abetlen.github.io/llama-cpp-python/whl/cu124/llama-cpp-python/

pabl-o-ce avatar Dec 09 '24 16:12 pabl-o-ce

0.3.5 never finished two days back... :disappointed: only metal built. https://github.com/abetlen/llama-cpp-python/actions/runs/12246721234

(0.3.4 needed the patch from #1858 )

fat-tire avatar Dec 11 '24 21:12 fat-tire

I want a version that supports DeepSeek!

John6666cat avatar Feb 06 '25 16:02 John6666cat