dw5189

Results 7 comments of dw5189

Please release a cuda build for v0.3.5

PS E:\llama-cpp-python> conda activate CUDA125-py312 (CUDA125-py312) PS E:\llama-cpp-python> $env:CMAKE_ARGS = "-DGGML_CUDA=ON" (CUDA125-py312) PS E:\llama-cpp-python> python -m pip install build wheel Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple/, http://mirrors.aliyun.com/pypi/simple/ Collecting build Downloading http://mirrors.aliyun.com/pypi/packages/84/c2/80633736cd183ee4a62107413def345f7e6e3c01563dbca1417363cf957e/build-1.2.2.post1-py3-none-any.whl (22...

successfully installed !! CUDA/v12.6 !! Visual Studio 2022!!

> 帅哥，大佬，可以帮忙编译一版cuda12.4.1 python=3.10 ubuntu20.04的0.3.7的预编译文件么。搞了几天了都成功不了，叩谢叩谢 sudo add-apt-repository ppa:deadsnakes/ppa -y sudo apt update sudo apt install -y \ python3.10 \ python3.10-dev \ python3.10-venv \ build-essential \ cmake \ git \ wget \...

successfully installed !! CUDA/v12.6 !! Visual Studio 2022!!

> 帅哥，大佬，可以帮忙编译一版cuda12.4.1 python=3.10 ubuntu20.04的0.3.7的预编译文件么。搞了几天了都成功不了，叩谢叩谢 安装编译依赖 sudo apt update && sudo apt install -y \ python3.10-dev \ build-essential \ cmake \ git \ wget \ libssl-dev \ libopenblas-dev # 加速数学库 #...

CMake build failed //Building wheel for llama-cpp-python (pyproject.toml) ... error

(CUDA124-py312) PS C:\WINDOWS\system32> $env:CUDA_TOOLKIT_ROOT_DIR="C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.4" (CUDA124-py312) PS C:\WINDOWS\system32> $env:CMAKE_GENERATOR_PLATFORM="x64" (CUDA124-py312) PS C:\WINDOWS\system32> $env:FORCE_CMAKE="1" (CUDA124-py312) PS C:\WINDOWS\system32> $env:CMAKE_ARGS="-DGGML_CUDA=ON -DCMAKE_CUDA_ARCHITECTURES=89" (CUDA124-py312) PS C:\WINDOWS\system32> pip install llama-cpp-python --no-cache-dir --force-reinstall --upgrade...

CMake build failed //Building wheel for llama-cpp-python (pyproject.toml) ... error

G:\>conda.bat activate CUDA124-py312 ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ggml_cuda_init: found 1 CUDA devices: Device 0: NVIDIA GeForce RTX 4070 SUPER, compute capability 8.9, VMM: yes llama_model_load_from_file_impl: using device CUDA0...

ERROR: Failed building wheel for llama-cpp-python Failed to build llama-cpp-python ERROR: Could not build wheels for llama-cpp-python which use PEP 517 and cannot be installed directly

I've just successfully installed it! Here's the information for your reference. PowerShell ： $env:CUDA_TOOLKIT_ROOT_DIR="C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.6" $env:CMAKE_GENERATOR_PLATFORM="x64" $env:FORCE_CMAKE="1" $env:CMAKE_ARGS="-DGGML_CUDA=ON -DCMAKE_CUDA_ARCHITECTURES=89" pip install llama-cpp-python --no-cache-dir --force-reinstall --upgrade ********************************************************************** **...

ERROR: Failed building wheel for llama-cpp-python Failed to build llama-cpp-python ERROR: Could not build wheels for llama-cpp-python which use PEP 517 and cannot be installed directly

类似这样做： "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6\extras\visual_studio_integration\MSBuildExtensions\CUDA 12.6.props" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6\extras\visual_studio_integration\MSBuildExtensions\CUDA 12.6.targets" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6\extras\visual_studio_integration\MSBuildExtensions\CUDA 12.6.xml" "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6\extras\visual_studio_integration\MSBuildExtensions\Nvda.Build.CudaTasks.v12.6.dll" cory to : "C:\Program Files\Microsoft Visual...