Deepak Kakadia

cuBLAS fails on same model - terminate called after throwing an instance of 'std::runtime_error' what(): unexpectedly reached end of file

5

Hello, I tried to see if anyone else had this issue but closest was #1596 and seems different in my situation. Crashes only for GPU cuBLAS ========================= 1. make LLAMA_CUBLAS=1...

Hi ggml experts I am trying to get this to work on a public cloud VM GPU in a docker container. I am having issues with the CUDA driver. I...

metadata_base.PrimitiveFamily.ANOMALY_DETECTION - MISSING PRIMITIVE ANOMALY_DETECTION

3

I am wondering why metadata_base.PrimitiveFamily is missing ANOMALY_DETECTION ? I did python setup.py build and install, as per README. Any hints or clues greatly appreciated. I tried to run the...

torch-disable-jit=yes but nuitka still looks for jit and fails - secure_build/server.dist/torch/lib/../../libcusparse.so.12: undefined symbol: __nvJitLinkComplete_12_4, version libnvJitLink.so.12

1

## 🐛 Bug Description It turns out that even with JIT turned off, Nuitka will still pull in all of PyTorch’s CUDA‐side libraries (libcusparse, libnvJitLink, libcudnn, etc.) into my standalone...