Hololite

Typo above. Should use the FileIO.ReadText API to read the file.

Ok I have added /usr/local/cuda/targets/x86_64-linux/lib/stubs to my LD_LIBRARY_PATH, and confirmed the libcuda.so exists under that dir. However I am still getting into error, like this: $ RUST_BACKTRACE=full cargo run --example...

@coreylowman @LaurentMazare Per @coreylowman's suggestions, I have checked my system, it appears that there are 2 locations in my WSL ubuntu that have the libcuda.so: $ find /usr -name libcuda.so...

I also have issue running this on ec2 instance with A10. The error is different though, it's related to building cudarc: $ RUST_BACKTRACE=1 cargo run --example quantized --release --features cuda...

On Windows's WSL Ubuntu/linux, this problem still persists. Adding the dir containing the libcuda.so to the LD_LIBRARY_PATH did not help. I have 2 different laptops with WSL/Ubuntu having similar problems....

> I think [coreylowman/cudarc#240](https://github.com/coreylowman/cudarc/pull/240) may fix this? Yes, I just tested the most recent changes. It worked now!

This is finally fixed in recent commit.

Which OS are you on? Sent from Outlook for Android ________________________________ From: Preslav Aleksandrov ***@***.***> Sent: Friday, May 31, 2024 6:10:23 AM To: huggingface/candle ***@***.***> Cc: Hololite ***@***.***>; Mention ***@***.***>...

Actually I was incorrect in saying this was fixed. Yes it still is there. What I found are the following: (all running ubuntu 22) - On the A100 gpu, this...