Annamalai Lakshmanan

icon location Zurich, Switzerland icon location MSc Electrical Engineering and Information Technology Student, ETH Zurich

Results 1 comments of Annamalai Lakshmanan

Problems with the installation of flash_attn with pytorch 2.8.0+cu128

For me this works, I used docker image `pytorch/pytorch:2.8.0-cuda12.8-cudnn9-devel` from dockerhub and built my container to use it in different GPUs including RTX 5090. Maybe this helps ` ENV TORCH_CUDA_ARCH_LIST="8.0;8.6;8.9;9.0;12.0+PTX"...