Fergus
Results
2
issues of
Fergus
The following dockerfile should successfully install flashinfer, but the build fails ```Dockerfile FROM pytorch/pytorch:2.4.0-cuda12.4-cudnn9-devel ENV TORCH_CUDA_ARCH_LIST="8.0 8.6 8.9 9.0a" RUN apt update && apt install -y git RUN pip install...
When installing from PyPI, the functions `apply_rope_pos_ids_cos_sin_cache` and `apply_rope_pos_ids_cos_sin_cache_inplace` don't seem to be available. They do work when installing from source, both with with AOT or JIT compilation. To reproduce:...