Adam Louly
Adam Louly
Thanks for the review
You can bypass this error by enabling long path name: `Set-ItemProperty -Path 'HKLM:\SYSTEM\CurrentControlSet\Control\FileSystem' -Name LongPathsEnabled -Type DWord -Value 1 ` However, you'll still bump into other issues since ORTModule does...
> FA3 is a beta release, you'd need to call a different interface to use it (for now). https://github.com/Dao-AILab/flash-attention/blob/main/hopper/flash_attn_interface.py > > As we roll it out (e.g. after v3.0.0 tag)...
Hey, I've had the same issue and I figured it out, make sure you install fa3 by: ```python git clone https://github.com/Dao-AILab/flash-attention/ cd hopper python setup.py install ``` then to import...