Saeed Najafi comments

Repositories
Issues
Comments

Results 2 comments of


                                            Saeed Najafi

[bug] build is verrrrrrrrrrrrrrrrrrrry slow

Super slow build.

[whisper] static kv cache

Hi, I am getting some cache errors while doing generation with llama3 and fsdp. I am using flash_attention_2, and the use_cache=True in the generate function. Latest transformer from the repo...