1E04 comments

Repositories
Issues
Comments

Results 4 comments of


                                            1E04

used python 3.7.15 but still having problems installing requirements.txt

I have the same issue with `\\home\\mef\\Documents\\plate_detection_project\\best.pt` but the directory didn't change if i change it in `helper/params.py.` Any further information, where i have to setup the model?

bug: 40GB is not enough for llama-2-7b

I have the same issue on an A100 80GB. If I used `--backend vllm` the usage of VRAM goes up at first to 15GB then after seconds to 70GB. I...

python inference code not different from "normal" whipser?

I also had the same thoughts about this, and I think you are right, the Flash Attention mechanism and the use of float16 or bfloat16 with transformers is the magic...

is_flash_attn_2_available() returns False

Hello, 1. SDPA wasn't slower for short audio files in my benchmarking tests, then flash attention. SDPA otherwise supports word-level timestamps. 2. The implementation of the code seems right to...