l31bn1tz

Hi guys, I have successfully trained a classifier with attention with context mecanism, but i 'm struggling with the way to call the function get_attention_tensor . Do you have any...

How can i update to vLLM v0.4.1 for llama3 support ?

5

Hello everyone, I would like to update the vLLM version to v0.4.1 in order to get access to LLAMA3 but i don't know how modify the fork runpod/vllm-fork-for-sls-worker. Could you...

Requesting a pod for cpu via python sdk seems not possible

5

**Describe the bug** When I want to create a only cpu pod, it's needed to choose a gpu_type_id but when i test all the gpu_type_id with gpu_count=0 , I have...

Bug with save VMU

1

Hi, thanks for the project, it's awesome. I intend to use it in order to have access to a vmu to save games. The device is recognized but when i...

Ablation Study Compression

1

Hi , first great work for the paper ! I had a question about the section E.2 of the appendix. Did you try to only use the pre-fusion mechanism (as...