Necolizer comments

Repositories
Issues
Comments

Results 5 comments of


                                            Necolizer

when text prompt is long, prompt is cut off?

Same issue for me. Using descriptions like `object in hand` would get both `object` and `hand` results. Despite this limitation, this work is great and easy-to-implement. Thanks to the authors'...

[Bug]: When using the latest 0.6.3, No module named 'vllm._version' appears

RuntimeError: batch size must be positive in flash_attn_varlen_forward when use_remove_padding=True

I set all mini/micro batch size < train/test batch size. It solves this `batch size must be positive` problem in my project.

RuntimeError: batch size must be positive in flash_attn_varlen_forward when use_remove_padding=True

> I set all mini/micro batch size < train/test batch size. It solves this `batch size must be positive` problem in my project. This may not be the solution. Sorry...

ray.exceptions.ActorDiedError: The actor died unexpectedly before finishing this task.

Same problem. Any progress?