david-vectorflow

Results 7 comments of david-vectorflow

[LLaVa-v1.6] Difference between slow and fast tokenizer for liuhaotian/llava-v1.6-34b

Does this mean that the faster tokenizer should be working? If I run this code below, it confirms that its the fast one but then it throws a warning that...

[Usage] Batch inference with Llava 1.5

In case anyone else finds this, here is a sample of working batch inference code based on the link above ```python prompt_temp = "system\nAnswer the questions.user\n\n{}assistant\n" prompts=[] images = []...

Add integration to salesforce

@asadnhasan are you still planning on working on this?

Swap Flask API for FastAPI

Any update?

vLLM import error

Attempting to downgrade to vllm 0.3.3 causing the installation of the most recent version of sglang to hang indefinitely

Import Errors occurring even when dependencies are installed

Thanks! Looks like it still isn't solved though?

Image Size

Does it maintain the aspect ratio when it coverts?