Dhruvil Patel

icon location Zen in the art of code

Results 5 comments of Dhruvil Patel

[Feature]: bitsandbytes support

+1

[BUG] after funetine, model inference is None / empty

did anyone find the solution to this?

[BUG] after funetine, model inference is None / empty

> 我这边也遇到了这个问题 确认下训练后保存的tokenizer_config.json，"chat_template"是否和原始模型一致（末尾要拼上'assistant\n\n） This is the actual problem i think. because the finetune config doesn't have 'assistant\n\n）at the end. adding it manually atleast solves the empty response problem. Would be...

[feat]: a `shadcn@latest reset` command to re-install components

yep. really need this feature

[Bug]: When using the VLLM framework to load visual models, CPU memory overflow occurs while continuously processing data with images.

hey @aswad546 were you able to solve this issue? I am currently facing the very same issue..