vdonchev

Hello, Using Cengal 4.4.0, tested with python 3.11 and 3.10: Following the shared_objects__example__sender.py, I am doing this: ``` sso: dict = {"block_1": "TEST"} # Create shared memory manager memory =...

Loading model with transformers / converting weights to GGUF

1

Hi, For the 7B weights of 2.5 VL we were able to successfully convert the language and vision parts to GGUF: https://huggingface.co/IAILabs/Qwen2.5-VL-7b-Instruct-GGUF Everything is functioning as expected there. With the...

gguf-py: Support for Qwen2.5 VL - DRAFT (#11483)

1

I've been trying to get the surgery working reliably for a few days, but without luck. The vision model produced by the latest version of the script (as of this...