Eneko Valero Cuenca

icon indicating a website link https://www.lhf.ai/en/home/ icon indicating an email [email protected]

icon company LHFLabs icon location Leuven icon location Senior NLP Data Scientist. Large Language Models and Data Science. Model Compression and Conversational Assistants

Results 2 comments of Eneko Valero Cuenca

ImportError: Using `bitsandbytes` 8-bit quantization requires Accelerate: `pip install accelerate` and the latest version of bitsandbytes: `pip install -i https://pypi.org/simple/ bitsandbytes`

Did you manage to solve the issue?

Cohere Command A model: RuntimeError: Model has multiple modules, must use modules: config syntax to work with slices

Hello, did you solve this? I am getting something similar trying to merge two Qwen3 models: WARNING:mergekit.architecture:No JSON architecture found for Qwen3ForCausalLM WARNING:mergekit.architecture:No JSON architecture found for Qwen3ForCausalLM Fetching 11...