Trapper4888

It may be a problem related to safe tensors and torch shared tensors: https://huggingface.co/docs/safetensors/torch_shared_tensors Because I had a similar error when tying to manually save my model in safetensors using...

> I also got this. on fresh install (today) there was no error, but after I did a db reset, this error popped up. in the supabase console, I can...

I was able to get pass this error by manually setting in `aphrodite/kv_quant/calibrate.py`: ``` LAYER_TYPE_MAP = { 'InternLMForCausalLM': 'InternLMDecoderLayer', 'QWenLMHeadModel': 'QWenBlock', 'Qwen2ForCausalLM': 'Qwen2DecoderLayer', 'BaiChuanForCausalLM': 'DecoderLayer', 'LlamaForCausalLM': 'LlamaDecoderLayer', } NORM_TYPE_MAP =...

> I've seen people running it on Mac. Krita supports it, the plugin generally works, and ComfyUI also has Mac support. > > What may not work is the automated...

To add my 2 cents: Since openwebui has an integrated whisper running (and api possibility), it really feels like a wasted opportunity to not be able to use it directly....

Maybe try to change this: ``` tokenizer = get_chat_template( tokenizer, chat_template = "Qwen2-1.5B", mapping = {"role" : "from", "content" : "value", "user" : "human", "assistant" : "gpt"}, # ShareGPT style...