Grégory Salvan

hi, also, exceptions syntax has changed in python3. this: except Exception, e: must be replaced by: except Exception as e: 2013/11/2 Daniel Ward [email protected] > Right ok, so this is...

Hi, I've quantized llama-3-8B-Instruct in Q4_K_M to try your app: https://huggingface.co/squaredlogics/Llama-3-8B-Instruct-Q4_K_M.gguf tried also capybarahermes-2.5-mistral7b from thebloch... It works perfectly with llama.cpp on my computer but gives random answers in your...