ehalit
ehalit
I downloaded the Falcon 7B instruction fine-tuned model from [https://huggingface.co/tiiuae/falcon-7b-instruct](https://huggingface.co/tiiuae/falcon-7b-instruct) and saved it under `ggllm.cpp/models/falcon7b_instruct` with ```# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("tiiuae/falcon-7b-instruct", trust_remote_code=True) model.save_pretrained("ggllm.cpp/models/falcon7b_instruct") ```...
If I modify stopwords with -S, the application quits after the stopwords are generated by the model, rather than returning control to the user. Edit: I guess I found the...
I tried downgrading pydantic all the way down to 1.8 but the error still persists.