Brad Murray
Brad Murray
Additionally, avoid largev3. If the language you are using works well with a smaller model, try it.
> @bradmurray-dt can you please elaborate on why to avoid largev3 in context of avoiding hallucinations? I have ran quite a few tests and noticed significantly higher hallucinations with large...
Adding comment to prevent this issue from closing.
From a quick glance, it looks like you're closing the model after the first request. You should be reusing the model (thread safe) but each context can only be used...