meherhendi comments

Repositories
Issues
Comments

Results 2 comments of


                                            meherhendi

Using the nomic-ai models from Hugging Face ( 2 .bin files )

You can find the bin files used by gpt4all under this directory in the section of [Manual download of models](https://github.com/nomic-ai/gpt4all/tree/main/gpt4all-chat)

on which folder should i keep my GPT4ALL model files?

When using docker to run Danswer, set this env variables in .env file in deployment/docker_compose/.env: **INTERNAL_MODEL_VERSION=gpt4all-chat-completion** **INTERNAL_MODEL_VERSION=ggml-gpt4all-j-v1.3-groovy.bin** **QA_TIMEOUT=120** (since the CPU is usually slower than GPU and needs more time...