GentleYo

OK, I follow 19f9618 and change the code, .vsdb is generated, then has a 'Segmentation fault' as follow: cmd: ./build/bin/main --embedding_model ./models/bce-embedding/bce_emb_q8.bin --init_vs ./fruits.dat log: ingesting... 2 / 3 done...

Follow your step, the error is solved, and log is: ' .... No LLM is loaded. Augmented by BCE-Embedding (0.2B) and BCE-ReRanker (0.2B). You > hello A.I. > {"file": "2.txt"}...

By the way, if want to compile the .so or .dll for rag chat.cpp function, how to change the cmake file for this project, this part of compiling will be...

ok, I'm trying now, and if i want to offload the ModelObject memory (such as: embedding, rerank), what should be coded for it?