Qin's repo
Qin's repo
Hi. This project already support LubanCat 4. As the newest addition to the Luban Cat series, Luban Cat 5 supports the RK3588 chip, which theoretically provides better performance than the...
### How are you running AnythingLLM? Docker (local) ### What happened? I found that when using the official API, the think content stops halfway and then waits for a long...
## Basic Test: 1. offline mode: `python3 examples/offline.py --model-path ./models/Llama-3.2-1B`  2. online mode: `python3 examples/online.py --model-path ./models/Llama-3.2-1B`  3. api_server: `python3 swiftllm/server/api_server.py --model-path ./models/Llama-3.2-1B/ --host 0.0.0.0 --port 8082` ...