Bodhi
Bodhi
Just another PR to fix the decoding crash issue, and also updated gradle & android sdk to its latest
:notes:
# Description Hello, This PR makes a simple change to remove the `COPY` instruction in the `.devcontainer/Dockerfile` file. It will copy the source files to `/` root, which seems unnecessary...
Hi, This PR fixes a minor mismatch of curDot and dots. Thanks : )
## ๐ Bug Hello, `HF://mlc-ai/Qwen1.5-1.8B-Chat-q4f16_1-MLC` seems to be incomplete: missing `max_batch_size` in `mlc-chat-config.json`; no tokenizers found under `Qwen1.5-1.8B-Chat-q4f16_1-MLC/` And above two missings will cause `mlc_llm chat ...` throw errors. ##...
This PR will: 1. support MUSA ARM64 target; 1. enable `dp4a` on MUSA; **Build:** ``` # we recommend using the `clang` compiler from musa sdk for both CPU & GPU:...