CementZhang
Results
2
comments of
CementZhang
To compile the server: - first set build server flag ```bash cmake -S . -B build -DLLAMA_BUILD_SERVER=ON ``` - then reset setup_env ```bash python setup_env.py -md models/BitNet-b1.58-2B-4T -q i2_s ```...
To compile the server: - first set build server flag ```bash cmake -S . -B build -DLLAMA_BUILD_SERVER=ON ``` - then reset setup_env ```bash python setup_env.py -md models/BitNet-b1.58-2B-4T -q i2_s ```...