Brook T.

icon company Zhejiang University icon location Hangzhou, China icon location Mind over matter is magic. I do magic.

Results 2 issues of Brook T.

[BUG] cannot launch server after builting from source

3 comment

i strictly follow the installation docs (https://lightllm-cn.readthedocs.io/en/latest/getting_started/installation.html#installation). and my gpu is a800. error: python -m lightllm.server.api_server --model_dir ~/autodl-pub/models/llama-7b/ INFO 12-24 20:14:05 [cache_tensor_manager.py:17] USE_GPU_TENSOR_CACHE is On ERROR 12-24 20:14:05 [_custom_ops.py:51] vllm...

bug

question about learning this template

@mlbileschi @ludwigschubert @shancarter @colah @arvind Hi, i am new to the distill, and i think it is cool. Actually, i wanna write an interactive introduction to my own acedemic work,...