Adam Ning

Is this stable?

3

The c version release final version in 2022.4, any code sync from the original c version?

async-std for example

Improve streaming interface

5

We use actix-web to handle some large file download, currently ResponseBuilder can only provide streaming() interface which requires user to implment future::stream::Stream interface. (https://docs.rs/actix-web/3.0.2/actix_web/dev/struct.HttpResponseBuilder.html#method.streaming) I think a trait simular to...

when syncing note with large picture, resource_ttype.data.body will be None, need to get download full resource with getResource() traceback: ``` 2015-07-23 23:31:08,608 - everpad-provider - DEBUG - Pulling note "美元指数"...

add some traceback in provider log (.everpad/logs/everpad-provider.log) to help bug fix ``` 2015-07-23 23:31:08,608 - everpad-provider - DEBUG - Pulling note "美元指数" from remote server. 2015-07-23 23:31:11,280 - everpad-provider -...

adding a working search provider for gnome-shell. Test is done on ubuntu 14.10 with gnome 3.14. sudo python setup.py install will not install "data_files" to /usr so have to copy...

Implement model.llm.memory.estimate_llm_gpu_memory which output model_mem, kv_cache, overhead, active_mem. * Download config.json from huggingface/modelscope and load model layers info * support kv_cache_dtype 8/16/32 (gpu_poor might only calculate fp32) Algorithm refer to...

### Describe the bug When access restful api with wrong model_uid, and error raise enough of times （benchmark with > 100 concurrence）, will lead to completely dead lock on server....

### Describe the bug A clear and concise description of what the bug is. ### To Reproduce To help us to reproduce this bug, please provide information below: 1. Your...

ENH: Display model name in process

2

在进程名中显示模型的名字，方便管理调试. 顺带提交一些日志优化 1. Retry 3 times to load model when CUDA busy error, the error can be encountered on AWS instance which is just launched. 2. ModelActor.repr ( add replica_model_uid...