LGBG

{"error":"Content-Type header [application/vnd.elasticsearch+json; compatible-with=8] is not supported","status":406}

1

### Java API client version elasticsearch-java: 8.10.0 ### Java version java: 11 ### Elasticsearch Version Elasticsearch: 7.10.2 ### Problem description When I execute the following code： ``` public static void...

部署AutoGPTQ量化后的Qwen-7B-Chat-Int4，报错RuntimeError: "addmm_impl_cpu_" not implemented for 'Half'

1

## 运行日志 warning: import flash_attn rotary fail, please install FlashAttention rotary to get higher efficiency https://github.com/Dao-AILab/flash-attention/tree/main/csrc/rotary Warning: import flash_attn rms_norm fail, please install FlashAttention layer_norm to get higher efficiency https://github.com/Dao-AILab/flash-attention/tree/main/csrc/layer_norm...

量化后的ChatGlm3-6B使用open_api部署tools功能无法使用

2

- 现象： 使用open_api部署后，测试tools功能，请求体如下 ``` { "functions": { "random_number_generator": { "name": "random_number_generator", "description": "Generates a random number x, s.t. range[0]