weibingo

parquet format support

3

Hi @mtth, is there any plan to support parquet data format? parquet data has schema by self . so can read parquet to pandas directly, write is same . python...

when use engine optimum device tensorrt，startup fail

5

### System Info infinity_emb v2 --model_id /home/xxxx/peg_onnx --served-model-name embedding --engine optimum --device tensorrt --batch-size 32 OS: linux model_base PEG nvidia-smi: cuda version 11.8, tensorrt: 8.6.1 ### Information - [ ]...

tensorrtllm have the metric of llm performance , e.g TTFT, latency of token , input token, output token。 if have, please tell me; if not , can add the metric...

opencompass 支持的数据集比较多，但evalscope使用opencompass作为后端，有些数据集却不支持

2

## 问题描述 / Issue Description 请简要描述您遇到的问题。 / Please briefly describe the issue you encountered. ## 使用的工具 / Tools Used - [ ] Native / 原生框架 - [yes ] Opencompass backend...