Manickavela

### Describe the feature request Generalized Static Quantizatoin infra, which can handle different model architectures. For models which maintains states and take previous inference output as input (conformer-based), current Calbrationdatareader...

Onnxrt ep config

21

Config files handling for onnxrt provider

Observing some mismatched outputs with sherpa-onnx tensorrt backend with concurrent calls. Or this would be my own internal issue, still debugging, just keeping a note! cc: https://github.com/microsoft/onnxruntime/issues/19275

[Feature] Handling onnxrt execution provider config for various models

2

Hi @csukuangfj, With https://github.com/k2-fsa/sherpa-onnx/pull/992, config for backends are handled as arguments and it is done. But there is an additional issue with arguments and models, as the suggested configs are...

Running seldon-sore in Docker image, but when I do ctrl+c, it is hanging as in the below code : ``` ^C[2024-08-02 14:04:09 +0000] [1] [INFO] Handling signal: int [2024-08-02 14:04:09...

refactor and pybind of OnlineWebsocketServer

6

Hi @csukuangfj , I have refactored the previous implementation, Below code base is functional tested and cleaned up I think you can suggest more for naming for more clarity or...