matthost

Can we use the `compile` are for inference, e.g. using `DetInferencer`? Would also like to be able to cache compiled models to avoid re-compilation.

[Bug] Python SDK Batch Inference not working?

5

### Checklist - [ ] I have searched related issues but cannot get the expected help. - [ ] 2. I have read the [FAQ documentation](https://github.com/open-mmlab/mmdeploy/tree/main/docs/en/faq.md) but cannot get the...

[Bug] C++ SDK batch inference not working?

1

### Checklist - [X] I have searched related issues but cannot get the expected help. - [X] 2. I have read the [FAQ documentation](https://github.com/open-mmlab/mmdeploy/tree/main/docs/en/faq.md) but cannot get the expected help....