microsoft
[Feature Request] EP context cache options don't seem to work with onnxruntime perf test
Describe the feature request
Using session options in c++/python i am able to use Ep context options. I tried the same using onnxruntime_perf_test but the app doesn't seem to honor these
./bin/onnxruntime_perf_test.exe -C "ep.context_enable|1 ep.context_file_path|C:/Users/nithink/IPU/w24/0805/1713/onnx-rt/out_cache/out_cache_psq1.onnx" -e vitisai -m duration -t 10 -I R:/ipu_regr/msft_models/win24_shell/shell_models_for_June_15_drop/shell/PSO0/Model-PSO0-QDQ-v1_0_1/Model-PSO0-QDQ-v1_0_1_A/b512-SyncBN-x4_rpn_batch_qdq_quant_A.onnx
-C is the session option as per documentation, when i use this i expect it to generate cached context file which is not happening
Describe scenario use case
Compatibility with onnxruntime_perf_test so that it's easy to use by anyone
It should work. Maybe it's a VitisAI Ep specific issue. I believe it works for some other EP's. will check with the VitisAI EP maintainers.
@Nithingx this issue has been fix at: https://github.com/microsoft/onnxruntime/commit/3ff8ca29e50e6b71d773f31e4796d4c11e84f299#diff-3f1317b7519d8237a64d22ef15968f5a80cf1bc3f9f324e173a08ad459e427c3 at VitisAIExecutionProvider::GetEpContextNodes()
