vscode-ai-toolkit Export comparison of agent versions

It would be a nice feature to export a comparison of agent versions. For example if you have 100 rows in a bulk run when comparing two agents, with an export you can easily build a heatmap or calculate agent model version accuracy from the data identify differences, etc...

Oct 23 '25 20:10 mafudge

Hey @mafudge Can you elaborate bit on the request here, what do you expect to see in the comparison? In AI Toolkit we have a comparison feature: https://code.visualstudio.com/docs/intelligentapps/evaluation#_compare-evaluation-results-between-versions

Do you expect an export of that comparison results or something else?

Oct 29 '25 07:10 MuyangAmigo

Export the comparison data for further analysis

Oct 29 '25 12:10 mafudge

@mafudge Thanks! I'm adding this to backlog

Nov 04 '25 07:11 MuyangAmigo