SDGym icon indicating copy to clipboard operation
SDGym copied to clipboard

Update summary metrics

Open katxiao opened this issue 4 years ago • 0 comments

Problem Description

Current, the summary metrics from the sdgym summary command are % coverage, avg time, avg score. We can update them to be more informative about the synthesizers' comparative performance and accuracy.

Expected behavior

Performance (time) metrics: One idea is to use a leaderboard approach. We can display how many times a given synthesizer had the best relative modeling time.

Quality metrics: TBD

katxiao avatar Jan 26 '22 19:01 katxiao