inference icon indicating copy to clipboard operation
inference copied to clipboard
verified publisher icon mlcommons

Submission checker results for SingleStream using 97-percentile results instead of 90-percentile results

Open nvzhihanj opened this issue 1 year ago • 1 comments

@pgmpablo157321 One of our submission results for singlestream was having wrong result showing in the final table. It should be showing 90-perc latency, but actually showing 97-perc latency. image image

nvzhihanj avatar Jul 26 '24 00:07 nvzhihanj

@nvzhihanj Its an unexpected error. Is it happening for all the models? Also we have early stopping result right?

arjunsuresh avatar Jul 26 '24 00:07 arjunsuresh