inference icon indicating copy to clipboard operation
inference copied to clipboard

llama3: performance_sample_count update

Open viraatc opened this issue 1 year ago • 1 comments

https://github.com/mlcommons/inference/blob/2d2eb3081dcda64e766a28dc1b6fb9c40fb9eefa/tools/submission/submission_checker.py#L432C28-L432C32

should this be 8313 as per length of 405b official dataset?

viraatc avatar Dec 13 '24 00:12 viraatc

Addressed in https://github.com/mlcommons/inference/pull/1978/files

nvzhihanj avatar Dec 13 '24 01:12 nvzhihanj