logging icon indicating copy to clipboard operation
logging copied to clipboard

Add missing RCPs for RNN-T

Open mwawrzos opened this issue 4 years ago • 3 comments

In https://github.com/mlcommons/logging/pull/146 only BS=2048 RCPs are updated. We need to update new numbers for reminder configs.

mwawrzos avatar Jul 12 '21 10:07 mwawrzos

Since we are updating the RCPs anyway, we would like to request relaxing the WER requirement slightly. With our experiments, we are finding it extremely challenging to observe stable convergence to the required WER (although we are able to get extremely close).

qpjaada avatar Jul 15 '21 22:07 qpjaada

You mean you are failing the RCP test?

emizan76 avatar Jul 16 '21 07:07 emizan76

@emizan76 - we fail to reach the target WER although our implementation seems to be exactly the same as reference.

qpjaada avatar Jul 20 '21 15:07 qpjaada