logging
logging copied to clipboard
Use original RCP for RCP test if batch size and ALL hparams of submission match the RCP, otherwise used pruned RCPs.
This is a comment made by the training committee, related to issue #206.
If the submission hyperparams match exactly to an RCP in the database, then we should compare against this RCP only.
If not, then we should compare to the pruned RCPs.
This is doable, but given the timeline, we may decide to implement it for the 2.1 round.
Shang, can you take a look?
I am swamped with all other tasks, and this is non-trivial.
However, we have not committed to implementing for this round, so it is optional.
Ritika suggested that, so you can talk to her if you have any questions.