codalab-competitions icon indicating copy to clipboard operation
codalab-competitions copied to clipboard

Public submissions show scores in scrambled order

Open zimmerm opened this issue 6 years ago • 2 comments

Hello,

I'm working on setting up a competition and encountered a bug with the "Public submission" page. The problem is that "Public submission" shows the scores under the wrong label, whereas the results in the leaderboard are still correct as well as the output the scoring program yields.

I set up a MWE example that shows the problem: https://competitions.codalab.org/competitions/21214

Compare the values of "KP mean error (aligned)" or "Mesh error (aligned)" between leaderboard and public submission, which appear to be shuffled with their not aligned counterpart. The values the scoring program still seem to be correct.

Any help is very much appreciated.

Cheers Christian

zimmerm avatar Sep 09 '19 09:09 zimmerm

Hello,

Thanks for bringing this to our attention and making an example competition to demonstrate this bug. We will address this issue in the near future when we can.

Best regards, Tyler

Tthomas63 avatar Sep 12 '19 17:09 Tthomas63

@zimmerm

Hi, I was trying to reproduce the error on the new server codalab.lisn.fr, but it happens that the submission file you used is not longer present in the storage (due to some deletion done to recover some space).

Is there any chance that you still have the submission file?

Best regards, Adrien

Didayolo avatar Jan 17 '22 15:01 Didayolo