Volnov Sergey comments

Results 7 comments of


                                            Volnov Sergey

Inference on custom data

Yes there is a .las format. I have already figure it out) But it will be very helpfull for other, if you post a little peace of ScanNet data too,...

Marking solutions that were trained on RAID train set

Thanks for the fast reply! Glad to hear that you already thought about it before and have plans on fixing it - separate leaderboards would be really great

Marking solutions that were trained on RAID train set

Hi @liamdugan, hope you're doing well. Just wanted to ask how is it going with the fixes and when should we expect them to be released?

Marking solutions that were trained on RAID train set

Hi @liamdugan, how is it going with the updates?

Marking solutions that were trained on RAID train set

Great! As for now I still can see one strange detector with 99.9% score, but others gone. Is AUC-ROC gonna be a new default metric or you'll set it back...

Marking solutions that were trained on RAID train set

I don't have a strong preference, but I'd chose TPR@FPR=5%, because in addition to paper consistency it's also more interpretable (showing accuracy at certain level of fpr) than AUROC.

Marking solutions that were trained on RAID train set

@liamdugan there is still one detector with 0.999 accuracy on the leaderboard, which seems really strange to me. Have you been able to get in touch with its team and...