raid icon indicating copy to clipboard operation
raid copied to clipboard

added a submission named gambit-mage

Open yashasviraii opened this issue 4 months ago • 5 comments

yashasviraii avatar Sep 18 '25 20:09 yashasviraii

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

Gambit-mage

Release date: 2025-01-19

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 86.72 and a TPR of 61.85% at FPR=5% and 47.86% at FPR=1%. Without adversarial attacks, it achieved AUROC of 91.21 and a TPR of 75.43% at FPR=5% and 62.24% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

github-actions[bot] avatar Sep 19 '25 14:09 github-actions[bot]

@yashasviraii thanks for the submission! Let me know at any point if you'd like to merge!

liamdugan avatar Sep 19 '25 14:09 liamdugan

@liamdugan Thanks for evaluating the first one! Could you evaluate this one too so I can compare results? Also, will these results be added to the leaderboard?

yashasviraii avatar Sep 21 '25 17:09 yashasviraii

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

Mage-baseline

Release date: 2024-05-21

I've committed detailed results of this detector's performance on the test set to this PR.

[!WARNING] Failed to find threshold values that achieve False Positive Rate(s): (['5%', '1%']) on all domains. This submission will not appear in the main leaderboard for those FPR values; it will only be visible within the splits in which the target FPR was achieved.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

github-actions[bot] avatar Sep 23 '25 15:09 github-actions[bot]

@yashasviraii they will be added to the leaderboard if we merge the pull request. If you want only one of them to be added at a time then you can make a commit removing the other submission from this PR and add it as a separate PR.

Let me know what you'd like to do

liamdugan avatar Sep 27 '25 17:09 liamdugan