Repository navigation
Update GPTTrace (Ettin-150M) predictions: v5e - #225
Conversation
|
Eval run succeeded! Link to run: link Here are the results of the submission(s): GPTTrace (Ettin-150M)Release date: 2026-10-16 I've committed detailed results of this detector's performance on the test set to this PR. On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.89 and a TPR of 99.80% at FPR=5% and 98.91% at FPR=1%. If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID! |
|
Let me know if you'd like me to submit this to the leaderboard @andrewnakas |
|
Yes please, thank you! |
Hi @liamdugan, following your note on #220 this updates the predictions for the existing GPTTrace (Ettin-150M) entry. There's no new folder.
predictions.json, all 672,000 test ids, scored as P(AI). Inmetadata.json, the release date, the HF link and a new GitHub link.Also, #223 (Ettin-1B) is ready whenever you'd like to merge it. Thanks again!