Skip to content

Update GPTTrace (Ettin-150M) predictions: v5e - #225

Merged
liamdugan merged 2 commits into
liamdugan:mainfrom
andrewnakas:update-gpttrace-ettin150-v5e
Oct 21, 2026
Merged

liamdugan merged 2 commits into
liamdugan:mainfrom
andrewnakas:update-gpttrace-ettin150-v5e

Conversation

@andrewnakas

Copy link
Copy Markdown
Contributor

Hi @liamdugan, following your note on #220 this updates the predictions for the existing GPTTrace (Ettin-150M) entry. There's no new folder.

Also, #223 (Ettin-1B) is ready whenever you'd like to merge it. Thanks again!

@github-actions

Copy link
Copy Markdown

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

GPTTrace (Ettin-150M)

Release date: 2026-10-16

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.89 and a TPR of 99.80% at FPR=5% and 98.91% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.95 and a TPR of 99.90% at FPR=5% and 99.53% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@liamdugan

Copy link
Copy Markdown
Owner

Let me know if you'd like me to submit this to the leaderboard @andrewnakas

@andrewnakas

Copy link
Copy Markdown
Contributor Author

Yes please, thank you!

@liamdugan
liamdugan merged commit 2e08f9c into liamdugan:main Oct 21, 2026
2 checks passed

This branch was successfully deployed

1 active deployment
raid-main — 74e0ba0f Deployed Oct 19, 2026 by liamdugan via evaluate #401
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants