Skip to content
AI Lehel Briefing
← Back to latest
Models & research OpenAI

Why we no longer evaluate SWE-bench Verified

SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.

Excerpt supplied by the publisher’s feed

Read the original article at OpenAI Opens in a new tab