A free, ad-free, open-data leaderboard for AI research that nobody could pay to top, but its benchmark scores are self-reported from papers rather than independently re-run, and Meta sunset the site in July 2025.
What it's really for A free, openly licensed research SOTA tracker (now archived).
What our grade covers The grade on this page is about its state-of-the-art ML leaderboards by task, not everything the site does.
High Scoring Confidence Checked against primary sources. We are confident in the facts and the grade here.
- Operating since
- 2018 (8 years) · source
- What it costs you
- Free to read The reviews are free to read.
- How they make money
- It made no money: a free, advertising-free public resource run by Meta AI with all content openly licensed under CC-BY-SA.
- What they do
- It aggregated machine-learning papers with their open-source code and ranked methods on benchmark "state-of-the-art" (SOTA) leaderboards by task, dataset and metric.
- What to watch for
- Leaderboard scores were taken from what papers reported and entries were openly community-editable, so results were not independently re-tested or audited by the platform.
- Composite score
- 2.90 / 5.00 → grade B-
How the grade was reached
Does the site take money from the very entities it ranks? Pay-for-placement, vendor-funded data, and affiliate commissions all pull this down. The less the ranking can be bought, the higher the score.
What is the ranking actually built on? Hands-on testing scores highest, then verified first-hand reviews, then opinion or popularity surveys and self-reported figures, then pay-to-rank, which scores lowest.
Is the methodology published, specific, and reproducible? Can a reader see how a given rank was reached, or is it a black box?
Are commercial relationships, sponsorships, and affiliate arrangements disclosed clearly and near the rankings themselves, rather than buried?
How hard is it to game? Controls against fake reviews, solicited reviews, and vendor gaming raise this; an open box anyone can stuff lowers it.
Evidence
- Founders Robert Stojnic and Ross Taylor: 'We launched Papers with Code in July 2018...' and on joining Meta, 'Papers with Code will remain a neutral, open and free resource... We're committed to the independence of this platform,' with 'all data released under a permissive open license (CC-BY-SA).' Source: Papers with Code blog (Medium) — 'Papers with Code is joining Facebook AI' →
- 'All the content on Papers With Code is openly licensed under CC-BY-SA, and anyone can contribute using the Edit buttons'; the leaderboards combine 'official code implementation and various community-based contributions' and 'the website is maintained by Meta AI, but it is run by the community.' Source: DataCamp — An Introduction to Papers With Code →
- On July 24–25, 2025 Meta sunset Papers with Code without notice; the domain began redirecting to Hugging Face's Trending Papers, and its ~9,327 benchmark leaderboards, ~79,817 paper-to-code links and ~5,628 datasets stopped being served from the canonical URL. Source: HyperAI — Paper With Code Shuts Down →