Plumb

The Reviewer Report Card

We review the reviewers.

Everyone trusts a ranking until they ask who paid for it. We grade review, ranking, and "best of" sites on how independent and transparent their methods really are, show our math, cite every claim, and put ourselves last.

Most independent

Top of the board: the rankings hardest to buy, mostly hands-on testers and nonprofit labs.

A+
Consumer Reports
Consumer products · Hands-on tester
The benchmark. Buys what it tests, takes no ads, answers to members.
A+
DeFiLlama
Crypto / DeFi analytics · Ratings & rankings
Ranks DeFi protocols by an objective, on-chain TVL metric anyone can audit in open-source code; by its own policy, projects can't pay to list or rank higher.
A+
Examine
Evidence-synthesis encyclopedia grading supplement and nutrition ingredients by research · Editorial reviews
A rare clean act in the supplement space: it grades the science behind ingredients, sells only information, and takes no industry money, so there is nothing for a vendor to buy, though its deepest analysis lives behind a paywall and it won't pick a brand for you.
A+
Hugging Face Open LLM Leaderboard
AI model benchmarks · Benchmark
A free, reproducible benchmark scoreboard that nobody could pay to climb — though Hugging Face itself retired it in 2025, saying its tests had grown gameable and obsolete.
A+
EvalPlus Leaderboard
AI coding-model benchmark · Benchmark
An academic, open-source coding benchmark that auto-grades LLMs on hand-verified tests with a published, reproducible method and no money changing hands; the usual public-benchmark caveat is contamination, not commerce.
A+
Stiftung Warentest
Consumer product testing · Hands-on tester
A government-founded but ad-free German foundation that buys products anonymously and lab-tests them; it sells a seal to winners but, by its own rules, the seal is earned before it can be licensed.
A+
CHOICE
Consumer products testing · Hands-on tester
A member-funded nonprofit that buys products at retail and tests them in its own accredited labs — about as close to unbuyable as consumer reviews get.
A+
AV-Comparatives
consumer-electronics · Hands-on tester
A hands-on, independent antivirus testing lab where vendors can't buy a ranking; the only catch is that the same labs sell logo licensing and paid commissioned single-product tests on the side.

Most conflicted

Bottom of the board: rankings shaped by who pays, where placement is closer to advertising.

F
The Knot
weddings-events · Marketplace
A wedding-vendor marketplace, not an independent judge: vendors pay for placement, and a 2025 New Yorker investigation and a U.S. senator's FTC referral allege the leads couples see can be low-quality or "fake," which the company denies.
F
BadCreditLoans.com
Bad-credit loan lead-gen marketplace · Marketplace
BadCreditLoans.com is a pay-to-match lead-gen marketplace, not a review site — lender placement is openly driven by bid price, so consumers get whoever pays most, not whoever is best.
F
FindLaw
Lawyer directory · Directory / lead-gen
The lawyers up top paid to be there; the order is advertising, not a ranking.
D-
MatchmakerReview.com
Matchmaking & Dating Coach Reviews · Directory / lead-gen
MatchmakerReview.com presents itself as a review site but operates as an undisclosed lead-generation directory: its own homepage (copyright sumoJACK LLC, 2023) reveals no ranking methodology, no editorial criteria, no explanation of what "verified" means, and no disclosure of any commercial relationship between the site and the matchmakers it lists.
D-
Insureon
Small-business insurance marketplace · Marketplace
A commission-paid digital insurance brokerage, not an independent reviewer; its "top-rated carriers" framing is marketing for a marketplace the carriers pay into.
D-
Autotrader
autos · Marketplace
A dealer-funded car marketplace, not an independent reviewer: by its own disclosure, higher-priced listing packages buy more prominent placement.
D-
BestDatingSites.com
Dating site rankings · Editorial reviews
BestDatingSites.com earns affiliate commissions on every subscription it drives, publishes no ranking methodology, names no reviewers, and has no disclosed criteria — the ratings are ungradeable by design, which is the design.
D-
Credit Karma
Personal finance · Directory / lead-gen
Its 'pre-approved' offers are ranked by who pays Intuit most, and the FTC fined it for the rest.
See the full report card →

Browse by category

Pick what you're shopping for. Each category is its own ranked list.

Grades are computed from a weighted rubric, not hand-set: independence and evidence carry the most weight, with method transparency, conflict disclosure, and resistance to gaming. Every site also carries a type tag and a "Grades:" line so you know what kind of site it is and exactly which part we judged. We take no money from anyone we grade. Last reviewed June 2026.