Plumb

The Reviewer Report Card

We review the reviewers.

Everyone trusts a ranking until they ask who paid for it. We grade review, ranking, and "best of" sites on how independent and transparent their methods really are, show our math, cite every claim, and put ourselves last.

Most independent

Top of the board: the rankings hardest to buy, mostly hands-on testers and nonprofit labs.

A+
Consumer Reports
Consumer products · Hands-on tester
The benchmark. Buys what it tests, takes no ads, answers to members.
A+
DeFiLlama
Crypto / DeFi analytics · Ratings & rankings
Ranks DeFi protocols by an objective, on-chain TVL metric anyone can audit in open-source code; by its own policy, projects can't pay to list or rank higher.
A+
Examine
Evidence-synthesis encyclopedia grading supplement and nutrition ingredients by research · Editorial reviews
A rare clean act in the supplement space: it grades the science behind ingredients, sells only information, and takes no industry money, so there is nothing for a vendor to buy, though its deepest analysis lives behind a paywall and it won't pick a brand for you.
A+
EvalPlus Leaderboard
AI coding-model benchmark · Benchmark
An academic, open-source coding benchmark that auto-grades LLMs on hand-verified tests with a published, reproducible method and no money changing hands; the usual public-benchmark caveat is contamination, not commerce.
A+
Stiftung Warentest
Consumer product testing · Hands-on tester
A government-founded but ad-free German foundation that buys products anonymously and lab-tests them; it sells a seal to winners but, by its own rules, the seal is earned before it can be licensed.
A+
CHOICE
Consumer products testing · Hands-on tester
A member-funded nonprofit that buys products at retail and tests them in its own accredited labs — about as close to unbuyable as consumer reviews get.
A+
AV-Comparatives
consumer-electronics · Hands-on tester
A hands-on, independent antivirus testing lab where vendors can't buy a ranking; the only catch is that the same labs sell logo licensing and paid commissioned single-product tests on the side.
A+
Stanford HELM
AI model benchmarking · Benchmark
A Stanford academic benchmark that runs its own standardized tests on AI models and publishes the raw prompts and code — about as close to an unbuyable, reproducible leaderboard as the field offers.

Most conflicted

Bottom of the board: rankings shaped by who pays, where placement is closer to advertising.

F
BadCreditLoans.com
Bad-credit loan lead-gen marketplace · Marketplace
BadCreditLoans.com is a pay-to-match lead-gen marketplace, not a review site — lender placement is openly driven by bid price, so consumers get whoever pays most, not whoever is best.
F
FindLaw
Lawyer directory · Directory / lead-gen
The lawyers up top paid to be there; the order is advertising, not a ranking.
D-
MatchmakerReview.com
Matchmaking & Dating Coach Reviews · Directory / lead-gen
MatchmakerReview.com presents itself as a review site but operates as an undisclosed lead-generation directory: its own homepage (copyright sumoJACK LLC, 2023) reveals no ranking methodology, no editorial criteria, no explanation of what "verified" means, and no disclosure of any commercial relationship between the site and the matchmakers it lists.
D-
Insureon
Small-business insurance marketplace · Marketplace
A commission-paid digital insurance brokerage, not an independent reviewer; its "top-rated carriers" framing is marketing for a marketplace the carriers pay into.
D-
BestDatingSites.com
Dating site rankings · Editorial reviews
BestDatingSites.com earns affiliate commissions on every subscription it drives, publishes no ranking methodology, names no reviewers, and has no disclosed criteria — the ratings are ungradeable by design, which is the design.
D-
Credit Karma
Personal finance · Directory / lead-gen
Its 'pre-approved' offers are ranked by who pays Intuit most, and the FTC fined it for the rest.
D
Bills.com
Personal Finance Reviews · Editorial reviews
Bills.com presents affiliate-compensated provider placements as editorial rankings while disclosing only in generic terms that paying partners may appear — the ranking method is unpublished, making independence unverifiable and the lead-gen motive the most plausible explanation for which providers rank first.
D
Toolify AI
AI tools directory · Directory / lead-gen
A massive, useful AI-tool index — but by its own model it ranks by popularity and paid signals, not hands-on testing, so treat it as a starting point, not a verdict.
See the full report card →

Browse by category

Pick what you're shopping for. Each category is its own ranked list.

Grades are computed from a weighted rubric, not hand-set: independence and evidence carry the most weight, with method transparency, conflict disclosure, and resistance to gaming. Every site also carries a type tag and a "Grades:" line so you know what kind of site it is and exactly which part we judged. We take no money from anyone we grade. Last reviewed June 2026.