Plumb

The Reviewer Report Card

We review the reviewers.

Everyone trusts a ranking until they ask who paid for it. We grade review, ranking, and "best of" sites on how independent and transparent their methods really are, show our math, cite every claim, and put ourselves last.

Most independent

Top of the board: the rankings hardest to buy, mostly hands-on testers and nonprofit labs.

A+
Consumer Reports
Consumer products · Hands-on tester
The benchmark. Buys what it tests, takes no ads, answers to members.
A+
Examine
Evidence-synthesis encyclopedia grading supplement and nutrition ingredients by research · Editorial reviews
A rare clean act in the supplement space: it grades the science behind ingredients, sells only information, and takes no industry money, so there is nothing for a vendor to buy, though its deepest analysis lives behind a paywall and it won't pick a brand for you.
A+
Stiftung Warentest
Consumer product testing · Hands-on tester
A government-founded but ad-free German foundation that buys products anonymously and lab-tests them; it sells a seal to winners but, by its own rules, the seal is earned before it can be licensed.
A+
AV-Comparatives
consumer-electronics · Hands-on tester
A hands-on, independent antivirus testing lab where vendors can't buy a ranking; the only catch is that the same labs sell logo licensing and paid commissioned single-product tests on the side.
A+
Tom's Hardware
Consumer electronics · Hands-on tester
An in-house lab that benchmarks PC hardware hands-on and says it won't sell reviews; the buy buttons earn it affiliate commissions, and it says so at the top of the review.
A
DeFiLlama
Crypto / DeFi analytics · Ratings & rankings
Ranks DeFi protocols by an objective, on-chain TVL metric anyone can audit in open-source code, and by its own policy projects can't pay to list or rank higher; the catch is that its main revenue is referral kickbacks from the swap aggregators it also tracks.
A
Notebookcheck
Consumer electronics reviews · Hands-on tester
A lab-driven laptop and gadget reviewer that publishes its own measurements and method; it earns affiliate commissions and ad revenue, and the same arm that sells its advertising also arranges the review samples.
A
Which?
UK consumer product testing · Hands-on tester
A rare reviewer that buys and lab-tests products itself, takes no ads, and by its own disclosure only lets a brand license its logo after the product has already earned the rating.

Most conflicted

Bottom of the board: rankings shaped by who pays, where placement is closer to advertising.

F
BadCreditLoans.com
Bad-credit loan lead-gen marketplace · Marketplace
BadCreditLoans.com is a pay-to-match lead-gen marketplace, not a review site — lender placement is openly driven by bid price, so consumers get whoever pays most, not whoever is best.
F
FindLaw
Lawyer directory · Directory / lead-gen
The lawyers up top paid to be there; the order is advertising, not a ranking.
D-
MatchmakerReview.com
Matchmaking & Dating Coach Reviews · Directory / lead-gen
MatchmakerReview.com presents itself as a review site but operates as an undisclosed lead-generation directory: its homepage (copyright sumoJACK LLC, 2023) carries no ranking methodology, no editorial criteria, no explanation of what "verified" means, and no disclosure of any commercial relationship between the site and the matchmakers it lists.
D-
Insureon
Small-business insurance marketplace · Marketplace
A commission-paid digital insurance brokerage, not an independent reviewer; its "top-rated carriers" framing is marketing for a marketplace the carriers pay into.
D-
BestDatingSites.com
Dating site rankings · Editorial reviews
BestDatingSites.com earns affiliate commissions on every subscription it drives, publishes no ranking methodology, names no reviewers, and has no disclosed criteria — the ratings are ungradeable by design, which is the design.
D-
Credit Karma
Personal finance · Directory / lead-gen
By its own disclosure, what Credit Karma shows you is shaped by which lenders pay it, and the FTC fined it $3 million in 2022 over 'pre-approved' offers that many users were then denied.
D
Toolify AI
AI tools directory · Directory / lead-gen
A massive, useful AI-tool index — but by its own model it ranks by popularity and paid signals, not hands-on testing, so treat it as a starting point, not a verdict.
D
HomeAdvisor
Local home-services lead-gen / directory · Directory / lead-gen
Your details sold to several contractors at once; visibility goes to whoever pays per lead.
See the full report card →

Pay-to-rank 44 sites' own fine print says payment can move their rankings — each one capped at D+. See the list →

Browse by category

Pick what you're shopping for. Each category is its own ranked list.

Grades are computed from a weighted rubric, not hand-set: independence and evidence carry the most weight, with method transparency, conflict disclosure, and resistance to gaming. Every site also carries a type tag and a "Grades:" line so you know what kind of site it is and exactly which part we judged. We take no money from anyone we grade. Grades verified June – September 2026; every graded site's link is health-checked monthly (last run September 1, 2026).