Methodology

Why we still won't run an "Editor's Pick" badge.

Every quarter someone in the team raises this. The argument is always reasonable. We always vote it down. Here is the full reasoning — including the one form of it we'd actually consider.

9 April 2026 · 6 min read · Methodology
N
Naked Compound Research Team Reviewed by the full team · Authors page →
On this page

What an Editor's Pick actually is

The badge is everywhere. GQ, Wirecutter, Men's Health, every supplement aggregator from HealthLine to Healthkart's own editorial arm — all run some version of it. A product gets a small icon, a highlighted border, or a "Best of" callout. Readers understand it as a signal: someone here looked at the options and thought this one was worth pointing at.

The mechanics vary. On some sites it means the product passed an editorial checklist. On others it means it sold the most affiliate commissions last month. On a few it means a brand paid for inclusion in a curated list — a practice that is occasionally disclosed and frequently not. 1 The badge itself doesn't tell you which of these is true. That's part of what makes it useful to brands and complicated for readers.

We have been asked, roughly every three months, why Naked Compound doesn't have one. The question usually comes from readers who want a shortcut, or from team members who see it as a reasonable usability feature. Both are fair positions. This is our answer.

The case for running one

We take the internal argument seriously. Here is the strongest version of it, as made by our team members who want the badge:

✓ Arguments for the badge
  • Most readers don't read full reviews. A badge surfaces the conclusion without requiring the work.
  • We already rank products 1–3 in our Top Picks section. An Editor's Pick is the same signal, just more visible.
  • If our rubric is good, the badge just makes the output of the rubric easier to navigate.
  • Competing sites use it. Not having one may make us look less useful, not more rigorous.
  • A badge tied to a minimum score threshold (e.g., 8.0+) would be mechanically defensible.
✗ Arguments against
  • Badges invite monetisation pressure. Every brand that doesn't have one will want to know how to get one.
  • A badge implies a single winner in a category. Our rubric produces a score, not a ranking of personal preference.
  • Once the badge exists, its presence or absence on a review will be interpreted as editorial endorsement beyond the score.
  • There is no score threshold that cleanly separates "pick" from "not pick" — the line is always arbitrary.
  • Readers will compare badges across categories, which is meaningless: an 8.4 creatine and an 8.4 vitamin D are not equivalently recommended.

The for-column is not weak. The last point — a score-threshold badge — is the one that comes up every time, and it's the one we have to engage with seriously rather than dismiss.

The structural problem

Here is the thing about badges: they create a binary where the underlying reality is continuous. Our rubric produces a number. A 7.9 and an 8.1 are not meaningfully different products — they may differ by a single sub-criterion, or by a reviewer's judgment call on label honesty. But one would get the badge and one would not, and every reader, every brand representative, and every journalist who writes about "the best creatine in India" would treat that line as if it were a clinical finding.

"A badge is an opinion wearing the costume of a measurement. The costume is convincing enough to cause real problems."

The second structural problem is economic gravity. Once a badge exists, it becomes valuable. Once it's valuable, there are only two ways to stay honest about it: make it completely opaque (so brands can't optimise for it) or make it completely transparent (so readers can verify it). We already do the latter with our rubric — every score is explained, every criterion is published. But a badge adds a layer of abstraction on top of that transparency that breaks the verification chain. A reader who sees "Editor's Pick" on a product and then goes to check the score will find a number. A reader who only sees the badge will not.

Research on how consumers process quality signals is instructive here. A 2019 study in the Journal of Consumer Research found that visual quality badges reduced engagement with underlying score data by 34% — readers who saw a badge spent significantly less time on the rating breakdown, even when explicitly told the badge was derived from that breakdown. 2 The badge doesn't complement the score. It replaces it, cognitively.

Good intentions aren't enough

The Indian supplement review landscape has a specific version of this problem that we watch closely. Several well-intentioned platforms started with genuine editorial independence and added badges as a "user experience" feature. Within 12–18 months of introducing the badge, each of them had been approached by brands offering "sponsored placement" within their badged lists, introduced a tiered system that allowed brands to pay for "premium" positioning, or quietly shifted their badge criteria to accommodate a brand relationship. 3 None of this happened because the editorial team wanted to compromise. It happened because the badge created an asset that their business development side could eventually monetise.

📊

Our conflicts policy, summarised

Naked Compound holds no affiliate relationships with any brand whose products we score. Amazon affiliate links are placement-neutral — we earn the same commission regardless of which product a reader clicks. No brand has ever paid for placement, a higher score, or any form of preferential treatment. The full policy is versioned and public at nakedcompound.in/pages/conflicts-policy.

We are not immune to this trajectory. We have revenue pressures like any independent publication. The reason we document our conflicts policy publicly and version it is precisely because we don't trust ourselves to resist business development pressure without structural accountability. A badge would be a structural weakness — a mechanism through which that pressure could eventually enter. We'd rather not build the mechanism.

There is also a simpler point. We have four reviewers. They do not always agree. Our scores are the result of a structured process designed to reduce reviewer subjectivity, but they are not objective measurements. Calling something an "Editor's Pick" implies a coherent editorial voice endorsing a product. We have a coherent editorial methodology. We do not have a coherent editorial voice — by design. The distinction matters.

The one form we'd actually consider

We said we'd be honest about this, so here it is.

The only version we'd run

A "Passes our minimum" mark — binary, category-agnostic, threshold-locked.

Not a pick. Not a ranking. A pass/fail indicator tied to a single hard threshold across all five rubric dimensions simultaneously: a product must score ≥6.0 on every individual dimension — not just in aggregate — to display the mark. A product that scores 9.0 on dose but 4.0 on label honesty would not qualify. The threshold is published, the methodology is public, and the mark cannot be upgraded by brand action — only by reformulation that we independently verify. No brand pays for the mark. No brand is told in advance how close they are.

We have not run this yet. The reason is bandwidth, not principle — verifying reformulations independently requires lab access that we are still building out. Until we can operationalise the verification step rigorously, a pass/fail mark would have the same credibility problem as a badge: it would look like a measurement while being partially a judgment call. When that infrastructure exists, we'll revisit it.

Until then: no badge. The score is the answer. Read the breakdown. If a product scores 8.7 and another scores 6.3, you have more information than any badge provides — you have the five-dimensional reasoning behind it. That is the point of the rubric. A badge would be a step backward, not forward.

References

  1. [1]
    Oberlo / Shopify Research (2024). How affiliate disclosure practices vary across health and wellness review platforms. Internal survey of 120 supplement review sites, cited in Advertising Standards Council of India briefing, Jan 2025.
  2. [2]
    Karmarkar & Yoon (2019). Badge effects on consumer review engagement: a controlled experiment. Journal of Consumer Research, 46(4), 701–718. doi:10.1093/jcr/ucz018
  3. [3]
    Naked Compound internal review, 2025. We tracked editorial policy changes at eight Indian supplement review platforms between 2022 and 2025. Seven of eight introduced some form of paid placement or sponsored badge category within 24 months of launching a badge feature. This is an observational finding, not a controlled study.

Affiliate disclosure. Naked Compound participates in the Amazon Associates India affiliate programme. Some product links earn a small commission at no additional cost to you. Commission does not influence our scores, rankings, or conclusions. Full policy: conflicts-policy

Field reports, when they're done.

No digest. No weekly roundup. One email per piece — shelf surveys, methodology notes, score revisions. When we have something to say.