A quit-vaping study says it worked for one subgroup: read the comparison

Identify what was divided

A report might divide participants by a characteristic or divide studies in a review by design. Locate the exact definition and the groups included. Do not substitute a broader everyday category for the one the researchers used, or assume that a news headline describes every person sharing that label.

Cochrane’s methods chapter explains the distinction between separate subgroup significance and evidence of a difference between effects. This guide uses that distinction for reading. It does not reanalyze data or identify which subgroup should receive a particular intervention.

Cochrane: Cochrane Handbook, Chapter 10: Analysing data and undertaking meta-analyses

Use a headline check

Imagine a fictional report with two subgroup estimates pointing in the same direction, but one labeled statistically significant and the other not. A headline calls the program useful only in the first subgroup. Before repeating it, look for the analysis that actually compares the effects between those groups.

Your reading note can say: “Two subgroup results reported; test of the difference not located.” That is more precise than asserting either that the headline is correct or that there can never be a meaningful subgroup difference. The example is invented and contains no vaping success rates.

Check when the subgroup question was specified

Find the protocol or analysis plan if available and note whether the subgroup comparison was planned. Keep this alongside the between-group comparison question. A planned subgroup still needs appropriate interpretation; an exploratory finding can suggest a research question without becoming a personal rule.

If several subgroup results appear, ask whether the headline selected only one attractive finding. Do not choose the subgroup result that best matches your identity and ignore the overall research question. A table of many divisions is not a personalized assessment of which method will work for you.

Cochrane: Cochrane Handbook, Chapter 3: Defining inclusion criteria

Keep the practical decision at the right level

If you are comparing available support, bring a bounded question about the evidence to a qualified professional rather than excluding an option because one subgroup lacked a significance label. Access, preferences and individual care questions require their own discussion.

The worksheet produces three items: the subgroup definition, the reported comparison of effects and whether the question was planned. It cannot establish clinical benefit, calculate a personal probability or settle an unexplained analysis. Leave any missing item explicitly unresolved.