A vaping pilot study may test feasibility rather than effectiveness

Start with the research question

Find the objective in the report. It may concern whether participants can be recruited, whether procedures can be delivered, or whether follow-up is workable. Record that question using the paper’s actual meaning, not the advertising claim that led you to it.

NCCIH’s methods guidance describes pilot work as a small-scale test of methods and procedures, emphasizing feasibility and acceptability rather than hypothesis testing about effects. This is general research-design guidance, not a review of a particular vaping intervention. A paper’s label is not a substitute for reading what its authors planned and reported.

US National Center for Complementary and Integrative Health: Pilot Studies: Common Uses and Misuses

Match each result to the question it can answer

A recruitment count describes access to participants. Attendance or completion describes participation in specified activities. Satisfaction describes an answer to a particular question. None can silently become the same thing as quitting, and an outcome called quitting still needs its definition and timing checked.

Our editorial worksheet pairs two columns: “Result reported” and “Question answered.” Add a third column for the stronger claim someone is making. Where the result does not answer that stronger question, leave the connection unestablished. The worksheet does not declare that feasibility findings lack value; it protects their actual purpose.

Keep exploratory outcomes in their proper role

A pilot may report use outcomes alongside feasibility measures. Check how those results are described, what comparison was made, and what limitations the report gives. A small preliminary result should not be renamed a definitive validation because it is easy to turn into a headline.

In an original hypothetical example, a project shows that participants can use a follow-up procedure and also reports observations of vaping. The reader keeps the procedure finding separate from the question of whether the intervention caused those observations. No sample size, success percentage, or named program is invented here.

US National Institutes of Health: When Clinical Research Is in the News

Identify the next evidence question

Ask what would be needed to support the claim you are evaluating: a suitable comparison, clearly defined outcomes, adequate follow-up, or another issue described by the authors. Read the report’s own limitations before adding your reading question. You are not required to design a trial or create a treatment ranking.

This guide does not assess the effectiveness of a named pilot or tell you what intervention to choose. It helps distinguish “can this research procedure be carried out?” from a different effectiveness question. Preserve the actual findings and the uncertainty around the broader claim rather than treating the word promising as a completed answer.