An opt-in vaping poll describes respondents, not everyone who vapes

Find the invitation behind the percentage

Look for the recruitment description. Was the poll open to a social account’s followers, existing customers, or a defined sample selected through another method? Keep the invitation route attached to the result. A large number of responses does not by itself answer who was left outside that route.

Pew Research Center’s original methods explainer distinguishes probability recruitment from opt-in recruitment, including ads and self-enrollment. It describes coverage and data-quality tradeoffs. We use that methodological distinction here, not its demographic findings or numbers as evidence about vaping.

Pew Research Center: Which approaches to surveying small populations are more inclusive?

Separate the people invited from the people described

A headline may refer to “people who vape” while the survey invited users of one product. Compare the broad wording with the group that could actually participate. Also check whether the report explains eligibility, repeat responses, and any analysis adjustments; do not presume those procedures were used.

Our original reading card has three boxes: “Who could see the invitation,” “Who actually responded,” and “Who the claim says it represents.” If the third box is broader than the first two, write down the unresolved generalization. The card does not assign a numerical bias correction or establish that every voluntary survey is useless.

Read the exact question and outcome

A question about liking a service, intending to quit, or recommending a product is not a question about observed quitting. Keep the response options and timing visible if the report supplies them. Do not rename the outcome to fit a stronger promotional claim.

In a hypothetical example, a service invites its followers to report whether they enjoyed a feature. The result may describe those respondents’ answers, but cannot simply be retitled as a quit success rate. No actual poll or percentage is supplied here. The exercise shows why recruitment and outcome meaning must both accompany the summary.

State what remains useful and what is not established

A voluntary poll can still raise practical questions, such as which feature respondents want explained. You can preserve that limited use while withholding a population-wide or causal conclusion. Read the method before deciding how far the result travels.

This guide does not evaluate a named survey, calculate representativeness, or recommend a treatment. Missing follow-up within a study is another problem that requires its own check; recruitment determines who entered the picture in the first place. When method details are unavailable, retain that uncertainty instead of replacing it with either an endorsement or a dismissal of all participants’ experiences.

US National Institutes of Health: When Clinical Research Is in the News