Why did a vaping survey drop a question after cognitive interviews?
Follow a draft vaping survey item through a cognitive interview and find out whether it survived into the questionnaire.
No Vape · Updated

Read the interview as a test of the item
The CDC’s questionnaire evaluation center describes probes about comprehension, recall, judgment and response. A participant might explain what an expression means, how they remembered a period of time or why their answer did not fit the choices. These interviews can reveal why two apparently clear answers came from different thinking.
Find the item that participants actually saw. A quotation from an early interview belongs to that draft even if the project later published a revised item with the same short name. Small, deliberately selected interview groups can find a problem without estimating how often it affects all future respondents.
CDC National Center for Health Statistics: Cognitive Interviewing
Trace the bottle question through the rounds
In an original study of e-cigarette questions for young adults, researchers explored how participants retrieved and estimated liquid-use information. The report describes discarding bottle-size and bottle-count questions before the third cognitive interview round. It also says the daily milliliter question was removed. These are documented changes during questionnaire development.
Suppose you want to know how much liquid the later survey measured. A description of what was tried in early interviews cannot supply a quantity from an omitted item. Check whether the study published a different surviving item that addresses the same quantity and period. Keep the answer unresolved if you only find the discarded version.
Write a short revision trail
Create four entries in a note. Copy the draft item, name the difficulty seen in the probes, record the revision or removal, and point to the final item list when available. Use the researchers’ actual distinction between an issue they observed and a change they tried. An explanation in the methods may be more specific than the phrase “pilot tested.”
In a fictional example, a respondent can remember the day a bottle was opened but has no record of the share they used. If the item is dropped, mark the requested amount as unavailable from that item. If it survives with clearer instructions, check whether those instructions also address the recall problem. Clearer wording and better recall are separate possibilities.
Keep the missing measure visible in your summary
A useful note says what was piloted and which information the final report contains. Even a successful revision in a small interview round leaves questions about the performance of the full survey. The exercise ends with a document trail, so the next reader can see why a familiar item title disappeared.
If your practical question is about a routine you observed today, describe that observation in its own terms. The research tool’s decisions about which volume questions to keep do not determine how you should organize your own notes.
Questions about this step
Does a confident draft answer establish that the survey item worked?
Confidence is one piece of the interview account. Check the explanation the person gave and what the research team did with that item.
Sources and scope
Sources inform the guidance. The worksheets and examples are No Vape editorial suggestions, not tested treatments.
Written with AI assistance and checked against the cited sources. No clinical review is claimed. This guide covers practical planning, not individual medical treatment. How we research and write