A vaping study uses an instrument: check the proposed pathway

Identify three distinct roles

The analysis has an instrument, an intervention or exposure, and an outcome. Cochrane’s design glossary describes an instrument that predicts intervention receipt with its outcome effect operating through that intervention. World Bank methodological commentary cautions that a strong predictive relationship alone does not settle validity or competing pathways.

Write the three actual labels from the report. Do not call an instrument another baseline characteristic unless that is how the paper used it. An instrumental-variable estimate is a different analysis from simply including more variables in an adjusted model. This guide identifies the proposed logic; it cannot certify that a named instrument satisfies the required assumptions.

Cochrane: Defining and determining which quantitative study designs to include in your systematic review of effects of a healthcare intervention (April2024) · World Bank — Development Impact: I’m not a fan of leave-one-out/spatial instruments

Draw a hypothetical pathway and a competing route

Imagine a fictional research proposal using proximity to a service as an instrument for attending it. Draw proximity leading to attendance, then attendance leading to the measured outcome. Now ask whether proximity could also stand for access to other support or a different environment. Draw those possibilities as unanswered questions, not proven explanations.

The example is not a recommendation to use distance as an instrument, and it gives no result. It shows why predicting attendance is only part of the proposed argument. If a possible route bypasses the intervention, the report needs a reasoned discussion. The reader should not erase that question merely because the first pathway sounds plausible.

Read the justification beyond the first-stage number

Look for the instrument’s timing, its relationship to intervention receipt, and the rationale about other influences on the outcome. Some assumptions cannot be established by one simple statistical check. Preserve the authors’ limitations and any analysis exploring alternative explanations. An impressive technical label does not remove the need to examine the actual setting.

Also identify whose effect the reported analysis aims to estimate. Do not assume every instrument-based result describes every eligible person or the effect of universal adherence. If the report’s target is unclear, retain the method name and make that the clarification question. This introductory pathway exercise is not a replacement for specialist evaluation of the analysis.

Repeat the result with its conditions

An honest note says that the study used this instrument for this intervention or exposure, with these stated validity assumptions. If those assumptions are not explained in the accessible report, say that their basis remains unverified. Avoid declaring the estimate definitely causal or definitely false from the name of the method alone.

For individualized care, obtain qualified interpretation of the full research. Your own tracker cannot test the unobserved alternative pathway in the fictional diagram. It can help you describe actual use or triggers without borrowing a causal claim. The useful output is a clear pathway map and the one assumption you still need the source to explain.