Skip to content
No Vape

An AMSTAR 2 appraisal concerns how a quitting review was conducted

Find the actual review-method assessment and critical weaknesses instead of converting checklist responses into a percentage quality score.

No Vape · Updated

Books arranged on a shelf
Illustrative image · Pramod Tiwari / Unsplash

Identify the object being assessed

A paper can contain primary trials, a review that synthesizes them, and an appraisal of that review. Write those three layers separately. A concern about the review’s search process differs from a concern about one trial’s allocation or one result’s uncertainty. First establish which review and version the quoted appraisal actually addresses.

Shea and colleagues’ original 2017 AMSTAR 2 paper describes appraisal of systematic reviews containing randomized or nonrandomized intervention studies. It warns against an overall numerical score and gives particular importance to critical domains. We use that assessment concept, not the instrument as a medical endorsement or a new formal rating of any vaping review.

Shea etal — BMJ, original paper via PMC: AMSTAR2: a critical appraisal tool for systematic reviews (2017)

Follow one judgment to its reason

Locate the appraiser’s explanation for a relevant weakness and the review material supporting it. For example, does the concern address how studies were located, how exclusions were explained, or how study limitations informed the conclusion? Record the actual issue rather than replacing several different problems with the single word bad. Missing access to the appraisal is an information gap.

Consider a fictional review that reports its findings clearly but has a documented limitation in its search. Good presentation does not repair that search automatically. Conversely, an unfamiliar layout does not establish a methodological flaw. The invented example separates the conduct of synthesis from the ease of reading its report; it makes no judgment about an actual quitting program.

Avoid averaging away a critical concern

A claim such as most boxes were checked can hide a weakness important to the result. Preserve the published overall judgment, its critical concerns and any stated adaptations instead of inventing your own arithmetic. Applying an appraisal instrument requires subject and methods knowledge. This introductory note is not permission to assign a formal rating from an abstract alone.

Likewise, do not transfer an AMSTAR 2 label directly to every included trial or every outcome. A review-method appraisal, a result-specific trial risk-of-bias assessment and GRADE certainty address different objects. The words confidence and quality can appear in several places while referring to distinct judgments. Attach each label to the document and question that generated it.

Use the appraisal to frame the next question

A useful evidence note names the review, appraisal source, important methodological concern and implication stated by the appraiser. If a promotional summary claims the tool certified an app, ask for the actual intervention comparison and result. Assessment of a review does not establish that a different product delivered the same support or achieved an equivalent outcome.

For treatment choices, obtain qualified interpretation of the evidence and its applicability. You can finish this reading task without calculating a new score, redoing a search or declaring the review useless. The goal is to understand why confidence in the synthesis was judged as it was, while leaving personal care and any unresolved methodological dispute to appropriate expertise.

Sources and scope

Sources inform the guidance. The worksheets and examples are No Vape editorial suggestions, not tested treatments.

  1. Shea etal — BMJ, original paper via PMC — AMSTAR2: a critical appraisal tool for systematic reviews (2017)
  2. No Vape — No Vape — app features and store links

Written with AI assistance and checked against the cited sources. No clinical review is claimed. This guide covers practical planning, not individual medical treatment. How we research and write