Which Review Is Right for You?: Evaluating Articles
Evaluate the Articles
Select studies for inclusion based on pre-defined criteria. Start with a title/abstract screening to remove studies that are clearly not related to your topic. Use your inclusion/exclusion criteria to screen the full-text of studies. It is highly recommended that two independent reviewers screen all studies, resolving areas of disagreement by consensus.
It's easy to get lost doing research. Keep that inclusion/exclusion criteria close so that you are better able to decide yes or no on an article. If it's a great article but doesn't fit, email it to yourself and read it later.
We also find that it is important to know what to say, "I quit". Sometimes that decision is made for you (i.e., you have two weeks to do this search or you have six months and after that, that's it). Other times, you have to know when to stop. Are you seeing the same articles over and over? Have you done a comprehensive search in other databases? It's okay to stop.
Evaluate the risk of bias of included studies. Use a Risk of Bias tool (such as the Cochrane RoB Tool) to assess the potential biases of studies in regards to study design and other factors. You can adapt existing tools to best meet the needs of your review, depending on the types of studies included.
- ROBISROBIS is a new tool for assessing the risk of bias in systematic reviews (rather than in primary studies). Here you can find the tool itself, information to help you complete a ROBIS assessment, and resources to help you present the results of your ROBIS assessment.
- Risk of Bias assessment instrumentsFrom the CLARITY Group at McMaster University, includes:
Tool to Assess Risk of Bias in Cohort Studies
Tool to Assess Risk of Bias in Case Control Studies
Tool to Assess Risk of Bias in Randomized Controlled Trials
Tool to Assess Risk of Bias in Longitudinal Symptom Research Studies Aimed at the General Population
Risk of bias instrument for cross-sectional surveys of attitudes and practices. - Risk of bias assessment instrument for systematic reviews informing WHO global air quality guidelines (2020)This publication includes a description of the instrument devised to assess the risk of bias in the individual studies included in the systematic reviews of adverse health effects informing the guidelines. Further, general instructions and specific subject matter advice to guide the assessments are provided.