From review to synthesis: A step-by-step methodological guide to systematic reviews and multilevel meta-analyses

Author

• Meilan HU
• Paye Shin KOH
• Xun Ci SOH
• Andree HARTANTO, Singapore Management UniversityFollow
• Nadyanna M. MAJEED

Publication Type

Journal Article

Version

publishedVersion

Publication Date

6-2026

Abstract

We provide a step-by-step guide on conducting a quantitative systematic review (i.e., meta-analysis) using the open-source programming language R, as well as conducting a multilevel meta-analysis, in contexts where effect sizes are non-independent (e.g., multiple studies from the same lab). Quantitative systematic reviews offer researchers a method for synthesizing large bodies of literature, helping clarify inconsistent findings, identify research gaps, and refine theoretical models. However, existing tutorials often assume prior knowledge and/or experience, often overlooking foundational concepts. To address this gap, a comprehensive walkthrough of the systematic review process is presented, covering pre-registration, literature search and retrieval, screening, risk of bias assessment, and data extraction following the PRISMA framework. We then present detailed guidance on how to conduct both traditional and multilevel meta-analyses in R. Specifically, the tutorial explains how to estimate overall meta-analytic effect sizes when effect sizes are independent (traditional meta-analysis) and when effect sizes are nested within labs (multilevel meta-analysis). Procedures for assessing heterogeneity, testing for publication bias, and conducting moderation analyses are also covered. To accompany this tutorial, we supplement annotated R scripts and R notebooks to support transparency, reproducibility, and accessibility for researchers of all levels of experience.

Keywords

Meta-analysis, Multilevel analysis, Systematic review, Tutorial

Discipline

Scholarly Publishing | Social Psychology

Research Areas

Psychology

Publication

Behavior Research Methods

Volume

3

Issue

7

First Page

1

Last Page

32

ISSN

1554-351X

Identifier

10.3758/s13428-026-02961-x

Publisher

Springer

Citation

HU, Meilan, KOH, Paye Shin, SOH, Xun Ci, HARTANTO, Andree, & MAJEED, Nadyanna M..(2026). From review to synthesis: A step-by-step methodological guide to systematic reviews and multilevel meta-analyses. Behavior Research Methods, 3(7), 1-32.

Available at: https://ink.library.smu.edu.sg/soss_research/4449

Copyright Owner and License

Authors-CC-BY

Creative Commons License

This work is licensed under a Creative Commons Attribution 3.0 License.

Additional URL

https://doi.org/10.3758/s13428-026-02961-x