Commentary Open Access | Volume 9 (3): Article  115 | Published: 14 Jul 2026

Multilevel and mixed-effects models: Enhancing analytical rigour in public health research

   Menu, Tables and Figures

Keywords

  • Multilevel modelling
  • Mixed‑effects models
  • Clustered data
  • Variance decomposition
  • Public health methodology

Kare Chawicha Debessa1,&

1School of Public Health, College of Medicine and Health Sciences, Hawassa University, Hawassa, Ethiopia

&Corresponding author: Kare Chawicha Debessa, School of Public Health, College of Medicine and Health Sciences, Hawassa University, Hawassa, Ethiopia, Email: kare.debessa@gmail.com, ORCID: https://orcid.org/0009-0002-6118-9153

Received: 29 Apr 2026, Accepted: 12 Jul 2026, Published: 13 Jul 2026

Domain: Public Health Research Methods

Keywords: Multilevel modelling, mixed‑effects models, clustered data, variance decomposition, public health methodology

© Kare Chawicha Debessa. Journal of Interventional Epidemiology and Public Health (ISSN: 2664-2824). This is an Open Access article distributed under the terms of the Creative Commons Attribution International 4.0 License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Cite this article: Kare Chawicha Debessa, Multilevel and mixed-effects models: Enhancing analytical rigour in public health research. Journal of Interventional Epidemiology and Public Health. 2026; 9(3):115. https://doi.org/10.37432/jieph-d-26-00137

Abstract

Public health research often involves data where individuals are nested within groups, such as households, schools, or administrative regions. Standard regression methods typically assume independence among observations; when this assumption is violated, biased standard errors and misleading conclusions can result. Multilevel and mixed‑effects models are designed to account for clustering by partitioning variance into within‑group and between‑group components. This allows researchers to examine how group‑level factors modify individual‑level associations. However, these models are one important option among several valid approaches for clustered data, including generalized estimating equations, cluster‑robust standard errors, and fixed‑effects methods. This commentary argues that multilevel and mixed‑effects models are especially useful when researchers aim to quantify contextual variation, estimate cluster‑level random effects, or examine cross‑level interactions; nevertheless, model choice should be guided by the research question, data structure, and inferential goal rather than by the assumption that a single method defines evidence quality.

Commentary

Introduction
Public health outcomes are shaped by determinants operating simultaneously at multiple levels, including the individual, family, community, and national policy levels [1]. Researchers often analyze data from complex surveys, such as Demographic and Health Surveys (DHS) or WHO STEPS surveillance, which are inherently hierarchical. Traditional regression methods, such as ordinary least squares or logistic regression, assume that observations are independent. Individuals within the same group commonly share exposures and environments, producing correlated errors; ignoring this correlation can inflate Type I errors and produce unreliable findings [2]. It is therefore important that analytic choices reflect data structure and the scientific question.

Terminology requires clarification. “Multilevel models” and “mixed‑effects models” share the same mathematical core (fixed and random effects), though the terms arise from different research traditions and are sometimes used with subtle differences [3]. In public health, researchers use “fixed effects” to refer to population‑level parameters and “random effects” to represent cluster‑specific deviations that permit generalization beyond sampled clusters [4]. Importantly, model choice should not be equated with evidence quality: sound study design, measurement validity, bias control, and causal reasoning remain central to generating high‑quality public health evidence [5].

Multilevel models and variance decomposition
Multilevel models explicitly account for nested data structures. A basic two‑level model includes random intercepts for groups, separating group‑level variance from individual‑level variance [6]. The intraclass correlation coefficient (ICC) quantifies the proportion of total variance attributable to group membership and thus provides a practical metric for assessing the importance of clustering. Variance decomposition is a critical contribution of multilevel models because it reveals where variation lies and therefore helps guide policy priorities [7].

Example: If a study shows that most variability in childhood BMI is attributable to neighbourhood-level factors rather than individual behaviours, policy interventions should prioritize community design over interventions targeting individual behaviour change. Conversely, when between‑group variance is negligible (very low ICC), simpler marginal methods may be sufficient [8, 9].

Mixed‑effects models for longitudinal data
Mixed‑effects models extend multilevel frameworks to repeated measures by incorporating random intercepts for baseline differences and random slopes for individual trajectories over time [10]. This flexibility exceeds repeated‑measures ANOVA, which assumes balanced designs and equal measurement intervals. Mixed‑effects models also make efficient use of unbalanced data and can include all available observations under the missing‑at‑random (MAR) assumptions [11]. Literature emphasises, however, that MAR is a strong and fundamentally untestable assumption; researchers should assess patterns of missingness and, where appropriate, conduct sensitivity analyses for missing‑not‑at‑random (MNAR) scenarios [12]. Practical checks include comparing baseline characteristics of completers and non‑completers, documenting reasons for dropout, and using pattern‑mixture or selection models as sensitivity analyses when dropout is plausibly related to outcomes [13].

Cross‑level interactions and contextual effects
Cross‑level interactions test whether group‑level moderators modify individual‑level associations and are readily estimated in multilevel frameworks [14]. For example, while individual income may predict physical activity, this association could weaken in neighborhoods with high walkability; detecting such moderation informs whether structural policies can compensate for individual‑level disadvantages. Without multilevel modelling, contextual modifications like these can remain hidden [15]. These models therefore permit testing whether an intervention’s effect is uniform or environment‑dependent, which is essential when the substantive question is contextual rather than purely individual [16].

Underuse and methodological alternatives
Despite their advantages, multilevel models remain underutilised across public health subfields [17]. That said, multilevel models are not always the optimal choice. When the ICC is very small or when the research aim is marginal (population‑averaged) inference, generalized estimating equations (GEE) or cluster‑robust standard errors provide well‑established alternatives [18]. Fixed‑effects approaches are preferable when the objective is to control for unobserved, time‑invariant cluster characteristics. GEE is particularly useful for marginal effects and robustness to certain misspecifications. Whereas cluster-robust standard errors are a straightforward way to guard against within‑cluster dependence without modelling random effects explicitly [19]. Literature therefore recommends that authors select analytic approaches according to the inferential target: partitioning variance and estimating random effects (multilevel), marginal population averages (GEE), or protection against cluster dependence (cluster‑robust SEs or fixed effects) and justify these choices in the manuscript [20].

Bayesian multilevel models
Bayesian multilevel models provide advantages in contexts with small numbers of groups or complex random‑effects structures because priors can stabilize estimates and posterior distributions yield direct probability statements about parameters [21]. Bayesian methods are especially helpful when fewer than ~30 groups are available or when substantive prior information exists [22]. Nonetheless, researchers have stressed that Bayesian estimation should be selected because it aligns with the inferential problem rather than because it is inherently superior; practical considerations (computational cost, required expertise) and transparency about prior choices should be addressed when adopting Bayesian approaches [23].

Limitations and methodological cautions
Multilevel models assume normally distributed random effects; severe departures from this assumption can bias variance estimates [24]. Sample size considerations are important: many practical recommendations suggest at least ~30 groups for stable random‑intercept estimation, with larger numbers required for reliable random‑slope estimation [25]. Convergence problems often indicate insufficient data for the model’s complexity; when these arise, simplify the model or consider Bayesian shrinkage methods [26]. Crucially, multilevel modelling does not eliminate confounding or selection bias; these remain challenges for causal inference that require robust design or analytic strategies (e.g., randomized trials, instrumental variables, difference‑in‑differences). Therefore, it is important to treat multilevel models as analytic tools within a broader causal and design framework [27].

Conclusion

Public health data are often multilevel, and analytical methods should reflect that structure. When clustering is substantial, multilevel and mixed‑effects models are powerful tools for partitioning variance, testing cross‑level interactions, and appropriately estimating standard errors. However, these models do not by themselves define the quality of public health evidence. Journals should encourage transparent reporting of clustering metrics (e.g., ICCs) and modelling rationale, while recognising that GEE, cluster‑robust standard errors, or fixed‑effects models may be preferable in particular settings. Researchers should therefore justify their modelling choices in relation to study aims and data structure rather than treating any single analytic approach as universally definitive.

What is already known about the topic

  • Public health data are often clustered or hierarchical, with individuals nested within households, facilities, schools, or communities.
  • Ignoring clustering can produce underestimated standard errors and misleading statistical inference.
  • Multilevel and mixed‑effects models are established approaches for analyzing nested and repeated‑measures data.
  • GEE, cluster‑robust standard errors, and fixed‑effects methods are also accepted tools for clustered data depending on the research question.
  • The ICC is commonly used to quantify the degree of within‑cluster similarity.

What this  study adds

  • A balanced commentary showing when multilevel and mixed‑effects models are especially useful in public health research.
  • Clarification that model choice should be guided by the study question, clustering structure, and inferential target, not by a claim that one model defines evidence quality.
  • Distinction between multilevel modeling as an analytic tool and the broader challenges of causal inference and evidence generation.
  • Positioning multilevel models alongside GEE, cluster‑robust standard errors, and fixed‑effects methods as valid alternatives.
  • Emphasis on the importance of reporting ICCs, variance decomposition, and modeling rationale when clustering is present.

Competing interest

The author of this work declares no competing interests.

Funding

The author did not receive any specific funding for this work.

Acknowledgements

The author thanks all researchers, institutions, and publishers whose published work contributed to this synthesis.

Abbreviations
BMI: Body Mass Index
DHS: Demographic and Health Surveys
GEE: Generalized Estimating Equations
ICC: Intraclass Correlation Coefficient
MAR: Missing at Random
MNAR: Missing Not at Random
STROBE: Strengthening the Reporting of Observational Studies in Epidemiology
WHO STEPS: World Health Organization Stepwise Approach to Surveillance

Author’s contributions

KCD conceptualised the commentary, performed the literature review and synthesis, prepared the manuscript, and approved the final version for submission.

 

References

  1. Mercado CI, Bullard KM, Bolduc MLF, Andrews CA, Freggens ZRF, Liggett G, Banks D, Johnson SB, Penman-Aguilar A, Njai R. A Shift in Approach to Addressing Public Health Inequities and the Effect of Societal Structural and Systemic Drivers on Social Determinants of Health. Public Health Rep [Internet]. 2024 Oct 11 [cited 2026 Jul 14]. doi:10.1177/00333549241283586
  2. Whatley M. Ordinary Least Squares Regression. In: Introduction to Quantitative Analysis for International Educators [Internet]. Cham: Springer International Publishing; 2022 [cited 2026 Jul 14]. p. 91–112. doi:10.1007/978-3-030-93831-4_7
  3. Higdon R. Mixed and Multi-Level Models. In: Dubitzky W, Wolkenhauer O, Cho KH, Yokota H, editors. Encyclopedia of Systems Biology [Internet]. New York, NY: Springer New York; 2013 [cited 2026 Jul 14]. p. 1386–7. doi:10.1007/978-1-4419-9863-7_1196
  4. Firebaugh G, Warner C, Massoglia M. Fixed Effects, Random Effects, and Hybrid Models for Causal Analysis. In: Morgan SL, editor. Handbook of Causal Analysis for Social Research [Internet]. Dordrecht: Springer Netherlands; 2013 [cited 2026 Jul 14]. p. 113–32. doi:10.1007/978-94-007-6094-3_7
  5. Deichsel A, Münch LN, Laky B, AGA Research Committee. Study designs, levels of evidence, and scientific bias. Arthroskopie [Internet]. 2024 Aug [cited 2026 Jul 14];37(4):224–31. doi:10.1007/s00142-024-00681-y
  6. Khan S, Rahman MdS. Statistical Methods and Models for Health and Clinical Studies [Internet]. Singapore: Springer Nature Singapore; 2025 [cited 2026 Jul 14]. doi:10.1007/978-981-96-0878-2
  7. Leyland AH, Groenewegen PP. Intraclass Correlation Coefficient (ICC). In: Michalos AC, editor. Encyclopedia of Quality of Life and Well-Being Research [Internet]. Dordrecht: Springer Netherlands; 2014 [cited 2026 Jul 14]. p. 3367–8. doi:10.1007/978-94-007-0753-5_1528
  8. Gupta M, Phan TT, Lê-Scherban F, Eckrich D, Bunnell HT, Beheshti R. Associations of Longitudinal BMI-Percentile Classification Patterns in Early Childhood with Neighborhood-Level Social Determinants of Health. Child Obes [Internet]. 2025 Jan [cited 2026 Jul 14];21(1):65–75. doi:10.1089/chi.2023.0157
  9. Arnold R, Oberhoffer-Fritz R, Fonseca H, Buoncristiano M, Wickramasinghe K, Williams J. Inequalities in childhood overweight and obesity: A call to strengthen upstream policy measures. Public Health Pract (Oxf) [Internet]. 2025 Jun 27 [cited 2026 Jul 14];10:100637. doi:10.1016/j.puhip.2025.100637
  10. Maggino F, editor. Encyclopedia of Quality of Life and Well-Being Research [Internet]. Cham: Springer International Publishing; 2023 [cited 2026 Jul 14]. doi:10.1007/978-3-031-17299-1
  11. Yu Z, Guindani M, Grieco SF, Chen L, Holmes TC, Xu X. Beyond t test and ANOVA: applications of mixed-effects models for more rigorous statistical analysis in neuroscience research. Neuron [Internet]. 2022 Jan 5 [cited 2026 Jul 14];110(1):21–35. doi:10.1016/j.neuron.2021.10.030
  12. Kang H. The prevention and handling of the missing data. Korean J Anesthesiol [Internet]. 2013 May [cited 2026 Jul 14];64(5):402–6. doi:10.4097/kjae.2013.64.5.402
  13. Elkins MR. Assessing baseline comparability in randomised trials. J Physiother [Internet]. 2015 Oct [cited 2026 Jul 14];61(4):228–30. doi:10.1016/j.jphys.2015.07.005
  14. Aguinis H, Gottfredson RK, Culpepper SA. Best-Practice Recommendations for Estimating Cross-Level Interaction Effects Using Multilevel Modeling. Journal of Management [Internet]. 2013 Sep [cited 2026 Jul 14];39(6):1490–528. doi:10.1177/0149206313478188
  15. Høyer-Kruse J, Schmidt EB, Hansen AF, Pedersen MRL. The interplay between social environment and opportunities for physical activity within the built environment: a scoping review. BMC Public Health [Internet]. 2024 Aug 30 [cited 2026 Jul 14];24(1):2361. doi:10.1186/s12889-024-19733-x
  16. Kipfer S, Mabire C, Koppitz A, Pihet S. Exploring Change Mechanisms in a Complex Intervention: Lessons Learned From a Longitudinal Constructivist Grounded Theory Study. Glob Qual Nurs Res [Internet]. 2025 Mar 20 [cited 2026 Jul 14];12:23333936251327360. doi:10.1177/23333936251327360
  17. Odimegwu C, Muchemwa M, Akinyemi JO. Systematic review of multilevel models involving contextual characteristics in African demographic research. J Pop Research [Internet]. 2023 Jun [cited 2026 Jul 14];40(2):10. doi:10.1007/s12546-023-09305-y
  18. Oshchepkov A, Shirokanova A. Bridging the gap between multilevel modeling and economic methods. Soc Sci Res [Internet]. 2022 May [cited 2026 Jul 14];104:102689. doi:10.1016/j.ssresearch.2021.102689
  19. Sommet N, Lipps O. A Primer on Fixed Effects and Fixed-Effects Panel Modeling Using R, Stata, and SPSS. Advances in Methods and Practices in Psychological Science [Internet]. 2025 Oct [cited 2026 Jul 14];8(4):25152459251392843. doi:10.1177/25152459251392843
  20. Monsen KA. Intervention Effectiveness Research: Quality Improvement and Program Evaluation [Internet]. Cham: Springer International Publishing; 2018 [cited 2026 Jul 14]. doi:10.1007/978-3-319-61246-1
  21. Veenman M, Stefan AM, Haaf JM. Bayesian hierarchical modeling: an introduction and reassessment. Behav Res Methods [Internet]. 2024 Aug [cited 2026 Jul 14];56(5):4600–4631. doi:10.3758/s13428-023-02204-3
  22. Ginn GL, Campbell-Cooper C, Lockett A. The growing role of Bayesian methods in clinical trial design and analysis. Medicine [Internet]. 2025 Jun [cited 2026 Jul 14];53(6):388–91. doi:10.1016/j.mpmed.2025.04.006
  23. Van De Schoot R, Depaoli S, King R, Kramer B, Märtens K, Tadesse MG, Vannucci M, Gelman A, Veen D, Willemsen J, Yau C. Bayesian statistics and modelling. Nat Rev Methods Primers [Internet]. 2021 Jan 14 [cited 2026 Jul 14];1(1):1. doi:10.1038/s43586-020-00001-2
  24. Antonakis J, Bastardoz N, Rönkkö M. On Ignoring the Random Effects Assumption in Multilevel Models: Review, Critique, and Recommendations. Organizational Research Methods [Internet]. 2021 Apr [cited 2026 Jul 14];24(2):443–83. doi:10.1177/1094428119877457
  25. Ahmed SK. How to choose a sampling technique and determine sample size for research: A simplified guide for researchers. Oral Oncology Reports [Internet]. 2024 Dec [cited 2026 Jul 14];12:100662. doi:10.1016/j.oor.2024.100662
  26. Choo J, Jung Y, Lee I. A bayesian model calibration under insufficient data environment. Struct Multidisc Optim [Internet]. 2022 Mar [cited 2026 Jul 14];65(3):96. doi:10.1007/s00158-022-03196-y
  27. Keil AP, Zadrozny S, Edwards JK. A Review and Synthesis of Multi-level Models for Causal Inference with Individual Level Exposures. Curr Epidemiol Rep [Internet]. 2023 Aug 10 [cited 2026 Jul 14];11(1):54–62. doi:10.1007/s40471-023-00328-w
Views: 24