Vachon H, Viechtbauer W, Rintala A, Myin-Germeys I. (2019). Compliance and retention with the experience sampling method over the continuum of severe mental disorders: Meta-Analysis and recommendations. Journal of Medical Internet Research. 21(12): e14475. doi: 10.2196/14475
Researchers analyzed 79 experience sampling method (ESM) studies of major depressive, bipolar, and psychotic disorders to examine correlations between participant gender and design characteristics and study compliance and retention rates. PubMed and Web of Science database searches yielded 79 relevant ESM studies, comprised of 8,013 individuals, both with and without severe psychiatric conditions (18% psychotic disorder, 17% major depressive disorder, 3% bipolar disorder, 3% at high risk of psychiatric disorder). Theoretical models of study data revealed that both female gender and negative clinical status (individuals without a diagnosed psychiatric condition) exhibited positive correlations with compliance and retention rates in ESM studies; compliance and retention rates in all-female samples were a respective 18% and 12% higher than in all-male samples, and compliance and retention rates in individuals with a negative clinical status were a respective 11% and 10% higher than in individuals with a diagnosed psychiatric condition. Five study design characteristics (fewer evaluations per day, longer time intervals between successive daily evaluations, fixed sampling, Web-based or mixed data collection, and substantial monetary incentivization) all predicted higher compliance rates in ESM studies, but did not have a significant effect on retention rates. Results indicate that participant gender, clinical status, and study design characteristics have a significant effect on ESM study compliance and retention rates and thus the quality of ESM data collection. Further study of these relationships may be beneficial for ESM optimization.