Abstract

Background

Ambulatory assessment and mood monitoring are different methods that can use novel technology to deliver a more efficient, flexible, and usable method of clinical outcome assessment compared with established measures of behavior and mood. Concerns have been raised around attrition in and adherence to these new protocols, particularly over the medium to long term by people with mood disorders.

Objective

This systematic review and meta-analysis assessed attrition from and adherence to active and passive ambulatory assessment and mood monitoring protocols by people with bipolar disorder and depression over the medium and long term.

Methods

Randomized controlled trials and nonrandomized studies were identified and rated for risk of bias. Adherence and attrition data were pooled to calculate effect sizes. We analyzed specific factors that we hypothesized a priori could affect the prevalences of attrition and adherence by means of subgroup meta-analysis or metaregression modeling.

Results

We evaluated 77 mood tracking or ambulatory assessment studies including 17,123 participants. Pooled adherence was 0.64% (95% CI 0.59%-0.70%; P<.001), and pooled attrition was 0.28% (95% CI 0.22%-0.34%; P<.001). Three factors had a statistically significant subgroup difference for adherence: The presence of financial incentives increased adherence, and the presence of mood monitoring reminders and a higher study risk of bias decreased adherence. Four factors had a statistically significant subgroup difference for attrition: Digital mood monitoring decreased attrition versus analogue studies, but mood monitoring reminders, mood monitoring versus other protocols, and a high risk of study bias increased attrition. These analyses, however, were vulnerable to confounding by study design and protocol design. Attrition rates were not reported by 17 studies (17/77, 22%), and 20 studies (20/77, 26%) did not report adherence rates. Most studies had a low-to-moderate risk of bias, but heterogeneity was very high. Only 16 studies reported adherence systematically.

Conclusions

Reporting of attrition and adherence to ambulatory assessments was not systematic nor universal, and until it is, analyses are unlikely to demonstrate clear conclusions. We found very high heterogeneity and evidence of publication bias, and this limited the certainty of our conclusions. Financial incentives may increase adherence, and attrition may be lower in digital than analogue studies of mood monitoring. There was no statistically significant difference in adherence and attrition between studies of passive and active ambulatory assessments. Reminders of mood monitoring increased attrition and decreased adherence, but the results may be confounded by longer length of follow-up versus other studies.

Introduction

Technological developments, such as wearables and smartphone sensors, have enhanced the capacity for mood monitoring through both active (manual input) and passive (automated) data collection [1]. Although these tools offer promising applications in mood disorders (particularly for addressing the limitations of traditional measurement tools for capturing rapidly shifting mood change [2]), smartphone-based ambulatory assessments may pose specific risks and challenges, especially for vulnerable populations [3]. The definition of ambulatory assessment encompasses a wide range of methods that leverage mobile technologies to repeatedly study individuals—often in real time and in their natural environments [4]. This includes mood monitoring (repeatedly tracking one’s mood over time), remote measurement technologies (defined as wearable devices that passively collect data without any active user input), and ecological momentary assessment (EMA), which is defined as a type of assessment involving more intensive, frequent self-reports throughout the day in real time and “in the moment” [5].

This review explored dropout, attrition, and adherence associated with mood monitoring, mood tracking, and ambulatory assessment by individuals with unipolar depression and bipolar disorder. This study focused on studies exploring mood monitoring (defined as regularly tracking and appraising one’s mood), and many of the studies included here also fall under the similar categories of EMA, remote measurement technologies, or ambulatory assessment depending on the frequency, manner, and technology used to track mood. There is also considerable overlap between these definitions (defined in the previous paragraph). Here, mood monitoring was used both as an intervention (in randomized and nonrandomized studies) and as a method for measuring outcomes (again in randomized and nonrandomized studies).

Because of this, this study focused specifically on individuals with unipolar depression and bipolar disorder. This is due to the evidence suggesting that this group faces distinct risks and challenges that may cause issues with attrition and adherence [67]. Mood disorders represent promising conditions for mood monitoring, as they are characterized by subtle mood shifts over time that may respond well to early intervention. They also represent a large global source of disability with depression as the leading cause [8]. Both people with depression and people with bipolar disorder (particularly those who experience psychosis) may have particularly poor adherence rates; therefore, improving this may be vital to realizing some of the benefits that ambulatory assessment approaches could offer for understanding and treating these conditions [910].

Due to the perceived burden of some ambulatory assessment protocols [6], concerns have been raised about their usability and acceptability, particularly over longer periods of time in clinical populations [9]. Therefore, this study focused on 3 months or longer. There are likely to be factors that could be adjusted to optimize usability and acceptability and thus adherence and attrition. This could improve the overall quality of the data collected and thus improve the research or interventions that derive from the data. Optimizing adherence and attrition is also of benefit to clinical research and could considerably decrease sample sizes required for future ambulatory assessment research [11].

Ambulatory assessment protocols are highly heterogenous and, even within the same discipline, use a wide variety of different methodologies [5]. These vary in terms of the type and frequency of assessment schedule as well as the technology used to collect the data and whether the assessment is also used as an intervention. Because of this heterogeneity, previous reviews have attempted to untangle which factors affect adherence and attrition, but these have only been in short-term use rather than medium or long-term assessment. This medium or long-term use may be necessary to evaluate the fluctuations in mood that occur over time, particularly in depression and bipolar disorder [911]. Longer-term data are likely to be fundamental for digital phenotyping and offering personalized psychiatry, which could, for example, identify early warning signs and prevent or predict relapse [12], aims that are particularly relevant for mood disorder research [1314].

There are several reasons why adherence to long-term ambulatory assessment use may be different to that of shorter protocols. Ambulatory assessment protocol adherence tends to decrease over the duration of the assessment and by people with higher levels of negative affect (eg, mood disorders), but again, this has not been assessed over longer time frames [915]. Previous work has identified that studies can improve adherence by offering financial incentives, minimizing the quantity of assessments, and the assessments occurring at a prespecified time [911]. Other studies have not identified any significant predictors of attrition [16]. It remains unclear if these factors also apply to medium or long-term approaches.

This review aimed to assess attrition and adherence over the medium and long term to ambulatory assessment and mood monitoring protocols and consider the factors that may affect these (eg, diagnosis, financial incentives, remote or in-person enrollment, reminders to complete the mood assessment, frequency of mood assessment).

Methods

We used a Cochrane Handbook for Systematic Reviews of Interventions–based methodology. We completed a PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) checklist. The study was pre-registered in accordance with the International Prospective Register of Systematic Reviews (PROSPERO: CRD42023396473 [17]).

Inclusion Criteria

Included studies met the following criteria: included self-monitoring, mood monitoring, or repeated symptom assessment with people with bipolar disorder or depression using an interventional or observational design over a minimum period of 3 months, with rating of symptoms weekly at a minimum. Operationally, for this review, we defined this repeated symptom assessment as either mood monitoring or ambulatory assessment (as defined in the previous section—with all mood monitoring conducted as an ambulatory assessment but not all ambulatory assessment being mood monitoring). We chose this broad definition because many ambulatory assessment protocols have the potential to be used for mood monitoring as an intervention or for research outcomes, even if this was not the intended aim of the study, although all included studies used the repeated symptom assessment either as an intervention or research outcome.

The studies should have either used a validated measure of mood or validated the chosen measure with a validated mood measure. The studies could be published in any language and could be digital or nondigital, although we acknowledged that the majority of studies would utilize digital technologies. We included nonrandomized or randomized studies with 20 or more participants with bipolar disorder or depression [18]. We searched the gray literature (eg, conference abstracts, dissertations, policy literature, reports via ProQuest and Google Scholar—full details are in the next section) for unpublished studies that were eligible for inclusion.

Search Strategy and Selection Criteria

The complete search strategy is listed in Multimedia Appendix 1. We searched Ovid MEDLINE, EMBASE, PsychINFO, SCOPUS, IEE Xplore, Proquest SciTech Collection, Proquest dissertations and theses global, and Google Scholar using the search terms. The initial search was conducted on March 3, 2023, and updated on October 28, 2024. All abstracts were appraised by 2 independent screeners, any disagreements were discussed, and a consensus was reached, with adjudication by a third independent screener if required. We acquired the full text of any potentially relevant papers, and if we were unable to source the full text of the study, we then contacted the corresponding author to request the paper. To determine if potentially relevant studies met the inclusion criteria, the full text was reviewed separately by 2 authors, again with discussion and consensus with a third reviewer if necessary. All papers for inclusion were reference checked along with relevant systematic reviews [19-28]. Key authors were also emailed to see if any ongoing unpublished studies could be included.

Data Extraction

Data were extracted by 2 independent reviewers from studies meeting the inclusion criteria using identical data extraction forms. Irregularities in the data extraction were discussed, and any discrepancy was resolved with discussion.

In this review, we defined attrition as the number of participants who had withdrawn from the study and no longer contributed data after randomization or baseline assessment. We defined adherence as the number of ambulatory assessments completed by those who remained in the study. When calculating attrition and adherence, we included anyone randomized into the trial, even if they did not subsequently complete any or many mood assessments. This was because preliminary analyses showed the reporting of the exact number of people who took part in the mood monitoring was poor, and our aim was to create pragmatic attrition and adherence values that would be useful to the power calculations of future ambulatory assessment studies. Using the number randomized was likely to affect the calculated estimates and was likely to increase the attrition rate by increasing the denominator size. For example, this may have included individuals without any actual use of the monitoring tool but who were randomized to the intervention arm. Even if not reflective of the adherence and attrition of highly motivated individuals, nonetheless, this is to give a pragmatic figure for the design of future studies. This estimate then gave a pragmatic figure for the design of future studies that use an optimal intention-to-treat design rather than estimates based on selection of more motivated and adherent participants.

Attrition and adherence were calculated using what we judged to be the most systematic and pragmatic metric available (eg, the longest follow-up available using systematically acquired data). Not all studies reported raw figures, and some only reported attrition %, which we included when available. For only a minority of studies, adherence was reported systematically using device-generated data. Many studies did not report this, and some studies reported the number of participants completing the study as the adherence: We included these less accurate metrics if there was not a more systematic metric reported. For many of these metrics, we were required to email the authors to request the attrition and adherence data due to no reporting in the manuscript. For attrition, using the number randomized as the denominator may have underestimated the attrition, as many of these individuals would have never used the ambulatory assessment protocol. On the other hand, including some nonsystematically gathered data likely distorts the pooled estimate (possibly by underestimating attrition and adherence but this is not certain), but we did, however, control for this in a sensitivity analysis documented in the following sections.

Assessment of Study Bias

For observational studies, the Cochrane Collaboration tool for assessing the risk of bias in nonrandomized studies of interventions [29] was used. For randomized controlled trials (RCTs), we used the Cochrane risk of bias tool for randomized trials for each study [30]. Risk of bias was assessed by 2 independent reviewers, and any disagreement was resolved via discussion.

Synthesis of Results

We grouped studies together, where possible, according to the variable assessed (eg, adherence or attrition) and pooled the data in a meta-analysis. We conducted subgroup analysis on specific factors that we hypothesized a priori could affect the prevalences of attrition and adherence. Results of each primary study were pooled using the inverse variance weighted approach with a random or fixed effects model, informed by examining the between-studies heterogeneities. Stata metan code was used to perform the analysis for proportion data, and metareg code was used for metaregression modeling.

Results

Search Results

The search identified 23,515 papers (Figure 1). No studies not published in English met the inclusion criteria. Following title and abstract screening, 21,638 articles were excluded, resulting in a total of 758 papers being reviewed in full. A total of 77 papers met the eligibility criteria and were included in the review. The 77 studies included 17,123 participants: 17 studies did not report attrition rates, 20 studies did not report adherence rates, 34 studies did not report if financial incentives were offered, and 25 studies did not report the recruitment method. The average mood tracking or ambulatory assessment duration was 6.9 months. Reporting of adherence was not universal nor systematic: Of the 57 studies that reported adherence, 34 studies did not specify how the adherence statistic was calculated, and 23 systematically used device-generated data to calculate this.

Tables S1 and S2 in Multimedia Appendix 2 display the detailed characteristics of the studies and the mood monitoring protocols used. These tables are stratified by clinical condition and type of study (eg, randomized or nonrandomized).

We included mixed samples if they included 20 or more participants with either depression or bipolar disorder. In the depression studies, this included 899 participants with primary diagnoses other than depression or healthy controls of a total of 9310 participants included. In bipolar disorder studies, there were 83 participants with primary diagnoses other than bipolar disorder or healthy controls of a total of 7813 included. In total, 5.7% (977/17,123) of the total participants did not have a primary diagnosis of depression or bipolar disorder.

We included relapse prevention or maintenance trials, as this is a core element of treatment of bipolar disorder and depression, which are usually relapsing and remitting illnesses. With studies of variable follow-up durations, we included the attrition or adherence from the latest available outcome, and this was a pragmatic decision around the design of future studies that will require long-term follow-ups due to the lifelong nature of many mood disorders.

Risk of Bias Assessments

The methodological quality of these studies was variable, but most were considered of low-to-moderate risk of bias (Table S3 in Multimedia Appendix 2).

Meta-Analysis

As planned a priori, we conducted a subgroup analysis of 5 different factors for both adherence and attrition reported in Table S1 in Multimedia Appendix 2: type of mood monitoring, mood disorder, RCT versus nonrandomized study, digitization of mood monitoring, presence of reminders to complete the mood monitoring, in-person or remote enrollment, and the presence of financial incentives.

Meta-analytic pooling of adherence (0.64%, 95% CI 0.59%-0.70%; P<.001) and attrition (0.28%, 95% CI 0.22%-0.34%; P<.001) is reported in Figures2 3, respectively. For adherence, heterogeneity was high (Cochran Q90=10,052.49; P<.001; I2=99.1%). Likewise for attrition, heterogeneity was high (Cochran Q73=6615.17; P<.001; I2=98.9%). Because of the pronounced heterogeneity, we used a random effects model to pool the data. Both of the funnel plots for the total prevalences of adherence and attrition demonstrated visual asymmetry and thus suggested possible publication bias or small study effects in the meta-analytic estimate (Figures S1 and S3 in Multimedia Appendix 2). The Egger test demonstrated that there were no small-study effects (Figures S2 and S4 in Multimedia Appendix 2) for both the adherence and attrition analyses.

We report subgroup analyses in Figures S5-S16 in Multimedia Appendix 2. The interpretation of any differences here should not be interpreted causally due to the limitations of the data; likewise, any notable absence of effect should not be interpreted as conclusive equivalence due to potential power limitations. Only 3 factors had a statistically significant subgroup difference for adherence: the presence of financial incentives, mood monitoring reminders, and study risk of bias. Studies without financial incentives had lower adherence (0.65%, 95% CI 0.52%-0.79%) than those offering financial incentives (0.77%, 95% CI 0.66%-0.88%; between-group Q2=6.38; P=.04). There was not a statistically significant effect of financial incentives on attrition, however: studies without financial incentives: 0.22% (95% CI 0.07%-0.37%); studies with financial incentives: 0.21% (95% CI 0.10%-0.31%; between-group Q2=3.91; P=.14). Studies with mood monitoring reminders had lower adherence (0.61%, 95% CI 0.54%-0.67%) than studies without mood monitoring reminders (0.78%, 95% CI 0.69%-0.88%; between-group Q2=11.25; P=.004).

A statistically significant subgroup difference was also not present for adherence for studies that systematically reported adherence via device-level data compared with those that did not: studies that did not systematically report adherence: 0.67% (95% CI 0.59%-0.75%); studies that systematically reported adherence: 0.62% (95% CI 0.54%-0.69%; between-group Q1=1; P=.32).

A statistically significant subgroup difference for attrition was present for 5 factors: presence of mood monitoring reminders, digital vs analogue mood monitoring, mood monitoring study or non-mood monitoring control, and study risk of bias. Studies with mood monitoring reminders had higher attrition (0.30%, 95% CI 0.22%-0.37%) than studies without mood monitoring reminders (0.27%, 95% CI 0.16%-0.38%; between-group Q2=56.80; P<.001). Analogue studies had higher attrition (0.40%, 95% CI 0.16%-0.64%) than digital studies (0.28%, 95% CI 0.21%-0.35%; between-group Q2=29.66; P<.001). Mood monitoring studies had higher attrition (0.29%, 95% CI 0.23%-0.36%) than non-mood monitoring control groups (0.09%, 95% CI 0.06%-0.12%; between-group Q2=31.94; P<.001).

There is likely an element of confounding by study design and protocol burden in these subgroup analyses, as studies with EMA reminders (n=23) reported a longer mean follow-up duration (mean 11.02, SD 8.5 months) than studies without EMA reminders (n=86; mean 7.48, SD 4.22 months).

There was no statistically significant difference in adherence nor attrition between active and passive mood monitoring (Figures S5 and S12 in Multimedia Appendix 2), in-person versus remote enrollment or recruitment (Figures S11 and S18 in Multimedia Appendix 2), and depression versus bipolar disorder (Figures S6 and S13 in Multimedia Appendix 2).

There were statistically significant subgroup differences in both adherence and attrition between studies deemed to have a high risk of bias (≤4 areas of low risk of bias as classified on the Cochrane risk of bias tool) versus those deemed to have a low risk of bias (5 or 6 areas of low risk of bias). High-risk studies had lower adherence (0.60%, 95% CI 0.53%-0.68%) than low-risk studies (0.70%, 95% CI 0.64%-0.76%; between-group Q1=3.93; P=.047). High-risk studies had higher attrition (0.38%, 95% CI 0.29%-0.46%) than low-risk studies (0.19%, 95% CI 0.14%-0.24%; between-group Q1=13.75; P<.001).

Metaregression

As the heterogeneity was very high, we conducted a metaregression to assess potential sources of this heterogeneity. We explored the effects of financial incentives, ambulatory assessment reminders, digital or analogue protocol, active or passive ambulatory assessment, gender, age, and ambulatory assessment duration on heterogeneity. The residual heterogeneity remained very high despite this, and the full results are reported in Table S4 in Multimedia Appendix 2.

Notably, active ambulatory assessments had a statistically significant higher attrition than nonambulatory assessment–based controls (odds ratio [OR] 1.23, 95% CI 1.00-1.51; P=.046). However, attrition rates for studies using both active and passive ambulatory assessments were not statistically significant compared with the control group (OR 1.14, 95% CI 0.92-1.42; P=.23). Likewise, attrition rates for passive ambulatory assessment studies were not statistically significantly different than the control groups (OR 1.23, 95% CI 0.97-1.57; P=.09). This suggests studies using just active ambulatory assessment measures may have a uniquely high burden for participants.

There was a statistically significant negative effect of ambulatory assessment duration on adherence rates (OR 0.99, 95% CI 0.99-1.00; P=.01), and adherence declined as assessment duration increased.

There was a statistically significant effect of the number of low-risk domains in a study leading to lower attrition (OR 0.94, 95% CI 0.90-0.98; P=.002) but not adherence (OR 1.02, 95% CI 0.98-1.07; P=.26).

Discussion

Summary of Findings

This meta-analysis examined long-term adherence and attrition in mood monitoring or ambulatory assessment studies by people with depression and bipolar disorder and, to our best knowledge, is the first review to do so. We documented larger improvements in attrition in digital studies than in analogue studies, in adherence in studies with financial incentives versus nonfinancial incentives, and increased attrition or decreased adherence in studies with mood monitoring reminders versus those without reminders. There was also improved adherence or attrition in higher-quality studies. Crucially, there were no differences in adherence and attrition between studies of passive and active mood monitoring, although active ambulatory assessments had higher attrition than non-mood monitoring controls. However, we noted there was a very high level of heterogeneity in the meta-analysis, with some evidence of publication bias, which may mean that studies showing no difference in attrition or adherence were not necessarily reported, and no clear picture has emerged from our results. The high heterogeneity was not due to the reasons explored in the metaregression: age, gender, assessment duration, active or passive assessment, digital or analogue, or assessment reminders or financial incentives. Reporting of adherence and attrition was not universal nor systematic, and until it is, analyses are unlikely to provide any clear conclusions.

Context of Findings

The mood monitoring adherence statistics we report here (many of which were EMA studies) are lower than those in studies of dropout and adherence with EMA protocols in both clinical and nonclinical populations [1197-99undefinedundefined]. They are also lower than the recommended rate of 80% for EMA studies [100]. Missing data, particularly higher than suggested recommended rates, can limit the conclusions that are drawn from statistical inference and have a significant effect on the study’s statistical power [98]. Furthermore, research suggests that missing data in EMA studies are not at random and thus more likely to introduce nonresponse bias—for example, participants are more likely to miss certain assessments at specific times (eg, when delivering childcare at a specific time in the evening) [101]. The rates of adherence reported here are thus concerning to the methodological validity of these mood monitoring studies, some of which are also EMA studies. This is further demonstrated by the higher attrition in mood monitoring groups when compared with non-mood monitoring controls, raising the question of whether mood monitoring is itself aversive.

The follow-up length that we assessed was also much longer than other studies and other reviews, and this may partially explain the lower adherence. Here, the average mood monitoring or ambulatory assessment protocol length was approximately 7 months, while many reviews have only assessed adherence over 7 days. Long-term studies generally demonstrate higher attrition than short-term studies [102]. Furthermore, clinical populations may have higher attrition rates and lower adherence than nonclinical populations. This is particularly true of people with mood disorders who can struggle with drive, motivation, and organization. The attrition rate was comparable to other studies of bipolar disorder [103] or depression and clinical trials of smartphone apps [104]. This was reassuring considering the increased participant burden reported in qualitative studies and suggests that mood monitoring studies, with regard to attrition and adherence, may not be particularly different or uniquely stressful than studies using established measures of assessment.

Protocol Design

Crucially, we did not demonstrate better adherence and attrition in passive mood monitoring studies than with active protocols. This was in contrast to qualitative research suggesting passive mood monitoring is preferred, as it is perceived as being less intrusive (and has less participation burden) by people with bipolar disorder and depression [6]. This may be due to people not adhering to or dropping out from mood monitoring studies for reasons other than the frequent completion of self-report measures. Some of these concerns driving nonadherence and dropout may be around data security, not feeling that they themselves are receiving a benefit, or the presence of adverse effects, as opposed to the type of mood monitoring or the way this is delivered [6105].

Financial incentives did not appear to affect attrition but were associated with improved adherence. This was in keeping with previous research with similar findings [11], finding 12% higher adherence if financial incentives were given (77%) compared with when financial incentives were not given (65%). This is a very large improvement in adherence, particularly over many months. There are, however, concerns that paying individuals to participate in research may exert undue influence and coercion [106] and potentially select individuals who are more motivated by the financial reward than the potential for digital technology to improve their mental disorder via mood monitoring or to contribute to research via ambulatory assessment—both of which likely require motivation and commitment [6]. This may thus create selection biases. This also may be especially problematic in studies where reward responsivity is being measured since financial incentives might be perceived as a reward and therefore a confounder. Participants should also be given the choice to not accept a financial reward if they choose; some people find such rewards coercive or forming an obligation when they wish to take part from free will.

Mood monitoring reminders were associated with increased attrition and decreased adherence. It is possible that a higher number of notifications and reminders increases participant burden and leads to dropout by some individuals or that those studies with more burdensome protocols also include reminders. There is likely an element of confounding by study design and protocol burden in these analyses. Furthermore, this is in contrast to other findings, where increased participant burden (eg, with active mood monitoring) was not associated with an increased dropout versus passive mood monitoring (which is often designed to minimize this burden). One possible explanation for the lack of difference in dropout despite an increased participant burden is that active mood monitoring directly asks the user their opinion and makes them aware of their mood versus passive monitoring, which sits in the background and provides no immediate feedback to the participant. This active feedback-driven process may compensate for the increased burden.

Reporting Standards

Reporting of attrition (60/77, 78% of studies) and adherence (57/77, 74% of studies) was low, suggesting that studies should report these metrics routinely, particularly considering the importance of these metrics to mood monitoring data validity. The number of studies reporting these metrics in the published manuscripts was even lower; we contacted a large number of authors individually to find much of this information, which was often difficult to locate in the first instance. Only a small minority of studies reported adherence in a systematic way from device data—most did not clarify the nature of the data they reported (eg, self-report adherence, objective app data).

Researchers have previously produced important guidelines on the reporting of mood monitoring data (eg, eMOOD guidelines [26]). Although these do report the importance of good adherence data, they do not mention the systematic underreporting of adherence and attrition statistics and provide no factual basis for the statement that adherence to mood monitoring is often low. The quantified evidence summarized here provides a basis for specific recommendations around the reporting of adherence and attrition data, which has previously been sparse. We suggest that preference be given to systematically collected device-level data that allow direct comparison between protocols. Acceptable attrition and adherence thresholds should be prespecified based on power calculations and the intended purpose of the ambulatory assessment. Power calculations for sample size should consider what effects acceptable attrition and adherence might have on outcome; power calculations without these considerations might then be considered incomplete and probably underpowered.

The reporting of attrition should be in accordance with CONSORT (Consolidated Standards of Reporting Trials) for randomized studies [107] and alternatives for nonrandomized studies [108]. This will allow researchers to assess attrition based on the number of participants enrolled or those with actual use of the ambulatory assessment, as these figures are likely to tell us different things and inform future studies in different ways. Researchers should report attrition based on the number of participants enrolled as an intention-to-treat analysis, as this will generate a more generalizable result for clinical practice. They should also report a per-protocol analysis of those who attempted to use the assessment as intended, as this will give an indication of attrition by those motivated and willing to undertake these assessments at the beginning of the study. These align with current guidelines for interventions in general in RCTs and nonrandomized studies. We make further broader recommendations incorporating a broad range of qualitative and quantitative evidence that puts poor adherence and attrition reporting in the wider ambulatory assessment or mood monitoring context [109].

Lower risk-of-bias studies had considerably less attrition and higher adherence. Higher-quality studies may be more rigorously conducted, and this may lead to improved follow-up rates and more participant-friendly protocols (eg, via more qualitative development of the protocol or lived experience input) to which it is easier to adhere. Therefore, the overall risk of bias of a study may be a marker of a higher-quality study that is less onerous for participants. These attrition and adherence results, even for high-quality studies, suggest that there is a high level of attrition and low level of adherence to data collection that are hard to address with methods that rely on longer-term active data collection alone. Further investigation on the optimal mix of methods of digital collection (eg, active and passive with optimal methods of support and reward) is merited .

Participant Engagement

Future mood monitoring studies with mood disorders should prioritize consistent reporting of adherence and attrition and use financial incentives to support participant engagement. This study failed to find a multitude of specific factors that improve attrition and adherence, aside from financial incentives and reminders (which surprisingly had a negative effect on adherence and attrition). This thus raises questions about additional methods of improving the acceptability and usability of these protocols. Many of these factors are likely to be protocol specific and will likely require lived experience input, qualitative research, and ethical implementation to create a protocol that has high acceptability and usability, particularly with long-term studies. Some mood monitoring protocols reported attrition as high as 92%, and others reported adherence as low as 18%. It remains unclear what is a realistic attrition or adherence rate for mood monitoring studies with people with mood disorders, and this may rarely reach the recommended 80%, particularly for individuals with a higher severity of illness.

Strengths and Limitations

The strengths of this review are that we evaluated studies using mood monitoring over a minimum period of 3 months. We argue that 3 months of follow-up was required to accurately assess mood, attrition, and adherence in a clinically meaningful way to assist the design of medium or long-term trials in the future. The average duration of follow-up was much longer than other reviews—approximately 7 months—a more clinically material length of time. We did not include many mood monitoring procedures that utilized shorter follow-up and are further away from implementation as interventions or as research tools. This allows us to make clear conclusions about mood monitoring methods that have the ability to affect the current delivery of mental health trials. One limitation of this review is that the vast majority of trials had issues with risk of bias, specifically around blinding of the intervention or mood monitoring procedure, but this is an issue with trials of psychological treatments more broadly where perfect blinding is not possible. We were also not able to include all studies in the meta-analysis due to underreporting of key data, which is in itself both a limitation and an important finding highlighting the lack of standardization in the reporting of key mood monitoring metrics. Furthermore, there was large statistical heterogeneity when aggregating data, and this reflects the heterogeneity of the wide-ranging mood monitoring protocols (eg, type of mood disorder, population, duration of mood monitoring, and intensity of mood monitoring); despite using a random-effects model, this may still limit the generalizability of our findings, mask important contextual differences, and limit the comparability of the summary estimates across studies. In addition, our analyses should not be interpreted causally due to these limitations, and they were vulnerable to confounding by study design and protocol burden.

Conclusions

To conclude, this meta-analysis examined long-term adherence and attrition in mood monitoring studies by people with mood disorders. Attrition and adherence were lower for people with bipolar disorder and depression than for other nonclinical or clinical populations but comparable to other non-mood monitoring studies with people with mood disorders. We demonstrated that some key factors may improve adherence and attrition (crucially, there were no differences in adherence and attrition between studies of passive and active mood monitoring), but the certainty of our findings is limited due to the lack of systematic and universal reporting of adherence and attrition in ambulatory assessment studies. These findings should inform the design of future mood monitoring protocols—prioritizing systematic and universal reporting of adherence and attrition—and be interpreted alongside qualitative findings to optimize real-world acceptability and utility. Until reporting of adherence and attrition improves, further analyses are unlikely to provide any clear conclusions.

Funding: This work was supported by a Wellcome Trust Fellowship to LAW. RM has received other National Institute of Health and Care Research (NIHR) funding for research on interventions for depression and bipolar disorder, including the lead for the Nottingham NIHR Biomedical Research Centre mental health and technology theme, the NIHR Applied Research Collaborations (ARC) East Midlands Mental Health and Well-being Theme, and the NIHR MindTech Health Technology Collaborative.

Authors’ Contributions: Conceptualization: LAW, RMFormal analysis: LAW, JR, BGInvestigation: LAW, JRWriting – original draft: LAWWriting – review & editing: LAW, RM, JM, BG

Conflicts of Interest: RM has received funding from Novartis to serve on a data management and ethics committee for two trials on the treatment of depression.