Skip to main content

Predictors of remission from body dysmorphic disorder after internet-delivered cognitive behavior therapy: a machine learning approach

Abstract

Background

Previous attempts to identify predictors of treatment outcomes in body dysmorphic disorder (BDD) have yielded inconsistent findings. One way to increase precision and clinical utility could be to use machine learning methods, which can incorporate multiple non-linear associations in prediction models.

Methods

This study used a random forests machine learning approach to test if it is possible to reliably predict remission from BDD in a sample of 88 individuals that had received internet-delivered cognitive behavioral therapy for BDD. The random forest models were compared to traditional logistic regression analyses.

Results

Random forests correctly identified 78% of participants as remitters or non-remitters at post-treatment. The accuracy of prediction was lower in subsequent follow-ups (68, 66 and 61% correctly classified at 3-, 12- and 24-month follow-ups, respectively). Depressive symptoms, treatment credibility, working alliance, and initial severity of BDD were among the most important predictors at the beginning of treatment. By contrast, the logistic regression models did not identify consistent and strong predictors of remission from BDD.

Conclusions

The results provide initial support for the clinical utility of machine learning approaches in the prediction of outcomes of patients with BDD.

Trial registration

ClinicalTrials.gov ID: NCT02010619.

Peer Review reports

Background

Body dysmorphic disorder (BDD) has an estimated prevalence of about 2% [1, 2] in the general population, and is characterized by a distressing and impairing preoccupation with perceived defects or flaws in physical appearance that are not noticeable, or only appear slight to others [3]. Thoughts about the disliked body parts are perceived as intrusive, difficult to control and time consuming, leading to a disproportionate preoccupation [4]. Insight about the perceived defects varies on a continuum from fair to delusional, but is typically poor [5, 6]. Another hallmark of BDD is the presence of repetitive behaviours (such as compulsive mirror gazing, excessive grooming or camouflaging of disliked body areas) in an attempt to hide or control the perceived defects [3]. BDD is associated with occupational impairment [7], suicidality [8], and reduced quality of life [9].

Evidence-based treatments for BDD include selective serotonin re-uptake inhibitors (SSRIs) and cognitive behavioural therapy (CBT). Both treatment modalities are recommended in clinical guidelines [10] (published in 2005 and about to be updated) but the current evidence does not allow clinicians to decide which patients should be offered which treatment or whether they should be offered both. Furthermore, while these treatments are efficacious, outcomes are relatively modest, with few patients achieving remission and many requiring long-term treatment. For example, a recent meta-analysis of CBT studies indicated that only 40—54% of patients enrolling in these trials were classified as treatment responders [11], which is lower than CBT for obsessive-compulsive disorder where response rates are 62–68% [12].

Identification of reliable predictors of treatment outcome would potentially help guide clinical decision making and reduce the number of treatment failures. In a scenario where the prediction model indicates a low probability of treatment success, a patient could be offered an alternative or adjunct treatment option, or receive additional support from their therapist. Co-morbid depression, high baseline severity of BDD symptoms, and longer duration of BDD, have been found to predict outcomes of CBT for BDD in some studies [13, 14], but a recent meta-analysis on CBT for BDD [11] did not find any predictors that consistently predicted outcomes across studies. One possible explanation for these previous mixed results could be that previous studies have used stepwise regression models. Stepwise regression models are prone to bias in regression coefficients [15] and are therefore not recommended for prediction in psychiatric research. Despite these limitations, stepwise regression is the most common statistical technique used for prediction (but see [16] for a comprehensive review and guide to prediction in psychiatry).

One way to increase statistical precision and improve clinical utility could be to use machine learning techniques [17]. Machine learning uses an iterative approach where the statistical model is evaluated in small subsets of the available data to maximize predictive power. One specific machine learning technique is the random forest algorithm, which can detect and aggregate weak predictors in its statistical model without assumptions of normal distribution [18, 19]. Such techniques can make use of more of the available data compared to regression models, and are therefore ideal when there are many potential predictors relative to the number of participants. Random forests have been used in the prediction of time in remission from obsessive-compulsive disorder with an error rate of 25% [20]. Researchers have evaluated four different machine learning methods in the prediction of response to Internet-based CBT (ICBT) for obsessive-compulsive disorder in children and adolescents, with 75 to 83% accuracy (the proportion of correct classifications) [21]. Similarly, a combined model of random forest and elastic net algorithms consistently outperformed a traditional linear regression model when predicting results after ICBT for depression [22]. These initial results are encouraging and machine learning algorithms such as random forests are yet to be applied to outcome prediction in BDD.

This study reports on a secondary analysis of data from a recent clinical trial investigating the efficacy of ICBT for adults with BDD [23, 24]. We used random forests machine learning approaches to identify predictors of remission from BDD immediately after treatment and at various follow-up points. For comparison purposes, we also employed traditional logistic regression models. Remission status was chosen as the outcome of interest because it can be assessed in a standardised way and represents a large improvement in well-being that is meaningful for patients. Candidate predictor variables included demographic characteristics, clinical characteristics of BDD and co-occuring disorders, and treatment-related characteristics.

Methods

Study design

We used data from a previously published RCT [23, 24], registered at ClinicalTrials.gov (no. NCT02010619), in which 94 participants with a primary diagnosis of BDD were randomized to either BDD-NET (n = 47) or online supportive therapy (n = 47) for 12 weeks. Participants who had received supportive therapy were offered BDD-NET after the controlled three month follow-up, which 41/47 (87%) participants accepted. Predictor analyses were thus conducted on the entire sample that received BDD-NET (n = 88). Outcome data was gathered at post-treatment, 3-month follow-up, 12-month follow-up, and 24 months after treatment with BDD-NET. For a detailed description of recruitment, participants and procedures of the trial, please refer to the original publications [23, 24].

Participants

All participants had a principal diagnosis of BDD according to the DSM-5, and a score of at least 20 on the modified Yale-Brown Obsessive-Compulsive Scale (BDD-YBOCS) [25]. Exclusion criteria were psychotropic medication changes within 2 months prior to enrolment, completion of CBT for BDD within the last 12 months, current substance dependence, a history of bipolar disorder or psychosis, acute suicidal ideation, a severe personality disorder that could jeopardize treatment participation (e.g., borderline personality disorder with self-harm), or concurrent psychological treatment.

Predicting variables

Available predictor variables included demographic characteristics, clinical characteristics of BDD and co-occuring disorders, and treatment-related characteristics.

Potential demographic predictors were gender, age, level of education, occupational status, marital status, and whether participants had children or not.

Clinical characteristics were assessed by both clinicians and participants themselves. Clinicians diagnosed BDD using the structured clinical interview for DSM-IV axis I disorders with an added question about repetitive behaviors to reflect updates to the diagnostic criteria of BDD in DSM-5 (SCID-I), and used the Mini International Diagnostic Interview (MINI [26];) to determine whether comorbid conditions were present. Clinicians also assessed BDD symptom severity using the BDD-YBOCS [25], level of insight (good, poor, or delusional), clinical severity using the clinical global impression scale (CGI [27];), and overall level of functioning (GAF [3];). Participants self-reported depressive symptoms on the Montgomery Åsberg Depression Rating Scale (MADRS-S [28];), quality of life on the EuroQol 5-dimensions (EQ-5D [29];), body areas of concern, duration of BDD, medication with antidepressants, whether they had received previous psychological treatment for BDD, had been in contact with secondary psychiatric care (for any reason), or had undergone previous plastic surgery.

Therapy-related predictors included participant-rated treatment credibility and expectancy of improvement with the Credibility Scale (C-scale [30];) at week 2 post-baseline, and working alliance (i.e. agreement on goals, experiencing the therapist as supportive) according to the working alliance inventory short-revised (WAI-SR [31];) at week 2 in treatment. At the end of treatment, participants reported the overall time spent on the treatment. The treating therapists reported the number of completed modules.

Definition of remission

Based on international expert consensus criteria, remission was defined as no longer fulfilling DSM-5 diagnostic criteria for BDD at the follow-up assessment [32].

Procedure

Interested individuals registered for the study online and answered a screening questionnaire (demographic variables and clinical characteristics) and MADRS-S via the online platform. Trained assessors then conducted telephone interviews to establish the diagnosis of BDD using the SCID-I and co-morbid conditions using MINI, and rated BDD symptom severity (BDD-YBOCS), clinical severity on the clinical global impression scale (CGI), global assessment of functioning (GAF), and criteria for inclusion and exclusion before enrolment in treatment. At week 2 in treatment, participants rated treatment credibility (C-scale) and working alliance (WAI-SR). At post-treatment and follow-up (3, 12, and 24 months after treatment with BDD-NET) trained assessors conducted telephone assessments similar to the baseline assessment. Self-reported measures (MADRS-S, EQ-5D) were administered using the online platform. Both telephone assessments and self-report measures via the internet have been found to be reliable and valid administration formats [33,34,35].

Treatment

Therapist guided internet-based cognitive behavioural therapy for body dysmorphic disorder (BDD-NET) was delivered via a tailored online platform using a dedicated hospital server with encrypted traffic and a two-factor authentication (password and single-use code sent via SMS) to guarantee participant confidentiality. The treatment lasted 12-weeks, and none of the participants had any face-to-face contact with a therapist. BDD-NET consists of self-help texts and worksheets that are delivered in eight interactive modules, each devoted to a certain theme. The BDD-NET modules are: 1) psychoeducation, 2) a CBT model for BDD, 3) cognitive restructuring, 4–5) exposure and response prevention and its application, 6) values-based behavior change, 7) difficulties encountered during treatment, and 8) relapse prevention plan. Throughout the treatment, the participant had unlimited access to an identified therapist that could be contacted at any time through the platform’s built in message system. The BDD-NET treatment protocol has been validated in a pilot trial [36], and was shown to be efficacious in the randomized controlled trial on which the current study is based [23], with gains maintained at 2-year follow-up [24].

Statistical analyses

The random forest classification model was estimated using 10-fold cross-validation with 10 repeats to increase model stability [37]. In 10-fold cross-validation, the model is trained on 90% of the data and evaluated on the remaining 10%. The procedure is repeated for each of the 10 folds and the receiver operating characteristic (sensitivity and specificity) are averaged across repetitions. Random forest classifications were fitted using a maximum of 500 trees and varying the number of predictors used for each split. In random forests, multiple decision trees are created using a random subset of predictors, where the predictor—and its optimal cut-point—that minimizes classification error is chosen at each split. The final model was selected based on the receiver operating characteristic and evaluated by comparing the probability of remission from BDD estimated from the model to the actual remission or non-remission for each patient. Variable importance in the random forest models was determined by their effect on the overall accuracy of the model; more important variables resulted in a bigger accuracy gain when included. The effects of the eight most important individual predictors was investigated using partial dependence plots, where the association between different values of the predictor and the probability of remission is plotted while holding all other predictors constant at their mean value.

For the logistic regression analyses, we first fitted each predictor variable separately in univariate analyses. Predictors with p < .05 were then included in a multiple logistic regression, where we report odds ratios of remission versus non-remission for predictors with p < .05. An odds ratio below 1 means lower odds of remission, while an odds ratio higher than 1 indicates higher odds of remission. This procedure is similar to previous work in internet-delivered cognitive behavioural therapy [38].

Predictor variables with high collinearity and with near zero variance were removed prior to modelling, because including them would have made the logistic regression models unstable and provided an unfair advantage for the random forest algorithms. Included variables are marked with an asterisk in Table 1. Missing data was imputed using random forests in the missForest package [39]. Scripts for data preparation and statistical analyses, as well as detailed results from the random forest and regression analyses, are available on the Open Science Framework (https://osf.io/fu5sj/). We used R version 3.5.3 [40] for all statistical analyses.

Table 1 Characteristics of study participants used for prediction

Results

The characteristics of the study participants at baseline and rates of remitted patients at post-treatment and follow-up are presented in Table 1. The sample was predominantly female, highly educated and working or studying. On average, they had had BDD symptoms for over 18 years and their BDD was in the moderately severe range at the time of participation. Slightly over half the sample had good insight. The most common current comorbid condition was depression (50% of participants). The majority of participants had had previous contact with psychiatric services, though few had received evidence-based treatment for BDD. The rates of participants in remission increased from 31% at post-treatment to 60% at 24-month follow-up (bottom of Table 1).

Predictors at post-treatment

Twenty-seven patients or 31% of the sample were in remission at post-treatment. The random forest model correctly classified 78% of cases. Partial dependence plots for the eight most important predictors of remission status at post-treatment are shown in Fig. 1. Treatment credibility (Credibility scale) and working alliance (WAI-SR) rated at week 2 in treatment had a positive linear relationship with probability of remission, i.e. a higher score on these measures were associated with a higher probability of remission. Conversely, depressive symptoms (MADRS-S) and BDD symptoms (BDD-YBOCS) were negatively associated with probability of remission. The supplementary materials (https://osf.io/fu5sj/) include partial dependence plots for the most important predictors at follow-up.

Fig. 1
figure 1

Partial dependence plots for remission status at post-treatment. Observed values (black) and LOESS-smoothing (blue) show the effect of each predictor variable when all other predictors are held constant at their mean value. Abbreviations: WAI-SR, Working alliance inventory short-revised; MADRS-S, Montgomery-Åsberg depression rating scale-self report; BDD-YBOCS, Yale-Brown obsessive compulsive scale modified for BDD; GAF, Global assessment of functioning

The univariate logistic regression analyses identified 7 significant predictors, but only MADRS-S remained significant in the multivariate analysis (OR = 0.91 [95% CI 0.81–1], p = 0.041) after stepwise selection.

Predictors at follow-up

Thirty-seven (42%) patients were in remission at the 3-month follow-up. The random forest model correctly classified 68% of cases. Treatment credibility, WAI-SR, MADRS-S and years with BDD were still among the most important variables. The univariate logistic regression analyses identified 8 predictive variables, but but only treatment credibility (C-scale) remained significant in the multivariate analysis (OR = 1.1 [95% CI 1.02–1.18], p = 0.019) after stepwise selection.

Fourty-one (47%) patients were in remission at the 12-month follow-up. The random forest model correctly classified 66% of cases. The most important predictor variable was treatment credibility. WAI-SR, MADRS-S, and BDD-YBOCS—all previously identified—were other important predictors. In the logistic regression, 8 variables passed the p < .05 threshold in univariate analyses. Treatment credibility (OR = 1.11 [1.04–1.19], p = 0.004) and spending at least 2 h per week on the treatment (OR = 10.99 [9.18–12.8], p = 0.009) remained statistically significant in the stepwise multivariate analysis.

Lastly, at the 24-month follow-up, 53 (60%) patients were in remission and the random forest model correctly classified 61% of cases. The most important predictor variables were MADRS-S, treatment credibility, number of body areas of concern, and BDD-YBOCS. In the logistic regression analyses, 6 variables reached statistical significance in the univariate model but only one remained statistically significant in the stepwise multivariate model: having children was associated with a higher probability of being in remission (OR = 3.59 [2.5–4.69], p = 0.022).

The random forest models were, in general, relatively more sensitive to detecting remitters than they were specific to correctly classifying non-remitters. The exception is at the 24-month follow-up, where the random forest model had high specificity at the expense of sensitivity (see Table 2). Figure 2 depicts model performance in terms of true and false positive rates at various thresholds for estimated probability of remission. The overall performance of the model can then be summarized as the area under the receiver operating characteristics curve (AUC) and compared to chance performance (dashed lines). AUC at post treatment was 0.78 and decreased over time (0.76, 0.73, and 0.63 at subsequent follow-ups), indicating that baseline predictor variables have less predictive power over time.

Table 2 Performance metrics of random forest models
Fig. 2
figure 2

ROC-curves for random forest models. True positive and false positive rates at various thresholds

Discussion

The results in this study indicated that a machine learning random forest algorithm could correctly detect 78% of participants as remitters or non-remitters at post-treatment. Although this accuracy was lower in the subsequent follow-ups, the model did still show acceptable predictive power compared to the traditional stepwise regression approach. The most important predictors were depressive symptoms, treatment credibility, working alliance, and initial severity of BDD. In general, the model was better able to detect true remitters and correctly classifying non-remitters. Although this was only a first ‘proof-of-concept’ study, the reults are encouraging and provide initial support for the use of machine learning algorithms to guide clinical decision making and approach personalized care for adults with BDD.

Depressive symptoms, measured using the MADRS-S, were consistently among the most important predictors in the random forest models. Previous trials of CBT for BDD using a questionnaire to measure depressive symptoms have found the same pattern [14], although a recent meta-analysis did not find that percentage of participants with diagnosed depression or antidepressant medication predicted results across trials [11]. Whether depression is measured by depressive symptoms on a severity scale or using a diagnosis of depression could explain the conflicting results; we found that symptoms—but not diagnosis—of depression was an important predictor, which is in line with previous findings [13, 14]. Our preliminary results point to the need for further treatment optimization for patients with co-morbid depressive symptoms, for example by adding specific modules targeting depressive symptoms in BDD-NET, or considering concurrent pharmacological treatment with antidepressants, for those that need it.

Our results also indicate that baseline severity and chronicity of BDD need to be taken into account. Baseline symptoms of BDD (BDD-YBOCS), number of body areas of concern, and years with BDD emerged as important predictors at every time-point. Initial severity and chronicity of BDD is an important part of the assessment prior to treatment selection, and the results are in line with [14], who found that BDD patients referred from secondary or tertiary care were less likely to respond to treatment. Similar observations were made in the early computerized CBT literature, e.g. in anxiety and mood disorders [41]. Level of insight into BDD was not an important predictor of remission, which is surprising given that insight is often cited as an important part of the assessment prior to CBT for BDD. However, individuals with low insight do not differ from individuals with adequate insight on most demographic and clinical characteristics [42]. Taken together, our results provide support for the idea of using ICBT for mild to moderate cases of BDD in a stepped-care model, where more severe cases receive other, more intensive interventions.

Treatment-related factors such as working alliance and treatment credibility may also be more important than demographic characteristics in the prediction of remission after ICBT for BDD. Both working alliance (WAI-SR) and treatment credibility (C-scale) emerged as important predictors at all time-points. Conversely, demographic characteristics were not important predictors of remission from BDD at any time-point. Similarly, the number of completed modules did not emerge as an important predictor at any time-point. It should be noted, however, that most participants completed the core modules that introduced exposure with response prevention, and may have continued to practice this technique despite not progressing to subsequent treatment modules. This indicates that success in ICBT for BDD is more likely to be determined by whether the user experiences the treatment as credible and the alliance with their therapist as positive, and that it is potentially helpful regardless of gender, age, family status, level of education or current occupational status.

Some limitations should be mentioned. First, the original randomized controlled trial consisted of self-referred patients with relatively good insight. Our sample differs slightly from previous trials of CBT for BDD, namely that participants in other clinical trials on BDD, on average, had higher levels of depressive symptoms [43, 44]. Second, although our sample size was relatively large, it was not large enough to divide into training and testing sub-samples that further decrease the possibility of false positive findings. Other measures were taken to reduce the risk of false positives, such as repeated cross-validation and averaging results across repeated models. Third, 41 of the 88 participants had received the supportive therapy control treatment before BDD-NET making the study sample more heterogeneous, as well as introducing potential additive effects after two bouts of treatment. However, only one individual was in remission after supportive therapy and of the 47 individuals initially randomised to supportive therapy 41 accepted BDD-NET as additional treatment [23]. Fourth, we do not know if these results will generalize to other treatment modalities for BDD, or whether integrating other sources of data, such as detailed platform usage, could potentially improve predictive accuracy.

Directions for future research include validating the use of machine learning algorithms in larger samples, developing algorithms that can guide clinical decision making (for example deciding between several available treatment options), and to integrate other kinds of data, e.g. genetic markers in the predictive models. Another suggestion for future research would be to do an experimental test of the clinical utility of machine learning prediction models. For example, patients could be randomized to either treatment as usual or a machine-learning-guided condition where patients at high-risk of non-remission are detected early using machine learning algorithms and offered additional treatment to maximize the chances of remission.

Conclusions

The results of this proof-of-concept study show that machine learning algorithms such as random forests can be potentially useful to distinguish remitters from non-remitters after ICBT for BDD and provide initial support for the utility of machine learning techniques in personalized care in the treatment of BDD. Experimental designs testing these novel prediction models are needed.

Availability of data and materials

The datasets analysed during the current study are not publicly available since they contain sensitive personal identifying information and data sharing was not part of the written informed consent, but are available from the corresponding author on reasonable request. The scripts used for statistical analyses and additional materials are publicly available at (https://osf.io/fu5sj/).

Abbreviations

AUC:

Area under the receiver operating characteristics curve

BDD:

Body dysmorphic disorder

BDD-NET:

Therapist guided internet-based cognitive behavioural therapy for body dysmorphic disorder

BDD-YBOCS:

Yale-Brown obsessive compulsive scale modified for BDD

CBT:

Cognitive behaviour therapy

CGI:

Clinical global impression scale

C-scale:

Treatment credibility scale

DSM-5:

Diagnostic and Statistical Manual of Mental Disorders, fifth edition

EQ-5D:

EuroQol 5-dimensions

GAF:

Global assessment of functioning

ICBT:

Internet-based cognitive behaviour therapy

MADRS-S:

Montgomery-Åsberg depression rating scale-self report

MINI:

Mini International Diagnostic Interview

OCD:

Obsessive-compulsive disorder

RCT:

Randomised controlled trial

ROC:

Receiver-operator characteristics

SSRI:

Selective serotonin reuptake inhibitor

WAI-SR:

Working alliance inventory short-revised

References

  1. Brohede S, Wijma K, Wingren G, Wijma B. Prevalence of body dysmorphic disorder among Swedish women: a population-based study. Compr Psychiatry. 2015;58:108–15.

    Article  PubMed  Google Scholar 

  2. Veale D, Gledhill LJ, Christodoulou P, Hodsoll J. Body dysmorphic disorder in different settings: a systematic review and estimated weighted prevalence. Body Image. 2016;18:168–86.

    Article  PubMed  Google Scholar 

  3. American Psychiatric Association, editor. Diagnostic and statistical manual of mental disorders. 5th ed: American Psychiatric Association; 2013.

  4. Brohede S, Wijma B, Wijma K, Blomberg K. “I will be at death’s door and realize that I’ve wasted maybe half of my life on one body part”: the experience of living with body dysmorphic disorder. Int J Psychiatry Clin Pract. 2016;20:191–8.

    Article  PubMed  Google Scholar 

  5. Phillips KA, McElroy SL, Keck PE Jr, Hudson JI, Pope HG Jr. A comparison of delusional and nondelusional body dysmorphic disorder in 100 cases. Psychopharmacol Bull. 1994;30:179–86.

    CAS  PubMed  Google Scholar 

  6. Phillips KA. Psychosis in body dysmorphic disorder. J Psychiatr Res. 2004;38:63–72.

    Article  PubMed  Google Scholar 

  7. Didie ER, Menard W, Stern AP, Phillips KA. Occupational functioning and impairment in adults with body dysmorphic disorder. Compr Psychiatry. 2008;49:561–9.

    Article  PubMed  Google Scholar 

  8. Angelakis I, Gooding PA, Panagioti M. Suicidality in body dysmorphic disorder (BDD): a systematic review with meta-analysis. Clin Psychol Rev. 2016;49:55–66.

    Article  PubMed  Google Scholar 

  9. Phillips KA, Menard W, Fay C, Pagano ME. Psychosocial functioning and quality of life in body dysmorphic disorder. Compr Psychiatry. 2005;46:254–60.

    Article  PubMed  PubMed Central  Google Scholar 

  10. National Institute for Clinical Excellence. Obsessive-compulsive disorder: Core interventions in the treatment of obsessive-compulsive disorder and body dysmorphic disorder; 2005.

    Google Scholar 

  11. Harrison A, Fernández de la Cruz L, Enander J, Radua J, Mataix-Cols D. Cognitive-behavioral therapy for body dysmorphic disorder: a systematic review and meta-analysis of randomized controlled trials. Clin Psychol Rev. 2016;48:43–51.

    Article  PubMed  Google Scholar 

  12. Öst L-G, Havnen A, Hansen B, Kvale G. Cognitive behavioral treatments of obsessive–compulsive disorder. A systematic review and meta-analysis of studies published 1993–2014. Clin Psychol Rev. 2015;40:156–69.

    Article  PubMed  Google Scholar 

  13. Phillips KA, Menard W, Quinn E, Didie ER, Stout RL. A 4-year prospective observational follow-up study of course and predictors of course in body dysmorphic disorder. Psychol Med. 2013;43:1109–17.

    Article  CAS  PubMed  Google Scholar 

  14. Veale D, Miles S, Anson M. Long-term outcome of cognitive behavior therapy for body dysmorphic disorder: a naturalistic case series of 1 to 4 years after a controlled trial. Behav Ther. 2015;46:775–85.

    Article  PubMed  Google Scholar 

  15. Steyerberg EW, Eijkemans MJC, Habbema JDF. Stepwise selection in small data sets: a simulation study of bias in logistic regression analysis. J Clin Epidemiol. 1999;52:935–42.

    Article  CAS  PubMed  Google Scholar 

  16. Fusar-Poli P, Hijazi Z, Stahl D, Steyerberg EW. The science of prognosis in psychiatry: a review. JAMA Psychiatry. 2018;75:1289–97.

    Article  PubMed  Google Scholar 

  17. Hahn T, Nierenberg AA, Whitfield-Gabrieli S. Predictive analytics in mental health: applications, guidelines, challenges and perspectives. Mol Psychiatry. 2017;22:37–43.

    Article  CAS  PubMed  Google Scholar 

  18. Biau G. Analysis of a random forests model. J Mach Learn Res. 2012;13:1063–95.

    Google Scholar 

  19. Malley JD, Kruppa J, Dasgupta A, Malley KG, Ziegler A. Probability machines: consistent probability estimation using nonparametric learning machines. Methods Inf Med. 2012;51:74–81.

    Article  CAS  PubMed  Google Scholar 

  20. Askland KD, Garnaat S, Sibrava NJ, Boisseau CL, Strong D, Mancebo M, et al. Prediction of remission in obsessive compulsive disorder using a novel machine learning strategy. Int J Methods Psychiatr Res. 2015;24:156–69.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Lenhard F, Sauer S, Andersson E, Månsson KN, Mataix-Cols D, Rück C, et al. Prediction of outcome in internet-delivered cognitive behaviour therapy for paediatric obsessive-compulsive disorder: a machine learning approach. Int J Methods Psychiatr Res. 2018;27:e1576.

    Article  Google Scholar 

  22. Pearson R, Pisner D, Meyer B, Shumake J, Beevers CG. A machine learning ensemble to predict treatment outcomes following an internet intervention for depression. Psychol Med. 2018;1:1–12.

    Google Scholar 

  23. Enander J, Andersson E, Mataix-Cols D, Lichtenstein L, Alström K, Andersson G, et al. Therapist guided internet based cognitive behavioural therapy for body dysmorphic disorder: single blind randomised controlled trial. BMJ. 2016;1:i241.

    Article  Google Scholar 

  24. Enander J, Ljótsson B, Anderhell L, Runeborg M, Flygare O, Cottman O, et al. Long-term outcome of therapist-guided internet-based cognitive behavioural therapy for body dysmorphic disorder (BDD-NET): a naturalistic 2-year follow-up after a randomised controlled trial. BMJ Open. 2019;9:e024307.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Phillips KA, Hollander E, Rasmussen SA, Aronowitz BR, DeCaria C, Goodman WK. A severity rating scale for body dysmorphic disorder: development, reliability, and validity of a modified version of the Yale-Brown obsessive compulsive scale. Psychopharmacol Bull. 1997;33:17–22.

    CAS  PubMed  Google Scholar 

  26. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-international neuropsychiatric interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(Suppl 20):22–33 quiz 34–57.

    PubMed  Google Scholar 

  27. Guy W. ECDEU assessment manual for psychopharmacology. Rockville: US Department of Health, Education, and Welfare, Public Health Service, Alcohol, Drug Abuse, and Mental Health Administration; 1976.

    Google Scholar 

  28. Svanborg P, Åsberg M. A new self-rating scale for depression and anxiety states based on the comprehensive psychopathological rating scale. Acta Psychiatr Scand. 1994;89:21–8.

    Article  CAS  PubMed  Google Scholar 

  29. Rabin R, de Charro F. EQ-SD: a measure of health status from the EuroQol group. Ann Med. 2001;33:337–43.

    Article  CAS  PubMed  Google Scholar 

  30. Borkovec TD, Nau SD. Credibility of analogue therapy rationales. J Behav Ther Exp Psychiatry. 1972;3:257–60.

    Article  Google Scholar 

  31. Hatcher RL, Gillaspy JA. Development and validation of a revised short version of the working alliance inventory. Psychother Res. 2006;16:12–25.

    Article  Google Scholar 

  32. Fernández de la Cruz L, Enander J, Rück C, Wilhelm S, Phillips KA, Steketee G, et al. Empirically defining treatment response and remission in body dysmorphic disorder. Psychol Med. 2019;1:1–7.

    Article  Google Scholar 

  33. Coles ME, Cook LM, Blake TR. Assessing obsessive compulsive symptoms and cognitions on the internet: evidence for the comparability of paper and internet administration. Behav Res Ther. 2007;45:2232–40.

    Article  PubMed  Google Scholar 

  34. Enander J, Andersson E, Kaldo V, Lindefors N, Andersson G, Rück C. Internet administration of the dimensional obsessive-compulsive scale: a psychometric evaluation. J Obsessive Compuls Relat Disord. 2012;1:325–30.

    Article  Google Scholar 

  35. Rohde P, Lewinsohn PM, Seeley JR. Comparability of telephone and face-to-face interviews in assessing Axis I and II disorders. Am J Psychiatry. 1997;154:1593–8.

    Article  CAS  PubMed  Google Scholar 

  36. Enander J, Ivanov VZ, Andersson E, Mataix-Cols D, Ljótsson B, Rück C. Therapist-guided, internet-based cognitive-behavioural therapy for body dysmorphic disorder (BDD-NET): a feasibility study. BMJ Open. 2014;4:e005923.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Kim J-H. Estimating classification error rate: repeated cross-validation, repeated hold-out and bootstrap. Comput Stat Data Anal. 2009;53:3735–45.

    Article  Google Scholar 

  38. de Graaf LE, Hollon SD, Huibers MJH. Predicting outcome in computerized cognitive behavioral therapy for depression in primary care: a randomized trial. J Consult Clin Psychol. 2010;78:184–9.

    Article  PubMed  Google Scholar 

  39. Stekhoven DJ, Buhlmann P. MissForest–non-parametric missing value imputation for mixed-type data. Bioinformatics. 2012;28:112–8.

    Article  CAS  PubMed  Google Scholar 

  40. R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2018. https://www.R-project.org/.

    Google Scholar 

  41. Mataix-Cols D, Marks IM. Self-help with minimal therapist contact for obsessiveCompulsive disorder: a review. Eur Psychiatry. 2006;21:75–80.

    Article  PubMed  Google Scholar 

  42. Phillips KA, Menard W, Pagano ME, Fay C, Stout RL. Delusional versus nondelusional body dysmorphic disorder: clinical features and course of illness. J Psychiatr Res. 2006;40:95–104.

    Article  CAS  PubMed  Google Scholar 

  43. Wilhelm S, Phillips KA, Didie E, Buhlmann U, Greenberg JL, Fama JM, et al. Modular cognitive-behavioral therapy for body dysmorphic disorder: a randomized controlled trial. Behav Ther. 2014;45:314–27.

    Article  PubMed  Google Scholar 

  44. Veale D, Anson M, Miles S, Pieta M, Costa A, Ellison N. Efficacy of cognitive behaviour therapy versus anxiety Management for Body Dysmorphic Disorder: a randomised controlled trial. Psychother Psychosom. 2014;83:341–53.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to express their gratitude to the study participants and clinicians involved, they made this research possible.

Funding

OF was supported by Karolinska Institutet (Clinical Scientist Training Programme) and received funding from Thuringstiftelsen (no. 2018–00390) during the conduct of the study. Funding sponsors did not influence the design, collection, analysis, or interpretation of data, writing the manuscript, or the decision to submit the manuscript for publication. Open access funding provided by Karolinska Institute.

Author information

Authors and Affiliations

Authors

Contributions

JE and CR designed the randomized controlled trial on which this study is based. OF analyzed the data and drafted the manuscript, which JE, EA, BL, VZI, DMC, and CR revised for important intellectual content. OF and CR have full access to the data and are accountable for the accuracy and integrity of statistical analyses. All authors approved the final version of the manuscript for publication.

Corresponding author

Correspondence to Oskar Flygare.

Ethics declarations

Ethics approval and consent to participate

The regional ethical review board in Stockholm approved the protocol (registration ID: 2013/1773–31/4) for the clinical trial from where data is analyzed. All participants gave written informed consent.

Consent for publication

Not applicable.

Competing interests

DMC reports personal fees from Elsevier and personal fees from UpToDate, Inc., outside the submitted work. The other authors declare no potential conflicts of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Flygare, O., Enander, J., Andersson, E. et al. Predictors of remission from body dysmorphic disorder after internet-delivered cognitive behavior therapy: a machine learning approach. BMC Psychiatry 20, 247 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s12888-020-02655-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12888-020-02655-4

Keywords