Skip to main content
  • Research article
  • Open access
  • Published:

A test of the goodness of fit of the generic metacognitive model of psychopathology symptoms

Abstract

Background

Common mental disorders such as depression and anxiety frequently co-occur and may share etiological mechanisms. The metacognitive model is based on the principle that there are common pathological mechanisms across disorders that account for comorbidity and therefore can be conceptualized in one generic model. A central prediction of the model is that particular metacognitive beliefs concerning the value of worry, and the uncontrollability and danger of cognition are positively correlated with psychopathology symptoms. In the present study, we set out to test the overall fit of this model by assessing generic metacognitive beliefs and judgements of attention control capacity as predictors of common and frequently co-occurring emotional distress symptoms.

Methods

In a cross-sectional design, 645 participants gathered at convenience completed a battery of self-report questionnaires.

Results

Structural equation modelling indicated a good model fit for the generic metacognitive model, and the predictors accounted for 93% of the variance in distress consisting of depression-, generalized- and social anxiety symptoms.

Conclusions

This finding supports the generic model and the implication that it can be used as a basis to formulate and treat multiple presenting problems.

Peer Review reports

Background

Evidence-based guidelines for mental disorders, such as those provided by the National Institute for Health and Care Excellence (NICE), are based on official classification systems that assume psychopathology can be defined as categorical constructs that are distinct and independent from other constructs. This has led to a collection of specific treatments for specific disorders. For example, specific and distinct variants of cognitive-behavioural therapy (CBT) are recommended as the treatment of choice for major depressive disorder [1] generalized anxiety disorder [2] and social anxiety disorder [3].

The validity of psychopathology categories has been extensively criticized [4] and it has been suggested based on the literature on information processing styles in anxiety and depression that similarities rather than differences should be emphasized in conceptualization and treatment of common mental disorders [5]. More recently, the idea of common factors is supported by research that shows high rates of comorbidity [6], that a substantial proportion of patients do not respond to the recommended disorder-specific treatments [7,8,9], and that specific mental disorders seem to be manifestations of broader underlying trait dimensions [10,11,12]. A transdiagnostic approach to conceptualization of psychopathology and psychological vulnerability has therefore been suggested as a potential solution.

One perspective that has advanced our understanding of transdiagnostic factors implicated in emotional disorders is the Self-Regulatory Executive Function (S-REF) model [5, 13] also known as the metacognitive model of psychological disorders [14]. This model grew out of dissatisfaction with how psychotherapeutic models did not capture important common aspects of maladaptive thinking found in most disorders and the factors that might control it [5].

The metacognitive model identified a general negative style of thinking across psychological disorders, called the Cognitive Attentional Syndrome [5]. The CAS is comprised of perseverative thinking, predominantly worry and rumination, attentional monitoring of perceived threats, and maladaptive coping strategies. The CAS interferes with self-regulation by impairing emotional processing, locking cognition onto perceived threats, strengthening negative appraisals and beliefs, and preventing corrective learning experiences. Furthermore, the model proposes that the CAS is directed by an underlying meta-level of cognition, which includes explicit knowledge about thinking, memory and attention (i.e. metacognitive beliefs), and implicit non-verbal rules or programs that guide thinking [14]. Thus, emotional disorder symptoms may be the output of running a particular metacognitive plan that is followed by the activation of its corresponding CAS strategies. For example, the belief that worrying is uncontrollable (e.g., “When I start worrying I cannot stop”) may be accompanied by reduced effort to inhibit worrying and monitoring and avoidance of worry triggers. Moreover, the belief that one has low attentional control capabilities may lead to maintenance of distress because it prohibits the person from disengaging the CAS [5].

Together with maladaptive metacognitive beliefs, the S-REF model emphasizes executive functions and their role in top-down regulation of cognitive style. One of these components is attentional control which may facilitate the ability to disengage from perseverative self-attention and the CAS [5, 13]. Thus, individual differences in attention control capacities (in the form of metacognitive beliefs about control or as individual differences in executive functions) could play a role in symptoms and disorders.

The metacognitive approach is based on the principle that there are core similarities in underlying mechanisms across symptoms and disorders. This is not to say that the metacognitive model does not recognize that there can be content specificity at the metacognitive and cognitive levels, but some of the similarities between disorders are seen as more important than the differences. Especially negative metacognitive beliefs about the control of cognition, which is given central importance [14]. The aim of the present study was therefore to examine the model fit of this generic metacognitive model. We chose to model depression-, generalized- and social anxiety symptoms as a latent distress factor as they are prevalent and often highly comorbid [6, 15, 16], and because the World Health Organization has ranked depression as the single largest, and anxiety disorders (of which social- and generalized anxiety are amongst the most prevalent) as the sixth largest contributor to global disability [17].

To specify the metacognitive variables in the generic metacognitive model, we used the gold-standard Metacognitions Questionnaire-30 (MCQ-30;[18]) which assesses metacognitive knowledge in the form of positive beliefs about worry, beliefs about the uncontrollability and danger of worry, judgements of confidence in memory, beliefs about the need to control thoughts, and cognitive self-consciousness. These belief domains have been associated with symptoms of depression, generalized anxiety (see [19] for a review) and social anxiety [20, 21]. Previous studies have shown that metacognitive beliefs are prospective predictors of anxiety and depression symptoms [22,23,24].

In addition to the MCQ-30, we also included the Attentional Control Scale (ACS; [25]). The ACS was originally developed to assess core individual differences in attention control capacity (i.e. executive functioning), but more recent studies indicate that it more likely assesses subjective judgements of attentional control capacities (i.e. metacognitive beliefs) rather than actual cognitive ability (e.g., [26, 27]). We therefore assume that the ACS offers a measure of metacognitive beliefs about attention even though there is some overlap between the ACS and behavioural assessment of attention control abilities (e.g., [28]). ACS scores have been identified as negatively related to depression [29], generalized anxiety [30], and social anxiety [31].

Previous studies have reported that both generic metacognitive beliefs and attentional control factors as assessed with the ACS explain unique variance in test-anxiety [32], state anxiety in students before end-of-year examinations [33], decisional procrastination [34], and anxiety in children with and without anxiety disorders [35]. However, to the authors’ knowledge, no previous studies have evaluated the structural relationships between generic metacognitive beliefs and attentional control beliefs as underlying factors of common and frequently comorbid distress symptoms. Our hypotheses were as follows; 1) generic metacognitive beliefs will be significantly and positively correlated with all types of symptoms; 2) self-report attentional control will be significantly and negatively correlated with generic metacognitive beliefs and all types of symptoms; 3) the hypothesized generic metacognitive model of emotional distress will show an acceptable fit to the data; and 4) the metacognitive factors will account for substantial variance in the latent symptom variable.

Methods

Participants and procedure

Participants were invited to an online survey on psychological factors in emotional distress through social media (Facebook). The study was conducted in Norway, where ethics approval is not required for surveys that collect non-identifying data. However, the study was registered with the Norwegian Centre for Research Data (NSD; ref. nr. 59,447) in line with local legislation as we used “SelectSurvey”, a survey software provided by the faculty at the first authors’ university, to collect the data. Several Norwegian voluntary mental health organizations helped spread information about the survey to their social media followers. Except being 18 years or above, there were no exclusion criteria. The first page of the survey constituted an information sheet that provided the necessary information about the study and its purpose, and stated that moving to the next page would be regarded as consent to participate.

A total of 645 participants completed the survey. In the total sample, the mean age was 36.26 (SD = 14.11) and 533 (82.6%) of the participants were female. As for marital status, 216 (33.5%) reported to be single, 69 (10.7%) reported to be in a relationship, 314 (48.7%) reported to cohabit or to be married, 39 (6.0%) reported to be separated or divorced, 5 (0.8%) reported to be widowed, while two (0.3%) did not report their marital status. In terms of occupational status, 195 (30.2%) reported to be students, 279 (43.3%) reported to be working, 10 (1.6%) reported to be unemployed, 14 (2.2%) reported to be on short-term sick leave, 130 (20.2%) reported to be on long-term sick leave (> 1 year), and 17 (2.6%) reported to be retired. In addition, 255 (39.5%) reported to have a higher education (completed 3 years or more at a university or equivalent).

Measures

The Patient Health Questionnaire (PHQ-9; [36]) is a 9-item self-report questionnaire based on DSM-IV criteria assessing severity of depression symptoms. The respondent is asked to indicate how often during the past 2 weeks one has experienced symptoms of depression (e.g. “Little interest or pleasure in doing things”, “Feeling tired or having little energy”), along a 4-point scale, ranging from 0 (“not at all”) to 3 (“nearly every day”). The PHQ-9 has shown good internal consistency (α = .89) [37]. In the current study the internal consistency was excellent (α = .93).

Generalized Anxiety Disorder Scale (GAD-7; [38]) is a 7-item self-report questionnaire assessing severity of generalized anxiety disorder symptoms. As in the PHQ-9, respondents are asked to indicate how often during the past 2 weeks one has experienced symptoms of anxiety such as “Becoming easily annoyed or irritable” and “Being so restless that it is hard to sit still”. Each item is scored on a scale ranging from 0 (“not at all”) to 3 (“nearly every day”). The instrument has shown excellent internal consistency (α = .92) [38]. In the current study the internal consistency was excellent (α = .93).

Fear of Negative Evaluation (FNE; [39]) is a 30-item self-report questionnaire assessing severity of social anxiety symptoms. Respondents are asked to rate 30 statements (e.g. “Sometimes I think I am too concerned with what other people think of me”, “I am afraid that people will find fault with me”) as true or false. A total score can be derived by summarizing positive responses to items characterizing social phobia (range 0 to 30), and a higher total score indicate greater levels of social fears and anxiety. The instrument has demonstrated excellent internal consistency (α = .94; [39]), which is also was in the current study (α = .95).

Metacognitions Questionnaire 30 (MCQ-30; [18]) is a 30-item self-report measure assessing metacognitive beliefs (beliefs about cognition). The scale has five subscales; a) positive beliefs about worry (pos; e.g. “I need to worry in order to work well”), b) negative beliefs about uncontrollability and danger of worry (neg; e.g. “When I start worrying I cannot stop”), c) cognitive confidence (cc; e.g. “I have a poor memory”), d) beliefs about the need to control thoughts (nc; e.g. “It is bad to think certain thoughts”), and e) cognitive self-consciousness (csc; e.g. “I monitor my thoughts”). Each item is rated on a 4-point scale ranging from 1 to 4 (1 = do not agree; 2 = agree slightly; 3 = agree moderately; 4 = agree very much) and reflect how much the respondent agrees with the statement. The MCQ-30 subscales have shown acceptable to good internal consistency (α = .77–.89) [22, 40], and in the current study the internal consistency was good (pos: α = .84, neg; α = .90, cc; α = .89, nc; α = .85, csc; α = .79).

Attentional Control Scale (ACS; [25]) is a 20-item self-report questionnaire intended to assess individual differences in attentional control capacity. More recent psychometric evaluation has indicated a two-factor solution (e.g., [41, 42]) consisting of; a) attention focusing (e.g. “It’s very hard for me to concentrate on a difficult task when there are noises around”) and b) attention shifting (e.g. “I have a hard time coming up with new ideas quickly”). Out of the original items, these factors consist of seven (item number 1, 2, 3, 6, 7, 8, 12) and five items (10, 13, 17, 18, 19) respectively. Each item is rated on a 4-point scale ranging from 1 (“almost never”) to 4 (“always”). A higher total score indicates better judgements of attentional control abilities. The ACS focusing subscale has shown good internal consistency (α = .82), and the shifting subscale acceptable internal consistency (α = .71) [42]. In the current study, the internal consistency was good for the focusing (α = .88) and for the shifting subscale (α = .76).

Overview of statistical analyses

All analyses were conducted using IBM SPSS Statistics version 25 and IBM SPSS Amos 25 Graphics. Bivariate correlations were used to explore the basic associations between the variables. Structural equation modelling (SEM) was employed to evaluate the fit of an overall model where a latent metacognition factor (consisting of the MCQ-30 subscales) and a latent attentional control factor (consisting of the ACS subscales) were used. A latent psychological distress/symptom factor (which consisted of the variables PHQ-9 (depression), GAD-7 (generalized anxiety) and FNE (social anxiety)) was specified. We tested the fit of the model (Fig. 1) in which the three latent factors (metacognitions; MCQ-30), attentional control, and transdiagnostic symptoms were correlated as shown. Modification indices were used to identify potential local misfits and secondary loadings were added if identified and consistent with metacognitive theory. Four commonly-recommended fit statistics were used to evaluate the models [43, 44] the comparative fit index (CFI), the Tucker Lewis index (TLI), the standardized root mean square residual (SRMR) and root mean square error of approximation (RMSEA). The CFI and TLI should be above .95, the SRMR should be less than .08, and the RMSEA should be below or close to .06 and the upper limit of the 90% RMSEA confidence interval should not exceed .10 to represent a good fit.

Results

Correlational analyses

Table 1 presents descriptive statistics and bivariate correlations between all variables. All of the correlations were significant at the .01 level. Distress domains were positively inter-correlated and were positively correlated with metacognitive belief domains and negatively correlated with attentional control. Moreover, metacognitive belief domains and attentional control were negatively correlated with each other. That is to say greater maladaptive metacognitions were associated with poorer attention control. Among the metacognitive belief domains, negative beliefs concerning uncontrollability and danger consistently showed the strongest association with symptoms, followed by need for control. Out of the attentional control domains, focusing consistently showed the strongest association with symptoms, and was more closely related to metacognitive beliefs domains than shifting.

Table 1 Mean values and standard deviations for all variables and bivariate inter-correlations (N = 645)

Structural equation modelling

Structural equation modelling was conducted to test the metacognitive model and evaluate relationships between generic metacognitive beliefs, attentional control, and emotional distress. Before taking potential secondary loadings into consideration, the basic model showed the following fit indices: χ2(32) = 220.008, p < .01, CFI = .95, TLI = .93, SRMR = .05, RMSEA = .10 (90% CI = .08–.11), indicating mixed results concerning model fit. Modification indices indicated a secondary loading that was theoretically consistent, between the observed variable MCQ-30 cognitive confidence and the latent variable attentional control which we included in the final model. The suggested structural equation model is presented in Fig. 1 and showed the following fit indices: χ2(31) = 158.771, p < .01, CFI = .97, TLI = .95, SRMR = .04, RMSEA = .08 (90% CI = .07–.09), indicating a good model fit to the data. The specified predictors explained 93% of the variance in the psychological distress latent variable, identified by the squared multiple correlation (adjusted for number of used indices). Moreover, further inspection of the standardized coefficients in the model showed that negative beliefs about the uncontrollability and danger of worry made the strongest contribution to the latent generic metacognitive beliefs variable, while attention focusing made the strongest contribution to the latent attentional control variable. Furthermore, the latent generic metacognitive beliefs variable made a stronger contribution to the latent symptom variable than the latent attentional control variable.

Fig. 1
figure 1

Testing the generic metacognitive model. Structural equation model of the relationship between generic metacognitive beliefs, metacognitive beliefs about attentional control and emotional distress (N = 645). Ellipses represent latent variables, and rectangles represent observed variables (indicators). PHQ-9 = Patient Health Questionnaire, GAD-7 = Generalised Anxiety Disorder Scale, FNE = Fear of Negative Evaluation, MCQpos = positive metacognitive beliefs, MCQneg = negative metacognitive beliefs, MCQcc = cognitive confidence, MCQnc = need for control, MCQcsc = cognitive self-consciousness, ACS-F = attentional control focusing, ACS-S = attentional control shifting. The figure shows standardized coefficients (all significant at the .01 level)

Discussion

The primary aim of the current study was to evaluate the fit and hence validity of the generic metacognitive model. In order to do this, we used structural equation modelling where we specified two latent metacognitive factors consisting of metacognitive beliefs and beliefs about attentional control as predictors of a third latent distress factor comprised of depression-, generalized anxiety- and social anxiety symptoms.

In line with our hypotheses, all domains of metacognitive beliefs and attentional control were significantly correlated with symptoms in the expected direction, and the strengths of correlations was moderate to strong. These findings indicated that greater endorsements of maladaptive metacognitive beliefs about thoughts and beliefs in low attention control capabilities were associated with higher distress levels. Furthermore, metacognitive belief domains showed a small to moderate negative correlation with attentional control subscales, indicating that greater endorsements of metacognitive beliefs concerning worry are associated with beliefs of lower attentional control capabilities.

Negative metacognitive beliefs about the uncontrollability and danger of worry followed by need for control of thoughts showed the strongest association with symptoms among the metacognitive belief domains. Furthermore, attention focusing consistently showed a stronger association to symptoms and to metacognitive belief domains than attention shifting.

Structural equation modelling was conducted to test the fit of the suggested generic metacognitive model and evaluate relationships between the specified latent variables (metacognitive beliefs, attentional control, and symptoms). This basic model included no secondary loadings and indicated mixed results concerning model fit. Following examination of modification indices, a covariation between the error term of the observed variable MCQ-30 cognitive confidence and the latent variable attentional control was included in the final model as it was assessed to be theoretically consistent. Specifically, the original Metacognitions Questionnaire 65-item version [45] assessed confidence in attention as part of its cognitive confidence factor, but these items were not included in the shortened version (MCQ-30; [18]). The suggested covariate likely represents the fact that cognitive confidence is a marker of confidence in memory as well as other cognitive capacities such as attention, which in the present model is better accounted for by the latent attentional control factor.

The final model indicated an acceptable to good overall model fit to the data. The chi-square was found to be significant, which indicates a poor fitting model, but the chi-square statistic is very sensitive to sample sizes and models with larger numbers of observed variables [46]. However, the CFI, TLI and SRMR indicated a good fitting model, whilst the RMSEA indicated an acceptable fit. In line with the bivariate correlations, the latent metacognitive beliefs factor was significantly and negatively associated with the latent attentional control factor. Both the generic metacognitive factor and the attention control factor explained independent variance in the distress factor, and together accounted for 93% of the variance. The generic metacognitive factor made a stronger contribution to the latent symptom variable compared to the attentional control factor, suggesting that generic metacognitive beliefs might be the most important target for treatment interventions. Moreover, negative metacognitive beliefs about the uncontrollability and danger of worry was the strongest contributor to the latent generic metacognitive beliefs variable, suggesting that this belief domain may be particularly important to modify in treatment. Notably, attention focusing contributed more to the latent attention factor than attention switching perhaps indicating a greater relative importance.

The structural equation model is regarded as a stringent test of models, but one must also keep in mind that several models consisting of the same latent variables and number of relationships between them could provide equally good fit to the data. However, models tested with SEM should be specified by theory in advance, and the most important question to be answered here is; does the model specified by the theory fit? Since this is specified a-priori, there is of course the possibility that the fit will be poor.

The present findings are in line with the metacognitive model of psychological disorders [5, 14] and with previous studies that have confirmed a role for metacognitive beliefs [19, 20] and attentional control [29,30,31] in psychopathology. Moreover, previous studies have found support for an association between greater maladaptive metacognitive beliefs and lower attentional control, and that these constructs can explain individual variance in several types of psychopathology [32,33,34,35, 47]. One previous study reported that attentional control moderated the relationship between the CAS (including metacognitive strategies and beliefs as a total score) and depression- and anxiety symptoms [48]. Previous studies have also indicated that the same metacognitive factors are implicated in different types of distress and that they may explain comorbidity. For example, negative metacognitive beliefs and cognitive confidence correlate with both depression [49] and social anxiety [50], and with depression symptoms in patients with social anxiety disorder [51]. However, the present study expands on previous studies by identifying the structural relationships between the central elements in the generic metacognitive model and by demonstrating the statistical fit of a generic metacognitive formulation of common and frequently co-occurring symptoms.

The present study supports the data from clinical practice. For example, metacognitive therapy (MCT) for major depressive disorder is not only an effective treatment for depressive symptoms, but also has an impact on anxiety and work ability [52], neuropsychological functioning [53], comorbid diagnoses [54], and interpersonal problems [55]. In addition, several studies have evaluated the utility and efficacy of the generic form of MCT: transdiagnostic MCT was more beneficial than treatment as usual in a controlled trial performed in a natural clinical setting in a heterogeneous patient sample [56]. In a randomized feasibility trial, transdiagnostic group MCT was more beneficial than transdiagnostic mindfulness based stress reduction (MBSR) in a mixed disorder sample [57]. In a randomized controlled trial comparing the efficacy of disorder-specific CBT and transdiagnostic MCT for patients with complex and comorbid anxiety disorders, MCT was associated with better outcomes pre to post treatment [58].

There are a number of limitations to the present study that must be acknowledged. The sample was gathered at convenience using online sampling and consisted of substantially more females than males that may compromise the generalizability of the findings. Moreover, we employed a cross-sectional design, and there may therefore be other models that fit the data equally well. Thus, no causal inferences can be made based upon these data. In addition and as noted in the introduction, the ACS may be a better measure of subjective judgements of attentional control capacities (i.e. metacognitive beliefs) rather than actual cognitive ability. Future research should use longitudinal designs and have more control over the samples used. There is also a need for further evaluation of the generic metacognitive model using objective measures of executive functioning such as attentional control. The fit and relevance of the generic metacognitive model should also be tested in clinical samples. Moreover, further evaluation of the generic metacognitive model should include other types of distress and problems.

Conclusions

In conclusion, the generic metacognitive model of common and frequently co-occurring distress symptoms provided a good fit to the data accounting for most of the variance in the latent distress construct. In the model, generic metacognitive beliefs and attentional control were correlated but accounted for unique variance. Our results support continued research on the generic model.

Availability of data and materials

The dataset generated and analyzed during the current study will be available in the NTNU Open Research Data respiratory once the manuscript has been accepted for publication. Until then, the dataset are available from the corresponding author on reasonable request.

Abbreviations

ACS:

Attentional Control Scale

CAS:

Cognitive Attentional Syndrome

CBT:

Cognitive-behavioral therapy

CFI:

comparative fit index

FNE:

Fear of Negative Evaluation

GAD-7:

Generalized Anxiety Disorder Scale

IBM SPSS:

International Business Machines Corporation- Statistical Package for the Social Sciences

MBSR:

Mindfulness based stress reduction

MCQ-30:

Metacognitions questionnaire 30

MCT:

Metacognitive therapy

NICE:

National Institute for Health and Care Excellence

NSD:

Norwegian Centre for Research Data

PHQ-9:

Patient Health Questionnaire

RMSEA:

root mean square error of approximation

SEM:

Structural equation modelling

S-REF:

Self-Regulatory Executive Function

SRMR:

standardized root mean square residual

TLI:

Tucker Lewis index

References

  1. National Institute for Health and Care Excellence: Depression in adults: recognition and management. (Clinical guideline 90). https://www.nice.org.uk/guidance/cg90 (2009). Accessed 20 Nov 2018.

  2. National Institute for Health and Care Excellence: Generalized anxiety disorder and panic disorder in adults: management. (Clinical guideline 113). http://guidance.nice.org.uk/CG113 (2011). Accessed 20 Nov 2018.

  3. National Institute for Health and Care Excellence. Social anxiety disorder: recognition, assessment and treatment of social anxiety disorder. (Clinical guideline 159). http://guidance.nice.org.uk/CG159 (2013). Accessed 20 Nov 2018.

  4. Brown TA, Barlow DH. A proposal for a dimensional classification system based on the shared features of the DSM-IV anxiety and mood disorders: implications for assessment and treatment. Psychol Assess. 2009;21:256–71 https://0-doi-org.brum.beds.ac.uk/10.1037/a0016608.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Wells A, Matthews G. Attention and emotion: a clinical perspective. Hove: Erlbaum; 1994.

    Google Scholar 

  6. Kessler RC, Chiu WT, Demler O, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62:617–27. https://0-doi-org.brum.beds.ac.uk/10.1001/archpsyc.62.6.617.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Carpenter JK, Andrews LA, Witcraft SM, Powers MB, Smits JA, Hofmann SG. Cognitive behavioral therapy for anxiety and related disorders: A meta-analysis of randomized placebo-controlled trials. Depress Anxiety. 2018;doi:https://0-doi-org.brum.beds.ac.uk/10.1002/da.22728.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Cuijpers P, Berking M, Andersson G, Quigley L, Kleiboer A, Dobson KS. A meta-analysis of cognitive-behavioural therapy for adult depression, alone and in comparison with other treatments. Can J Psychiatr. 2013;58:376–85 https://0-doi-org.brum.beds.ac.uk/10.1177/070674371305800702.

    Article  Google Scholar 

  9. Springer KS, Levy HC, Tolin DF. Remission in CBT for adult anxiety disorders: a meta-analysis. Clin Psychol Rev. 2018;61:1–8 https://0-doi-org.brum.beds.ac.uk/10.1016/j.cpr.2018.03.002.

    Article  PubMed  Google Scholar 

  10. Naragon-Gainey K, Watson D. What lies beyond neuroticism? An examination of the unique contributions of social-cognitive vulnerabilities to internalizing disorders. Assessment. 2018;25:143–58 https://0-doi-org.brum.beds.ac.uk/10.1177/1073191116659741.

    Article  PubMed  Google Scholar 

  11. Caspi A, Houts RM, Belsky DW, Goldman-Mellor SJ, Harrington H, Israel S, et al. The p factor: one general psychopathology factor in the structure of psychiatric disorders? Clin Psychol Sci. 2014;2:119–37 https://0-doi-org.brum.beds.ac.uk/10.1177/2167702613497473.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Rosenström T, Gjerde LC, Krueger RF, Aggen SH, Czajkowski NO, Gillespie NA, et al. Joint factorial structure of psychopathology and personality. Psychol Med. 2018:1–10 https://0-doi-org.brum.beds.ac.uk/10.1017/S0033291718002982.

    Article  PubMed  Google Scholar 

  13. Wells A, Matthews G. Modelling cognition in emotional disorder: the S-REF model. Behav Res Ther. 1996;34:881–8. https://0-doi-org.brum.beds.ac.uk/10.1016/S0005-7967(96)00050-2.

    Article  CAS  PubMed  Google Scholar 

  14. Wells A. Metacognitive therapy for anxiety and depression. New York: Guilford press; 2009.

    Google Scholar 

  15. Ohayon MM, Schatzberg AF. Social phobia and depression: prevalence and comorbidity. J Psychosom Res. 2010;68:235–43 https://0-doi-org.brum.beds.ac.uk/10.1016/j.jpsychores.2009.07.018.

    Article  PubMed  Google Scholar 

  16. Wittchen HU. Generalized anxiety disorder: prevalence, burden, and cost to society. Depress Anxiety. 2002;16:162–71 https://0-doi-org.brum.beds.ac.uk/10.1002/da.10065.

    Article  PubMed  Google Scholar 

  17. World Health Organization. Depression and Other Common Mental Disorders: Global Health Estimates. Geneva: World Health Organization. Licence: CC BY-NCSA 3.0 IGO; 2017.

    Google Scholar 

  18. Wells A, Cartwright-Hatton S. A short form of the metacognitions questionnaire: properties of the MCQ-30. Behav Res Ther. 2004;42:385–96. https://0-doi-org.brum.beds.ac.uk/10.1016/S0005-7967(03)00147-5.

    Article  PubMed  Google Scholar 

  19. Sun X, Zhu C, So SHW. Dysfunctional metacognition across psychopathologies: a meta-analytic review. Eur Psychiatry. 2017;45:139–53 https://0-doi-org.brum.beds.ac.uk/10.1016/j.eurpsy.2017.05.029.

    Article  CAS  PubMed  Google Scholar 

  20. Gkika S, Wittkowski A, Wells A. Social cognition and metacognition in social anxiety: a systematic review. Clin Psychol Psychother. 2017;25:10–30. https://0-doi-org.brum.beds.ac.uk/10.1002/cpp.2127.

    Article  PubMed  Google Scholar 

  21. Nordahl H, Nordahl HM, Hjemdal O, Wells A. Cognitive and metacognitive predictors of symptom improvement following treatment of social anxiety disorder: a secondary analysis from a randomized controlled trial. Clin Psychol Psychother. 2017:1–7. https://0-doi-org.brum.beds.ac.uk/10.1002/cpp.2083.

    Article  Google Scholar 

  22. Nordahl H, Hjemdal O, Hagen R, Nordahl HM, Wells A. What lies beneath trait-anxiety? Testing the Self-Regulatory Executive Function Model of Vulnerability. Front Psychol. 2019;10:122. https://0-doi-org.brum.beds.ac.uk/10.3389/fpsyg.2019.00122.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Papageorgiou C, Wells A. A prospective test of the clinical metacognitive model of rumination and depression. Int J Cogn Ther. 2009;2:123–31 https://0-doi-org.brum.beds.ac.uk/10.1521/ijct.2009.2.2.123.

    Article  Google Scholar 

  24. Ryum T, Kennair LEO, Hjemdal O, Hagen R, Halvorsen JØ, Solem S. Worry and metacognitions as predictors of anxiety symptoms: a prospective study. Front Psychol. 2017;8:924 https://0-doi-org.brum.beds.ac.uk/10.3389/fpsyg.2017.00924.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Derryberry D, Reed MA. Anxiety-related attentional biases and their regulation by attentional control. J Abnorm Psychol. 2002;111:225–36 https://0-doi-org.brum.beds.ac.uk/10.1037/0021-843X.111.2.225.

    Article  PubMed  Google Scholar 

  26. Quigley L, Wright CA, Dobson KS, Sears CR. Measuring attentional control ability or beliefs? Evaluation of the factor structure and convergent validity of the attentional control scale. J Psychopathol Behav Assess. 2017;39:742–54 https://0-doi-org.brum.beds.ac.uk/10.1007/s10862-017-9617-7.

    Article  Google Scholar 

  27. Williams PG, Rau HK, Suchy Y, Thorgusen SR, Smith TW. On the validity of self-report assessment of cognitive abilities: attentional control scale associations with cognitive performance, emotional adjustment, and personality. Psychol Assess. 2017;29:519–30 https://0-doi-org.brum.beds.ac.uk/10.1037/pas0000361.

    Article  PubMed  Google Scholar 

  28. Reinholdt-Dunne ML, Mogg K, Bradley BP. Attention control: relationships between self-report and behavioural measures, and symptoms of anxiety and depression. Cogn Emot. 2013;27:430–40 https://0-doi-org.brum.beds.ac.uk/10.1080/02699931.2012.715081.

    Article  PubMed  Google Scholar 

  29. Hsu KJ, Beard C, Rifkin L, Dillon DG, Pizzagalli DA, Björgvinsson T. Transdiagnostic mechanisms in depression and anxiety: the role of rumination and attentional control. J Affect Disord. 2015;188:22–7 https://0-doi-org.brum.beds.ac.uk/10.1016/j.jad.2015.08.008.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Armstrong T, Zald DH, Olatunji BO. Attentional control in OCD and GAD: specificity and associations with core cognitive symptoms. Behav Res Ther. 2011;49:756–62 https://0-doi-org.brum.beds.ac.uk/10.1016/j.brat.2011.08.003.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Sluis RA, Boschen MJ, Neumann DL, Murphy K. Attentional control associated with core cognitive maintenance factors of social anxiety. J Exp Psychopathol. 2018; https://0-doi-org.brum.beds.ac.uk/10.1177/2043808718798076.

    Article  Google Scholar 

  32. O’Carroll PJ, Fisher P. Metacognitions, worry and attentional control in predicting OSCE performance test anxiety. Med Educ. 2013;47:562–8. https://0-doi-org.brum.beds.ac.uk/10.1111/medu.12125.

    Article  PubMed  Google Scholar 

  33. Spada MM, Georgiou GA, Wells A. The relationship among metacognitions, attentional control, and state anxiety. Cogn Behav Ther. 2010;39:64–71 https://0-doi-org.brum.beds.ac.uk/10.1080/16506070902991791.

    Article  PubMed  Google Scholar 

  34. Fernie BA, McKenzie AM, Nikčević AV, Caselli G, Spada MM. The contribution of metacognitions and attentional control to decisional procrastination. J Ration Emot Cogn Behav Ther. 2016;34:1–13. https://0-doi-org.brum.beds.ac.uk/10.1007/s10942-015-0222-y.

    Article  Google Scholar 

  35. Reinholdt-Dunne ML, Blicher A, Nordahl H, Normann N, Esbjørn BH, Wells A. Modeling the relationship between metacognitive beliefs, attentional control and symptoms in children with and without anxiety disorders: a test of the S-REF model. Front Psychol. 2019;10(1205). https://0-doi-org.brum.beds.ac.uk/10.3389/fpsyg.2019.01205.

  36. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–13 https://0-doi-org.brum.beds.ac.uk/10.1046/j.1525-1497.2001.016009606.x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  37. Kroenke K, Spitzer RL, Williams JB, Löwe B. The patient health questionnaire somatic, anxiety, and depressive symptom scales: a systematic review. Gen Hosp Psychiatry. 2010;32:345–59 https://0-doi-org.brum.beds.ac.uk/10.1016/j.genhosppsych.2010.03.006.

    Article  PubMed  Google Scholar 

  38. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166:1092–7. https://0-doi-org.brum.beds.ac.uk/10.1001/archinte.166.10.1092.

    Article  PubMed  Google Scholar 

  39. Watson D, Friend R. Measurement of social-evaluative anxiety. J Consult Clin Psychol. 1969;33:448–57. https://0-doi-org.brum.beds.ac.uk/10.1037/h002780.

    Article  CAS  PubMed  Google Scholar 

  40. Spada MM, Mohiyeddini C, Wells A. Measuring metacognitions associated with emotional distress: factor structure and predictive validity of the metacognitions questionnaire 30. Pers Individ Dif. 2008;45:238–42 https://0-doi-org.brum.beds.ac.uk/10.1016/j.paid.2008.04.005.

    Article  Google Scholar 

  41. Ólafsson RP, Smári J, Guðmundsdóttir F, Ólafsdóttir G, Harðardóttir HL, Einarsson SM. Self reported attentional control with the attentional control scale: factor structure and relationship with symptoms of anxiety and depression. J Anxiety Disord. 2011;25:777–82. https://0-doi-org.brum.beds.ac.uk/10.1016/j.janxdis.2011.03.013.

    Article  PubMed  Google Scholar 

  42. Judah MR, Grant DM, Mills AC, Lechner WV. Factor structure and validation of the attentional control scale. Cogn Emot. 2014;28:433–51. https://0-doi-org.brum.beds.ac.uk/10.1080/02699931.2013.835254.

    Article  PubMed  Google Scholar 

  43. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6:1–55 https://0-doi-org.brum.beds.ac.uk/10.1080/10705519909540118.

    Article  Google Scholar 

  44. Kline RB. Principles and practice of structural equation modelling. 3rd ed. New York: Guilford; 2011.

    Google Scholar 

  45. Cartwright-Hatton S, Wells A. Beliefs about worry and intrusions: the meta-cognitions questionnaire and its correlates. J Anxiety Disord. 1997;11:279–96. https://0-doi-org.brum.beds.ac.uk/10.1016/S0887-6185(97)00011-X.

    Article  CAS  PubMed  Google Scholar 

  46. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. Multivariate data analysis. Seventh ed. Pearson new international: Harlow, Essex; 2014.

    Google Scholar 

  47. Spada MM, Roarty A. The relative contribution of metacognitions and attentional control to the severity of gambling in problem gamblers. Addict Behav Rep. 2015;1:7–11 https://0-doi-org.brum.beds.ac.uk/10.1016/j.abrep.2015.02.001.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Fergus TA, Bardeen JR, Orcutt HK. Attentional control moderates the relationship between activation of the cognitive attentional syndrome and symptoms of psychopathology. J Individ Differ. 2012;53:213–7 https://0-doi-org.brum.beds.ac.uk/10.1016/j.paid.2012.03.017.

    Article  Google Scholar 

  49. Papageorgiou C, Wells A. An empirical test of a clinical metacognitive model of rumination and depression. Cognit Ther Res. 2003;27:261–73 https://0-doi-org.brum.beds.ac.uk/10.1023/A:1023962332399.

    Article  Google Scholar 

  50. Nordahl H, Wells A. Testing the metacognitive model against the benchmark CBT model of social anxiety disorder: is it time to move beyond cognition? PLoS One. 2017;12:e0177109 https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0177109.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Nordahl H, Nordahl HM, Vogel PA, Wells A. Explaining depression symptoms in patients with social anxiety disorder: do maladaptive metacognitive beliefs play a role? Clin Psychol Psychother. 2018;25:457–64 https://0-doi-org.brum.beds.ac.uk/10.1002/cpp.2181.

    Article  PubMed  Google Scholar 

  52. Hagen R, Hjemdal O, Solem S, Kennair LEO, Nordahl HM, Fisher P. Metacognitive therapy for depression in adults: a waiting list randomized controlled trial with six months follow-up. Front Psychol. 2017;8:31. https://0-doi-org.brum.beds.ac.uk/10.3389/fpsyg.2017.00031.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Groves SJ, Porter RJ, Jordan J, Knight R, Carter JD, McIntosh VV, et al. Changes in neuropsychological function after treatment with metacognitive therapy or cognitive behavior therapy for depression. Depress Anxiety. 2015;32:437–44. https://0-doi-org.brum.beds.ac.uk/10.1002/da.22341.

    Article  PubMed  Google Scholar 

  54. Hjemdal O, Hagen R, Solem S, Nordahl H, Kennair LEO, Ryum T, et al. Metacognitive therapy in major depression: an open trial of comorbid cases. Cog Behav Pract. 2017;3:312–8 https://0-doi-org.brum.beds.ac.uk/10.1016/j.cbpra.2016.06.006.

    Article  Google Scholar 

  55. Strand ER, Hagen R, Hjemdal O, Kennair LEO, Solem S. Metacognitive therapy for depression reduces interpersonal problems: results from a randomized controlled trial. Front Psychol. 2018;9:1415 https://0-doi-org.brum.beds.ac.uk/10.3389/fpsyg.2018.01415.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Nordahl HM. Effectiveness of brief metacognitive therapy versus cognitive-behavioral therapy in a general outpatient setting. Int J Cogn Ther. 2009;2:152–9 https://0-doi-org.brum.beds.ac.uk/10.1521/ijct.2009.2.2.152.

    Article  Google Scholar 

  57. Capobianco L, Reeves D, Morrison AP, Wells A. Group metacognitive therapy vs. mindfulness meditation therapy in a Transdiagnostic patient sample: a randomised feasibility trial. Psychiatry Res. 2018;259:554–61 https://0-doi-org.brum.beds.ac.uk/10.1016/j.psychres.2017.11.045.

    Article  PubMed  Google Scholar 

  58. Johnson SU, Hoffart A, Nordahl HM, Wampold B. Metacognitive therapy versus disorder-specific CBT for comorbid anxiety disorders: a randomized controlled trial. J Anxiety Disord. 2017;50:103–12 https://0-doi-org.brum.beds.ac.uk/10.1016/j.janxdis.2017.06.004.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This study did not receive any funding.

Author information

Authors and Affiliations

Authors

Contributions

All authors participated in planning the study. IHØ and HN carried out the survey. HN, OH, and AW conducted the data analyses. HN, IHØ and AW wrote a first draft of the manuscript and all authors contributed substantially to the finalized version. All authors have read and approved the manuscript and given approval of the current version to be published.

Corresponding author

Correspondence to Henrik Nordahl.

Ethics declarations

Ethics approval and consent to participate

The study was conducted in Norway, where ethics approval is not required for surveys that collect non-identifying data (https://helseforskning.etikkom.no/reglerogrutiner/soknadsplikt/sokerikkerek?p_dim=34999&_ikbLanguageCode=us). Thus, no formal ethics approval was required for the current study. However, the study was registered with the Norwegian Centre for Research Data (NSD; ref. nr. 59447) in line with local legislation in Norway (https://nsd.no/personvernombud/en/notify/index.html). Participants were presented with an information sheet about the study upon entering the survey portal, and was informed that proceeding to the survey would be considered as consent to take part in the study.

Consent for publication

Not applicable.

Competing interests

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nordahl, H., Ødegaard, I.H., Hjemdal, O. et al. A test of the goodness of fit of the generic metacognitive model of psychopathology symptoms. BMC Psychiatry 19, 288 (2019). https://0-doi-org.brum.beds.ac.uk/10.1186/s12888-019-2266-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12888-019-2266-5

Keywords