- Research article
- Open Access
- Open Peer Review
Citizenship and recovery: two intertwined concepts for civic-recovery
© Pelletier et al.; licensee BioMed Central. 2015
- Received: 9 September 2014
- Accepted: 19 February 2015
- Published: 4 March 2015
Validation of the psychometric properties of a new measure of citizenship was required for a research project in the province of Quebec, Canada. This study was meant to study the interplay between recovery- and citizenship-oriented supportive employment. As recovery and citizenship were expected to be two related concepts, convergent validity between the Citizenship Measure (CM) and the Recovery Assessment Scale (RAS) was tested.
Study objectives were to: 1) conduct exploratory factor analyses on the CM and confirmatory factor analysis on the RAS tools (construct validity), 2) calculate Cronbach’s alphas for each dimension emerging from objective 1 (reliability), and 3) calculate correlations between all dimensions from both tools (convergent validity). Data were collected from 174 individuals with serious mental illness, working in social firms. Serious mental illnesses include major depression, schizophrenia, bipolar disorder, obsessive compulsive disorder, panic disorder, post traumatic stress disorder and borderline personality disorder.
Five factors emerged from the exploratory factor analysis of the CM, with good reliability. Confirmatory factor analyses showed that the short and the long versions of the RAS present satisfactory results. Finally, the correlation matrix indicated that all dimensions from both tools are significantly correlated, thus confirming their convergent validity.
This study confirms the validity and reliability of two tools, CM and RAS. These tools can be used in combination to assess citizenship and recovery, both of which may be combined in the new concept of civic-recovery.
- Tool validation
- Recovery Assessment Scale
- Citizenship Measure
The recovery approach has gained traction in mental health policy throughout the English-speaking world, and much effort is going into the transformation of services and systems to achieve recovery-oriented outcomes [1,2]. Beyond reduction or remission of psychiatric symptoms, recovery-oriented mental health policies and systems not only help the individuals with mental illness to live in their community – to be in the community – but also aim at enabling them to become and remain members of the community .
Several evidence-based interventions exist that focus on the psychiatric rehabilitation and social inclusion of people living with mental illness. Social interaction, which is essential to community membership, involves the development and maintenance of reciprocal relationships between members of a community in which each of its components are co-citizens to each other. Citizenship relates to the strength of people’s connections to the rights, responsibilities, roles, and resources that society offers to people through public and social institutions, and relationships involving close ties, supportive social networks, and associational life in one’s community [4,5].
As early as 1994, in the early ages of the recovery movement , Fisher developed an empowerment model of recovery based on the principles that emerged from the experiences of consumers in recovery. Among those principles is Personhood: “We are full human beings and deserve respect and full citizenship” (, p. 914). More recently, Davidson et al. suggest that, as a sense of empowerment and control over one’s life emerges, people in recovery may start to demand the same rights and responsibilities as other citizens [8,9]. Supporting people with mental illness in exercising the rights and responsibilities of citizenship might be a pre-condition for their recovery, not an eventual reward contingent on the person overcoming his or her disability first. Indeed, almost from inception, recovery proponents have alluded to citizenship, albeit rarely defining the term and without attempts to measure it empirically. One of the aims of this paper is to contribute to the filling of that gap by comparing two measurement tools: one designed to assess citizenship, the other one to assess recovery from the perspective of persons in recovery.
Generally speaking, two portrayals of recovery stand out amidst the diversity of views: restoration of functioning and deepening wellness . When recovery is mainly seen as symptom management, the primary focus of personal choice and responsibility in the process of recovery becomes seeking and complying with treatment. Such a “clinical” model does include social functions, but from a professional point of view. Instead of focusing primarily on symptom relief and management, a second view casts a wider spotlight on restoration of self-esteem and identity and on attaining meaningful roles in society . While the clinical-recovery model has focused upon the remission of symptoms and restoration of functioning, a rehabilitative view of recovery has been a more subjective and consumer-oriented concept that focuses on the full lives that are lived in the face of, or despite, enduring disability. This second axiom of recovery derives from the Mental Health Consumer/Survivor Movement, and refers to a person’s rights to self-determination and inclusion in community life regardless of disability status.
For a research project meant to study the interplay between recovery- and citizenship-oriented supportive employments, validation of the psychometric properties of a recently developed measure of citizenship was required. As citizenship and recovery were expected to be related concepts, convergent validity between the Citizenship Measure (CM) and the Recovery Assessment Scale (RAS) was tested.
Although the recovery literature has now and then alluded to citizenship, clinicians’ and scientists’ references or pledges to citizenship have been sparse and, generally, vague. Several tools have been developed to assess recovery , but until very recently no measure was available to assess citizenship from the perspective of persons in recovery. In a review of the literature  based on a MEDLINE search with the key words “citizenship”, “measure”, and “mental health”, the CM is the only referenced tool specifically designed to assess the degrees to which individuals with psychiatric disorders perceive themselves to have full citizenship . On the other hand, the search with “recovery”, “measure”, and “mental health” yielded 392 references. Among those is the RAS, which was developed as an outcome measure for program evaluation . In this paper we explore the RAS and the CM, which was developed, too, as an outcome measure.
Salzer and Brusilovskiy have recently published an in-depth review of the quantitative properties of the RAS, based on 77 articles that included psychometric data. They found that these studies indicate very good results for internal consistency, test-retest reliability, and internal reliability . It has however not yet been validated in French. Among the tools that were developed to empirically assess recovery, the RAS has been the most published , whereas the CM is the only published tool developed to assess citizenship. Although citizenship is a distinct concept, it overlaps somewhat with the Mental Health Consumer/Survivor Movement’s view of recovery. As such, a citizenship measure such as CM should demonstrate convergent validity with a recovery measure like the RAS.
Therefore, this study consists of the validation of the French CM and RAS. The objectives are threefold: 1) to conduct factor analyses on both tools (i.e., construct validity), more precisely: 1.1) exploratory factor analysis on the CM and 1.2) confirmatory factor analysis on the RAS, 2) to calculate Cronbach’s alphas for each dimension emerging from the objective 1 (i.e., reliability), and 3) to calculate correlations between all dimensions from both tools (i.e., convergent validity). Convergent validity is a series of tests to see whether constructs that are expected to be related are, in fact, related . Thus we chose to look at the CM and the RAS together. The alphas for the factors of the original RAS ranged from 0.74 to 0.87 , and the alphas for the English version of the CM ranged from 0.56 to 0.86 [O’Connell et al, Reliability and validity of a newly developed measure of citizenship among persons with mental illnesses, submitted].
Two translators translated the CM and RAS from English to French separately and then two other translators translated each of the measurements backward from French to English for discussion with the English speaking authors of the CM and RAS. For this study we thus used translation-back-translation procedures  to translate into French both the CM (M.R., co-author) and the RAS (P.C., co-author) and to explore possible convergent validity between the measures of citizenship and recovery. The primary aim of this paper is to evaluate the psychometrics of the new French-versions of the CM and RAS among French speaking research participants in the province of Quebec, Canada.
The CM is a scale of 46 items that are rated on a 5-point Likert scale (5 = strongly agree; 1 = strongly disagree). Multidimensional scaling and hierarchical cluster analysis revealed seven primary domains of citizenship: personal responsibilities; government and infrastructure; caring for self and others; civil rights; legal rights; choices; and world stewardship .
The RAS has been used to assess various aspects of recovery from the perspective of persons with serious mental illness and with a particular emphasis on hope and self-determination. The original instrument comprises 41 items, and a shorter version containing 24 items is also available . We used both versions, for which all items are also rated on a 5-point Lickert scale (5 = strongly agree; 1 = strongly disagree). The RAS covers five domains: personal confidence; willingness to ask for help; goal and success orientation; reliance on others; and no domination by symptoms.
A total of 183 individuals provided usable data; missing values for some items have lowered the n to 174. These participants, all people with serious mental illness, were involved in governmental work integration programs and participated in the abovementioned larger study, with a majority of them receiving the equivalent in Quebec of the Social Security Disability Insurance in the USA (SSDI). Serious mental illnesses include major depression, schizophrenia, bipolar disorder, obsessive compulsive disorder, panic disorder, post traumatic stress disorder and borderline personality disorder. This study was approved by the Institutional Review Board of Institut universitaire en santé mentale de Montréal (affiliated with the University of Montreal) and written informed consent for participation in the study was obtained from participants. Fifty-four percent were males (n = 94), and the mean age was 45.5 (SD = 10). Approximately one half (n = 83) self-reported a diagnosis of schizophrenia spectrum disorders. Anxiety disorder (n = 22), bipolar disorder (n = 23) and major depression (n = 22) were each mentioned by about 13% of participants. Another 4% mentioned having a personality disorder (n = 8). The diagnosis was unknown or unspecified among 9% of participants (n = 16). All participants were French speaking.
As suggested by Costello and Osborne , a principal axis factoring method of extraction (PAF) with oblique (oblimin) rotation was applied to the CM. Different indices were considered such as scree plot, eigenvalues, percentage of total variance, and item loadings on each emerging dimension. Confirmatory factor analyses (CFA) were carried out on the French translation of RAS – long and short versions – which consists of items spread over the following five dimension scales: (1) personal confidence; (2) willingness to ask for help; (3) goal and success orientation; (4) reliance on others; and (5) no domination by symptoms.
CFA procedure permits the evaluation of the model’s fit with the empirical data by taking into account various statistical indices. Using the EQS software , the estimation method maximum likelihood-robust was carried out to evaluate the model with five subscales, considering the 24-item short version or the long version (40 out of 41 items). Note that, for the long version, we did not include the item that was not part of any subscale (I am a better person than before my experience with mental illness). The Satorra-Bentler scaled chi-square index method was used to control for violation of the assumption of multivariate normality, since this index integrates a scale that corrects chi-square statistics.
The internal consistency of each of the CM and RAS scales, from the exploratory factor analysis (CM) and confirmatory factor analysis (RAS) results respectively, was assessed using Cronbach’s alpha . Pearson correlations were calculated between the dimensions of the CM and the RAS to assess the tools’ convergent validity. Beaver et al. consider that when the factors load moderately (.40 or higher), as is the case here (see below), a sample size of 150 or more is needed to be confident in the results at such an initial stage .
Factor structure of the Citizenship Measure (N = 174)
Dimensions and items of the citizenship scale
Basic needs (n = 5 items; α = .60)
- Your basic needs are met
- You do things to take care of your home
- You are safe in your community
- There are laws that will protect you
- You have or would have access to employment
Involvement in community (n = 4 items; α = .65)
- You are include in your community
- You have responsibilities to others in the community
- You can influence your community or local government
- You have knowledge about your community
Self-determination (n = 6 items; α = .67)
- You or your family have choices in education
- You stand up for what you believe in
- You have the right to be in a relationship with a partner of your choice
- You have privacy
- You have the right to be disagree with others
- You can make choices about how you spend your money
Basic needs (n = 5 items; α = .60)
- You have access to adequate healthcare
- You have or could have access to adequate and affordable housing
- You would have access to public assistance, if needed
- You have choices in your mental healthcare
Respect by others (n = 4 items; α = .74)
- You are treated with dignity and respect
- You feel accepted by you
- You listen to you
- You personal decisions and choices are respected
Variance after rotation
Confirmatory factor analyses results of the Recovery Assessment Scale (N = 174)
Adjustment fit indices
χ 2 /df
M1-Short version with all factors corrected
.03 (confidence interval = .01-.04)
M2 - Long version with all factors associated
.03 (confidences interval = .02 - .04)
Correlations among dimensions – citizenship and recovery measures
1. CM - Self-determination
2. CM - Respect by others
3. CM - Involvement in community
4. CM - Fundamental needs
5. CM - Access to services
6. RAS - Personal confidences
7. RAS - Willingness to ask for help
8. RAS - Goal and success orientation
9. RAS - Reliance on others
10. RAS - No domination by symptoms
With respect to the value of the alpha, Streiner and Norman  mention that the alpha should be between 0.70 and 0.90 to have a good internal consistency for the evaluated conceptual dimension. However, if the number of items is inferior to 5, it is possible to obtain a low alpha coefficient (around 0.65) whereas if the number of items is superior to 10, the value of the alpha is higher (around 0.90). Consequently, according to the number of items included in a conceptual dimension, alpha coefficients can vary considerably , though DeVellis  mention that an alpha inferior to .60 is not acceptable regardless of the number of items. If we consider the number of items included in conceptual dimensions or subscales from the RAS and CM, all alpha values in our study are satisfactory or acceptable.
Therefore, the construct validity and the reliability for each tool, the French CM and RAS, are satisfactory. This study demonstrates the empirical relationship between citizenship and recovery, supporting the convergent validity of the CM measure. In effect, our findings suggest a correlational relationship between the five dimensions of the CM and RAS respectively. Citizenship and recovery would appear to be two intertwined and complementary concepts. This does not suggest, however, a causal relationship between the two concepts. We cannot predict, for instance, that a recovery-oriented program would necessarily imply good outcomes in terms of citizenship for people with mental illness, nor vice-versa.
In terms of implications for practice, what we do argue is that, for future research, more precision is necessary as the idea of recovery remains controversial and as there remains little consensus on what recovery means, especially when an individual’s understanding of his/her own recovery changes over time [32,33]. Therefore, the global aim of this paper is to contribute to the field by proposing a new angle of analysis, in complementarity with the clinical and rehabilitative views.
To prevent what Slade et al. have called an abuse of recovery , more clarity in the field is warranted, with authors specifying for instance which view of recovery they are referring to. In effect, researchers and scholars who write about recovery are rarely explicit about whether or not they are writing from the clinical-recovery or the rehabilitative-recovery views . The latter has focused more on the subjective sense of living a life in recovery and on changing mental health care than on ensuring that people in recovery are and remain full members of the community – not just in the community. Citizenship, with community membership at its core, can help to tease apart these various aspects of recovery. As recovery presupposes interaction factors relating to the person and the environment, plus elements from professional interventions , it might be appropriate to combine the short CM and the short RAS (given that the short RAS is the best adjusted model) as an outcome measure for recovery- and citizenship-oriented services. There would be 10 dimensions to such a composite index – in alphabetical order: Access to services; Basic needs; Goal and success orientation; Involvement in community; No domination by symptoms; Personal confidence and hope; Reliance on others; Respect by others; Self-determination; and Willingness to ask for help. Each item can be uniformly answered with a 5-point Likert scale, for a total of 47 questions.
Undoubtedly, there is an increasing global commitment to recovery as the expectation for people with mental illness. Recovery is a process in which the person engages to figure out how to manage and live with his or her disorder. Recovery and citizenship are neither things that providers can do to, or for people with mental illness, nor things that can be promoted after or separate from treatment and other clinical services. Using the CM-RSA combination as an outcome measure for the existing services may be one place to start, while pursuing new evidence from further research on citizenship and community membership for people with mental illness.
Among the limits inherent to this study is the fact that participants were already involved in a process of reintegration into work and therefore could be already in the process of recovery towards full citizenship. But this might also be an advantage because such persons may feel that they do have an opinion to share about the content of items. Another limitation is that the sample consists only of French speaking participants and our civic recovery combination pertains to findings for the French CM and RAS measures. We suggest to test the civic-recovery composite index factor solutions with other people. Also, as our hypothesis is that recovery and citizenship are two related constructs, convergent validity between the CM and RAS was explored. Citizenship and recovery may be related, but they certainly are not synonymous with one another, just like recovery vs self-esteem . More research is needed to assess if, and to what extent these would be different constructs (concurrent validity). Also of importance is to underscore the preliminary nature of these findings, given the small sample size.
This study provided further validation for the Citizenship Measure (CM) and the Recovery Assessment Scale (RAS). Exploratory Factor Analysis and Confirmatory Factor Analyses’ results supported the construct validity and reliability for each dimension or subscale. Significant correlations were also found between these scales and their subscales, thus confirming the convergent validity of both tools. This convergence suggests that the CM and RAS can be used in complementarity of current axioms of recovery to assess civic-recovery as an outcome measure for program evaluations, but more research is needed to explore this new construct.
This research project was funded by the Fondation de l’Institut universitaire en santé mentale de Montréal, Canada. Additional support comes from the International Program for Participatory-Action Research. The authors wish to thank all participating patients and their supervisors in the social firms where they work. We also wish to thank Michèle Anderson, Julie Bordeleau and Sandrine Rousseau for data collection.
- Slade M, Amering M, Oades L. Recovery: an international perspective. Epidemiol Psichiatr Soc. 2008;17:128–37.View ArticlePubMedGoogle Scholar
- Slade M, Williams J, Bird V, Leamy M, Boutillier C. Recovery grows up. J Mental Health. 2012;21(2):99–104.View ArticleGoogle Scholar
- Ware NC, Hopper K, Tugenberg T, Dickey B, Fisher D. Connectedness and citizenship: redefining social integration. Psychiatr Serv. 2007;58(4):469–74.View ArticlePubMedGoogle Scholar
- Rowe M. Crossing the Border: Encounters Between Homeless People and Outreach Workers. Berkeley: University of California Press; 1999.Google Scholar
- Rowe M, Pelletier JF. Mental Illness, Criminality, and Citizenship Revisited. J Am Acad Psychiatry Law. 2012;40(1):8–11.PubMedGoogle Scholar
- Anthony WA. Recovery from mental illness: The guiding vision of the mental health service system in the 1990s. Psychiatr Rehabil J. 1993;16(4):11–23.Google Scholar
- Fisher D. Health care reform based on an empowerment model of recovery by people with psychiatric disabilities. Hosp Community Psychiatry. 1994;45(9):913–5.PubMedGoogle Scholar
- Davidson L, O’Connell M, Tondora J, Lawless M, Evans A. Recovery in serious mental illness: a new wine or just a new bottle? Prof Psychol Res Pr. 2005;36(5):480–7.View ArticleGoogle Scholar
- Davidson L, Roe D. Recovery from versus recovery in serious mental illness. J Mental Health. 2007;16(4):459–70.View ArticleGoogle Scholar
- Hess J, Lacasse J, Harmon J, Williams D, Vierling-Glaassen N. “Is there a getting better from this, or not?” Examining the meaning and possibility of recovery from mental health disorder. Child Youth Serv. 2014;35(2):116–36.View ArticleGoogle Scholar
- U.S. Surgeon General. Mental Health: A report of the Surgeon General. Section 10: Overview of recovery. 1999. http://profiles.nlm.nih.gov/ps/access/NNBBHS.pdf.
- Ralph RO, Kidder K, Phillips D. Can We Measure Recovery? A Compendium of Recovery and Recovery-related Instruments. Cambridge, MA: Human Services Research Institute; 2000.Google Scholar
- Ganann R, Ciliska D, Thomas H. Expediting systematic reviews: methods and implications of rapid reviews. Implement Sci. 2010;19(5):56.View ArticleGoogle Scholar
- Rowe M, Clayton A, Benedict P, Bellamy C, Antunes K, Miller R, et al. Going to the source: creating a citizenship outcome measure by community-based participatory research methods. Psychiatr Serv. 2012;63(5):445–50.View ArticlePubMedGoogle Scholar
- Corrigan PW, Salzer M, Ralph RO, Sangster Y, Keck L. Examining the factor structure of the Recovery Assessment Scale. Schizophr Bull. 2004;30(4):1035–41.View ArticlePubMedGoogle Scholar
- Salzer M, Brusilovskiy E. Advancing recovery science: reliability and validity properties of the Recovery Assessment Scale. Psychiatr Serv. 2014;65(4):442–53.View ArticlePubMedGoogle Scholar
- Shanks V, Williams J, Leamy M, Bird VJ, Le Boutillier C, Slade M. Measures of personal recovery: a systematic review. Psychiatr Serv. 2013;64(10):974–80.View ArticlePubMedGoogle Scholar
- Campbell DT, Fiske DW. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull. 1959;56(2):81–105.View ArticlePubMedGoogle Scholar
- Vallerand RJ. Toward a methodology for the transcultural validation of psychological questionnaires: Implications for research in the French language. Can Psychol. 1989;30(4):662–80.View ArticleGoogle Scholar
- Corrigan PW, Giffort D, Rashid F, Leary M, Okeke I. Recovery as a psychological construct. Community Ment Health J. 1999;35(3):231–9.View ArticlePubMedGoogle Scholar
- Costello A, Osborne J. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess Res Eval. 2005;10(7):173–8.Google Scholar
- Bentler P. EQS, Structural Equations Program Manual. 1995.Google Scholar
- Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297–334.View ArticleGoogle Scholar
- Beavers A, Lounsbury J, Richards J, Huck S, Skolits G, Esquivel S. Practical considerations for using exploratory factor analysis in educational research. Pract Assess Res Eval. 2013;18(6):1–13.Google Scholar
- Byrne B. A primer of LISREL: Basic applications and programming for confirmatory factor analytic models. New York/Berlin: Springer-Verlag; 1989.View ArticleGoogle Scholar
- Hofmann R. Establishing factor validity using variable reduction in confirmatory factor analysis. Educ Psychol Meas. 1995;55:572–82.View ArticleGoogle Scholar
- Hox JJ. Amos, EQS, and LISREL for Windows: A comparative review. Struct Equation Model. 1995;2(1):79–91.View ArticleGoogle Scholar
- Akaike H. Factor analysis and AIC. Psychometrica. 1987;52(3):317–32.View ArticleGoogle Scholar
- Streiner DL, Norman GR. Health measurement scales: A practical guide to their development and use. 3rd ed. Oxford: Oxford University Press; 1995.Google Scholar
- Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. 4th ed. Oxford: Oxford University Press; 2008.View ArticleGoogle Scholar
- DeVellis RF. Scale Development: Theory and Applications. Thousand Oaks, California: Sage Publications; 2011.Google Scholar
- Farkas M. The vision of recovery today: what it is and what it means for services. World Psychiatry. 2007;6(2):68–74.PubMedPubMed CentralGoogle Scholar
- Windell D, Norman R, Malla A. The personal meaning of recovery among individuals treated for a first episode of psychosis. Psychiatr Services. 2012;63(6):548–53.View ArticleGoogle Scholar
- Slade M, Amering M, Farkas M, Hamilton B, O’Hagan M, Panther G, et al. Uses and abuses of recovery: implementing recovery-oriented practices in mental health systems. World Psychiatry. 2014;13(1):12–20.View ArticlePubMedPubMed CentralGoogle Scholar
- Davidson L, Lawless MS, Leary F. Concepts of recovery: competing or complementary? Curr Opin Psychiatry. 2005;18(6):664–7.View ArticlePubMedGoogle Scholar
- Mukolo A, Heflinger C, Baxter J. Recovery and self-esteem: concurrent validity of the Recovery Assessment Scale. Int J Psychosoc Rehabil. 2011;15(2):41–68.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.