- Research article
- Open Access
Psychometric properties of the Japanese version of the Recovery Attitudes Questionnaire (RAQ) among mental health providers: a questionnaire survey
BMC Psychiatry volume 16, Article number: 32 (2016)
“Recovery” is a central concept in mental health, particularly for mental health services and policy-makers. The present study examined the factorial and concurrent validity, internal consistency reliability, and test–retest reliability of the Japanese version of the 7-item Recovery Attitudes Questionnaire (RAQ) among mental health service providers in community and inpatient settings in Japan.
We conducted a cross-sectional questionnaire with a number of eligible professional groups, including psychiatrists, registered/assistant nurses, public health nurses, clinical psychologists, pharmacists, occupational therapists, and social workers. Participants were drawn from two psychiatric hospitals and 56 psychiatric clinics or community service agencies. In total, 331 participants completed the questionnaire. After excluding those with missing RAQ values, 307 participants were included in the analysis; the participants’ mean age was 40.2 years and 29.6 % were men. The questionnaire comprised the Japanese version of the 7-item RAQ developed by the present authors, the revised scale of the positive attitudes of staff toward persons with mental disorder (the positive attitudes scale), and the Japanese-language version of the Social Distance Scale (SDSJ). Confirmatory factor analyses were used to examine factorial validity of a two-factor structure reported in a previous study (Borkin et al., 2000) as well as a single-factor structure. Concurrent validity was determined by calculating correlations between RAQ and the other two scales. Internal consistency reliability was assessed with Cronbach’s alpha coefficients and inter-item correlations. Test–retest reliability was assessed by the intraclass correlation coefficient (ICC), with a weighted kappa in a subsample of participants (n = 13).
The two-factor structure showed acceptable factorial validity. RAQ scores were significantly and positively correlated with the positive attitudes scale, and there was a significant inverse correlation with the SDSJ (p < 0.01). The RAQ had an overall Cronbach’s alpha coefficient of 0.64. Four inter-item correlations were not significant. The ICC and weighted kappa values indicated unsatisfactory test–retest reliability.
The Japanese RAQ showed acceptable factorial validity, reasonable concurrent validity, and unsatisfactory reliability in community and inpatient mental health settings in Japan. Further large-scale research is required to ensure robust verification.
“Recovery” is a central concept in mental health, particularly for mental health services and policy-makers. The recovery concept first emerged in the 1980s as a movement led by people with mental illness in the US. Since then, the recovery concept has prevailed in Western countries and more recently, in other parts of the world such as Asian and African countries [1–4]. Recovery is defined as a complex process of developing new meaning and purpose in life as one grows beyond the catastrophic effects of mental illness . Recovery is considered to be an individualized process related to subjective, multifaceted dimensions such as hope, self-identity, meaning in life, and personal responsibility . This concept clearly differs from the traditional treatment-based concept of recovery, which focuses on the illness with a goal of symptomatic remission or functional improvement.
Even though recovery can be achieved without mental health services, mental health service providers play an important role in facilitating recovery, as they provide professional, directive support [7, 8]. Embracing recovery requires mental health service providers to approach service provision with new way of thinking, refined skills, and attitudes that include developing relationships within an even power balance . For example, it is necessary to develop self-control of own anxiety when people with mental illness would take risks in trying something new, and acknowledging that people with mental illness have expertise through experience . Embracing recovery also includes emphasizing an individual’s possibilities, rather than concentrating on the problems; this means that service providers support people with mental illness to identify their own strengths [11, 12]. Service providers’ attitudes toward recovery also help to foster a recovery-oriented organizational system that goes beyond individual-level care provision .
Several studies in Western populations have suggested that service providers’ attitudes and knowledge about the several aspects of recovery can be improved [9, 11]. Service providers’ attitudes toward recovery are considered to be associated with positive attitudes toward people with mental illness. Other studies have found that some service providers exhibit harmful stigma toward people with mental illness that may impede recovery-oriented care [14–17]. This stigma toward them is considered to be negatively associated with service providers’ attitudes toward recovery.
To date, various scales have been developed to assess an individual’s attitude toward recovery or knowledge of recovery [8, 18, 19]. Among these, the Recovery Attitudes Questionnaire (RAQ) , developed in the US, is a representative scale that assesses attitudes about the belief that people can recover from mental illness. Borkin et al. (2000) theoretically established a two-factor structure for RAQ items, and found marginally adequate internal consistency in a US sample . Subsequent studies with Australian and Dutch mental health professionals examining the psychometric properties of RAQ suggested further research was necessary to confirm the suitability of RAQ in those countries [20, 21]. This suggests that elaborative evaluation is needed to consider the cross-cultural applicability of RAQ.
To enhance recovery among people with mental illness, many programs have been developed for people with mental illness and for service providers. RAQ has been used in such interventional studies over the past decade to examine their effectiveness [22–24]. Examining the reliability and validity of the Japanese version of RAQ will be useful to assess its possible use in future studies in Japan. To date, most of the studies on recovery have been conducted in community settings; however, inpatients in psychiatric wards also have their own paths to recovery [25, 26], and recovery-oriented principles should be applied in inpatient settings [27, 28].
The present study aimed to examine the factorial validity, concurrent validity, internal consistency reliability, and test–retest reliability of the Japanese version of the 7-item RAQ among mental health service providers in community and inpatient settings in Japan. We hypothesized that the Japanese version of RAQ would show good factorial validity to the two-factor structure and good reliability. We also hypothesized that RAQ scores would show significant correlation with the scores on related scales, in the assumed direction for each related scale.
A cross-sectional, self-administered questionnaire survey was conducted with mental health service providers from February to March 2012. Professional groups eligible for inclusion whether they worked full- or part-time were: psychiatrists, registered/assistant nurses, public health nurses, clinical psychologists, pharmacists, occupational therapists, and social workers. We conducted the survey in two psychiatric hospitals in the Kanto region and 56 psychiatric clinics or community service agencies in Tokyo, Japan.
There were 220 eligible professionals in the two psychiatric hospitals; 180 of these agreed to participate and returned completed questionnaires (response rate = 81.8 %). In the psychiatric clinics and community service agencies, there were 255 eligible professionals, and 151 agreed to participate and responded to the questionnaire (response rate = 59.2 %). This gave a total of 331 respondents; 24 were excluded because they were missing responses for one or more RAQ items. We used data from the remaining 307 participants for the analyses.
The questionnaire included RAQ, the revised scale of the positive attitudes of staff toward persons with mental disorder (the positive attitudes scale), and the Japanese-language version of the Social Distance Scale (SDSJ). We also collected data on socio-demographic and occupational variables.
Development of the Japanese version of the 7-item RAQ
RAQ includes seven items such as “Recovery can occur even if symptoms of mental illness are present.” Responses are on a 5-point Likert scale ranging from “strongly disagree” to “strongly agree” . Higher total scores indicate a more positive attitude to the concept of recovery. Two specific RAQ domains were determined with factor analysis: 1) recovery is possible and needs faith, and 2) recovery is difficult and differs among people. A US study demonstrated that the 7-item RAQ has sound internal consistency reliability, test–retest reliability, and factorial validity . RAQ includes a brief introduction before the items:
“Recovery is a process and experience that we all share. People face the challenge of recovery when they experience the crises of life, such as the death of a loved one, divorce, physical disabilities, and serious mental illnesses. Successful recovery does not change the fact that the experience has occurred, that the effects are still present, and that one’s life has changed forever. Rather, successful recovery means that the person has changed, and that the meaning of these events to the person has also changed. They are no longer the primary focus of the person’s life.” 
We translated the 7-item RAQ into Japanese with the consent of the original developer, referring to relevant guidelines for translating and adapting psychometric scales . We developed the Japanese 7-item RAQ in five steps. 1) Forward translation: two of the present authors independently translated RAQ from English into Japanese. 2) Reconciliation: five mental health researchers discussed and reached consensus on a draft Japanese translation of RAQ that best reflected the literal and conceptual content of the original English version. 3) Cognitive debriefing and review of cognitive debriefing results: two mental health service providers, a peer-support group leader with chronic mental illness, and five peer-support group participants tested RAQ, after which the present authors reworded the items as necessary to ensure they were understandable. 4) Back-translation: two native English-speaking professional translators, who had not seen the original English RAQ back-translated the Japanese version into English. 5) Back-translation review and finalization: the present authors reviewed the back translations against the source instrument to ensure the literal and conceptual equivalence of the translation. The translation included the introductory sentences described above . Additional file 1 shows the Japanese version of the RAQ.
To examine the construct and concurrent validity of RAQ, we used two additional scales to assess staff attitudes toward people with mental illness.
The positive attitudes scale
The positive attitudes scale is a 19-item scale, comprising three domains covering expectations about the ability and recovery of people with mental illness, attitudes toward living alongside those people, and supportive helping behaviors. The items, for example, “I think most people with mental illness can take responsibility for their own lives” are rated on a 4-point Likert scale, ranging from “strongly disagree” to “strongly agree.” A higher score indicates a more positive attitude toward people with mental illness. The good internal consistency reliability and good convergent validity of the positive attitudes scale have been previously confirmed among mental health service providers in Japan .
SDSJ was developed in reference to the original scale created by Whatley , which was a 5-item scale designed to assess an individual’s sense of social distance from people with schizophrenia. SDSJ includes items such as “I think it best not to associate with people with schizophrenia.” Responses are on a 4-point Likert scale ranging from “disagree” to “agree,” with a higher scale score indicating a more negative attitude. SDSJ has been found to have good internal consistency reliability, good test–retest reliability, and acceptable factorial validity . Though RAQ is a scale to assess one’s attitude for not people with schizophrenia but inclusive people with mental illness, we used the unchanged version of SDSJ, because a revised version with confirmed reliability and validity was not available.
Borkin et al. (2000)  demonstrated a theoretically significant two-factor structure for RAQ (Factor 1 = “Recovery is possible and needs faith; Factor 2 = “Recovery is difficult and differs among people). We conducted confirmatory factor analysis (CFA) to test the model fit of the data to the factor structure. In addition, as RAQ is a 7-item scale, we used CFA for a single-factor structure. CFA were conducted in AMOS ver. 23.0 using structural equation modeling (SEM). Maximum likelihood estimation was used to examine goodness of fit for the models using the following criteria : goodness of fit index (GFI) >0.90; adjusted goodness of fit index (AGFI) >0.90; comparative fit index (CFI) >0.90; and a smaller Akaike’s information criterion (AIC) that indicates better model. Concurrent validity was assessed by calculating Pearson’s correlation coefficients between the total RAQ score and the scores for the other two scales.
We calculated Cronbach’s alpha coefficients for the total RAQ score, and for each factor score. As Cronbach’s alpha coefficients may not be sufficient to measure the homogeneity of each item , we also calculated inter-item correlations. Test–retest reliability was examined by calculating the intraclass correlation coefficient (ICC) for the total score and quadratic weighted kappa values for each item in a subsample of participants (n = 13) who were re-surveyed 2 weeks after the original questionnaire. This test–retest time interval was chosen as we considered it was long enough to prevent recall of previous answers, while being short enough to assume that the condition would not change in most cases. The scores were compared with ICC standards (almost perfect, >0.81; substantial, 0.61–0.80; moderate, 0.41–0.60; fair, 0.21–0.40; and slight, 0.0–0.20)  and kappa values (good, >0.61; moderate, 0.41–0.60; slight, 0.21–0.40; and poor, <0.20) .
All statistical analyses, including descriptive analyses (other than those described above), were conducted using SPSS 23.0 J for Windows. P values of less than 0.05 were considered statistically significant (two-tailed tests).
The aim and procedures of this study were approved by the Ethical Committee of The University of Tokyo. It was qualified to approve recruitment at all sites from which participants were enrolled. All participants received full explanations in writing about the purpose and methods, as well as the data storage and privacy protection methods employed in the study. Providing an answer represented their agreement to participate in the study. The survey was conducted on an anonymous basis.
Table 1 presents participants’ socio-demographic and occupational characteristics. About 70 % of the participants were female, 40 % were registered or assistant nurses, and 35 % were psychiatric social workers. The mean age of participants was 40.2 years (standard deviation [SD] = 11.8 years; range 22–74 years), and the mean length of work experience in psychiatric services was 9.8 years (SD = 8.4 years; range 0–45 years).
The mean total RAQ score was 27.98 (SD = 2.85; range 14–35). Item 7 showed a marginal ceiling effect; that is, most participants agreed with this item, meaning collective scores were disproportionately higher. The mean RAQ total scores by occupation (in descending order) were: 28.05 (SD = 2.22) for clinical psychologists (n = 19); 27.40 (SD = 2.46) for occupational therapists (n = 20); 27.19 (SD = 2.93) for social workers (n = 109); 27.00 (SD = 2.48) for psychiatrists (n = 16); and 26.63 (SD = 3.04) for registered nurses/assistant nurses (n = 134). Total scores were not calculated for pharmacists (n = 6) and public health nurses (n = 3) as these samples were small. We found no significant differences between the occupations.
Validity of RAQ
The two-factor structure  fitted the data better than the single-factor structure (Table 2). GFI and AGFI for the two-factor structure indicated a good fit, although CFI did not reach the recommended standard (GFI = 0.95; AGFI = 0.90; CFI = 0.86; AIC = 85.26). However, three of the seven RAQ items had relatively small loadings: Item 2 “To recover requires faith” (0.26), item 5 “Recovering from mental illness is possible no matter what you think may cause it” (0.33), and item 7 “People differ in the way they recover from a mental illness” (0.35) (Fig. 1).
The mean total score for the positive attitudes scale was significantly and positively correlated with the mean RAQ total score (r = 0.38; p < 0.01), the mean RAQ Factor 1 score (r = 0.35; p < 0.01), and the mean RAQ Factor 2 score (r = 0.24; p < 0.01). The mean total SDSJ score was significantly and negatively correlated with the mean RAQ total score (r = −0.29; p < 0.01), the mean RAQ Factor 1 score (r = −0.26; p < 0.01), and the mean RAQ Factor 2 score (r = −0.21; p < 0.01).
Reliability of RAQ (internal consistency reliability and test–retest reliability)
Cronbach’s alpha coefficients were 0.64 for the mean total RAQ score, 0.53 for the mean Factor 1 score (Recovery is possible and needs faith, four items), and 0.56 for the mean Factor 2 score (Recovery is difficult and differs among people, three items). In addition, inter-item correlation coefficients were moderate to slight (Table 3). While most correlations were significant, the correlations for RAQ items 1 and 6, items 2 and 5, items 3 and 6, and items 6 and 7 were not significant.
ICC for the mean total RAQ score was 0.68, indicating substantial reliability. The weighted kappa values for each item were also examined. Two of the seven items had weighted kappa values of 0.41–0.60, indicating moderate reliability, while the other five items (RAQ items 1, 2, 4, 5, and 6) had weighted kappa values of 0.40 or less, indicating slight or poor reliability.
The Japanese version of the 7-item RAQ showed acceptable factorial validity, reasonable concurrent validity, and unsatisfactory internal consistency reliability and test–retest reliability among mental health professionals in Japan.
CFA showed that the two-factor model  fit the data acceptably, though RAQ item 2 (To recover requires faith) had particularly small factor loading (0.26) for Factor 1 (Recovery is possible and needs faith). Given that this item indicates an attitude that recovery is difficult without faith, it may be argued that it also comes under Factor 2 (Recovery is difficult and differs among people). Studies using the Dutch version of RAQ  and in Australia  also found that RAQ item 2 had lower factor loading and did not fit the factor structure. Faith is a concept with diverse meanings, dependent on the culture, context, and even the setting in which it is used [20, 37]; it describes confidence, belief, or trust in a being, object, living organism, deity, view, or the doctrines or teachings of a religion. In Western or secular culture, faith has been argued as being present in science-based clinical practice, because science has replaced religion . However, in Japan, concepts of faith may include the inner mind and spirituality stemming from traditional Japanese culture that values virtue and loyalty over science. At the same time, the nuances of this interpretation of Japanese faith may vary depending on the translated expression. Therefore, to validate cross-cultural applicability, it will be necessary to define faith in the context of RAQ, and to refine the expression used after a careful review of the wording in the Japanese version.
The positive attitudes score was significantly and positively correlated with the RAQ score, while the SDSJ score was significantly and inversely correlated with the RAQ score. Although these correlations were not strong, they were consistent with our hypotheses. The moderate correlation between the RAQ and the positive attitudes scores suggests that while conceptually not the same, they are close. The RAQ domain, “Recovery is possible,” was similar to the positive attitudes scale domain “An expectation for the ability and recovery of people with mental illness.” On the other hand, the RAQ domain “Recovery is difficult and differs among people” did not overlap with the other two domains of the positive attitudes scale (attitude toward living alongside people with mental illness, and supportive helping behaviors). The significant and inverse correlation between the RAQ and SDSJ scores was consistent with previous studies conducted in the US [39, 40]. As previous conceptual and empirical studies have suggested that the recovery of people with mental illness can be impeded by stigma [41–43], this finding demonstrates the reasonable concurrent validity of the Japanese version of RAQ. A possible reason for the relatively weak correlation observed in our study seems due to the difference in the target diseases between RAQ (mental illness in general) and SDSJ (schizophrenia). This difference may affect the results, since people with schizophrenia are more likely to be stigmatized compared to those with other mental illness .
The Cronbach’s alpha coefficients in the present study (0.64, 0.53, and 0.56 for the total RAQ and factor scores) indicated the Japanese RAQ had unsatisfactory internal consistency reliability; although this is limited by the small number of scale items , the values were not sufficiently high to meet the recommended 0.72 standard . The relatively modest values we found are comparable to previous studies using RAQ that reported values of 0.57 (German version)  and 0.61 (Dutch version) . However, other studies have reported somewhat higher Cronbach’s alpha coefficients, with 0.70 in the US , 0.70 for the German version , and 0.74 in Australia . Inter-item correlation coefficients showed that RAQ item 6 (All people with serious mental illness can strive for recovery) had insignificant and weak correlations with RAQ items 1 (People in recovery sometimes have setbacks), 3 (Stigma associated with mental illness can slow down the recovery process), and 7 (People differ in the way they recover from a mental illness). As some of our participants worked in inpatient settings and provided care for people with severe mental illness, there might be a tendency to not agree with item 6, regardless of positive answers to the other items. This might explain the poor correlations between those items.
We found the Japanese RAQ had reasonable test–retest reliability by the ICC. However, the quadratic weighted Kappa values for five of the seven items ranged from slight to poor. Although the specific reason for this is unclear, the non-systematic variability cannot be justified in a two-week test–retest interval. These item scores might depend on changing mood or other conditions related to a short time span. One can also argue that even 2 weeks interaction between providers and people with mental illness might affect providers’ attitude toward recovery. In addition, the test–retest reliability analysis was conducted in a small sample, and may need to be further examined in future research with a larger number of participants.
We included the introduction describing the concept of recovery  in our literal translation of RAQ. Similar to the concept of faith, the concept of recovery also has multifaceted connotations. For example, it often encompasses a traditional meaning of a complete cure. Therefore, the explanation of the meaning of recovery in the RAQ context is a key issue, particularly as the concept of recovery has not yet permeated the mental health field in Japan, and might have resulted in biased responses. The introductory sentences could, for example, provide previously unknown information about recovery, enhance practitioners’ awareness, or even prompt respondents to answer disproportionately based on social expectations. The mean RAQ total score in the present study may therefore be overestimated. Further research is required to examine the appropriateness of the wording used in the introduction.
In Western countries, RAQ has been used for service providers and for people with mental illness [46–52]. Examining its applicability in Japanese people with mental illness may be a relevant topic for future study, particularly as the concept of what constitutes recovery may differ between healthcare providers and people with mental illness .
There are some limitations of the present study. First, participants were selected from institutions in specific areas only. In addition, three-quarters of the total study population were registered/assistant nurses, and psychiatric social workers. Although attitudes toward recovery did not differ among occupations in this study, they may vary between areas (urban versus rural), institutional cultures, or professional roles. In short, the generalization of our findings poses a challenge for the future. Second, although the response rate was high, there were a number of non-respondents. The non-responders might have been more likely to report lower attitudes toward recovery and stigma toward people with mental illness. Therefore, the mean RAQ total score in the present study may be slightly overestimated. Further large-scale research that includes a more diverse mental health service provider population is required for robust verification, particularly in terms of the reliability of the Japanese version of the 7-item RAQ.
The present study demonstrated the factorial validity, concurrent validity, and internal consistency reliability of the Japanese version of the 7-item RAQ among mental health service providers in community and inpatient settings in Japan. We found the Japanese RAQ had acceptable factorial validity, reasonable concurrent validity, and unsatisfactory reliability. Further large-scale research is required to ensure robust verification of the Japanese RAQ.
Recovery Attitudes Questionnaire
the Japanese-language version of Social Distance Scale
Chiba R, Kawakami N, Miyamoto Y. Quantitative relationship between recovery and benefit-finding among persons with chronic mental illness in Japan. Nurs Health Sci. 2011;13(2):126–32.
Kaewprom C, Curtis J, Deane FP. Factors involved in recovery from schizophrenia: a qualitative study of Thai mental health nurses. Nurs Health Sci. 2011;13(3):323–7.
Parker JS. Developing the philosophy of recovery in South African mental health services. Afr J Psychiatry (Johannesbg). 2012;15(6):417–9.
Tse S, Davidson L, Chung KF, Ng KL, Yu CH. Differences and similarities between functional and personal recovery in an Asian population: a cluster analytic approach. Psychiatry. 2014;77(1):41–56.
Anthony WA. Recovery from mental illness: the guiding vision of the mental health service system in the 1990s. Psychosoc Rehabil J. 1993;16(4):11–23.
Andresen R, Oades L, Caputi P. The experience of recovery from schizophrenia: towards an empirically validated stage model. Aust N Z J Psychiatry. 2003;37(5):586–94.
Russinova Z, Rogers ES, Ellison ML, Lyass A. Recovery-promoting professional competencies: perspectives of mental health consumers, consumer-providers and providers. Psychiatr Rehabil J. 2011;34(3):177–85.
Salyers MP, Brennan M, Kean J. Provider Expectations for Recovery Scale: refining a measure of provider attitudes. Psychiatr Rehabil J. 2013;36(3):153–9.
Cleary A, Dowling M. Knowledge and attitudes of mental health professionals in Ireland to the concept of recovery in mental health: a questionnaire survey. J Psychiatr Ment Health Nurs. 2009;16(6):539–45.
Schrank B, Slade M. Recovery in psychiatry. Psychiatr Bull. 2007;31:321–5.
Klockmo C, Marnetoft SU, Nordenmark M, Dalin R. Knowledge and attitude regarding recovery among mental health practitioners in Sweden. Int J Rehabil Res. 2012;35(1):62–8.
Rapp CA, Goscha RJ. The strengths model: case management with people with psychiatric disabilities. Oxford: Oxford University Press; 2006.
Malinovsky I, Lehrer P, Silverstein SM, Shankman SA, O’Brien W, Samuelson T, et al. An empirical evaluation of recovery transformation at a large community psychiatric rehabilitation organization. Psychol Serv. 2013;10(4):428–41.
Rao H, Mahadevappa H, Pillay P, Sessay M, Abraham A, Luty J. A study of stigmatized attitudes towards people with mental health problems among health professionals. J Psychiatr Ment Health Nurs. 2009;16(3):279–84.
Ross CA, Goldner EM. Stigma, negative attitudes and discrimination towards mental illness within the nursing profession: a review of the literature. J Psychiatr Ment Health Nurs. 2009;16(6):558–67.
Schulze B. Stigma and mental health professionals: a review of the evidence on an intricate relationship. Int Rev Psychiatry. 2007;19(2):137–55.
Vendsborg P, Bratbo J, Dannevang A, Hagedorn-Moller J, Kistrup K, Lindhardt A, et al. Staff attitudes towards patients with schizophrenia. Dan Med J. 2013;60(10):A4710.
Bedregal LE, O’Connell M, Davidson L. The Recovery Knowledge Inventory: assessment of mental health staff knowledge and attitudes about recovery. Psychiatr Rehabil J. 2006;30(2):96–103.
Borkin JR, Steffen JJ, Ensfield LB, Krzton K, Wishnick H, Wilder K, et al. Recovery attitudes questionnaire: development and evaluation. Psychiatr Rehabil J. 2000;24(2):95–102.
Hungerford C, Dowling M, Doyle K. Recovery Outcome Measures: Is There a Place for Culture, Attitudes, and Faith? Perspect Psychiatr Care. 2015;53(1):171–9.
Wilrycx G, Croon MA, van den Broek A, van Nieuwenhuizen C. Psychometric properties of three instruments to measure recovery. Scand J Caring Sci. 2012;26(3):607–14.
Crowe TP, Deane FP, Oades LG, Caputi P, Morland KG. Effectiveness of a collaborative recovery training program in Australia in promoting positive views about recovery. Psychiatr Serv. 2006;57(10):1497–500.
Salgado JD, Deane FP, Crowe TP, Oades LG. Hope and improvements in mental health service providers’ recovery attitudes following training. J Ment Health. 2010;19(3):243–8.
Young AS, Chinman M, Forquer SL, Knight EL, Vogel H, Miller A, et al. Use of a consumer-led intervention to improve provider competencies. Psychiatr Serv. 2005;56(8):967–75.
Chiba R, Miyamoto Y, Kawakami N. Reliability and validity of the Japanese version of the Recovery Assessment Scale (RAS) for people with chronic mental illness: scale development. Int J Nurs Stud. 2010;47(3):314–22.
Chiba R, Kawakami N, Miyamoto Y, Andresen R. Reliability and validity of the Japanese version of the Self-Identified Stage of Recovery for people with long term mental illness. Int J Ment Health Nurs. 2010;19(3):195–202.
McLoughlin KA, Du Wick A, Collazzi CM, Puntil C. Recovery-oriented practices of psychiatric-mental health nursing staff in an acute hospital setting. J Am Psychiatr Nurses Assoc. 2013;19(3):152–9.
Rabenschlag F, Konrad A, Rueegg S, Jaeger M. A recovery-oriented approach for an acute psychiatric ward: is it feasible and how does it affect staff satisfaction? Psychiatr Q. 2014;85(2):225–39.
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for Patient-Reported Outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8(2):94–104.
Iwai K, Nonaka T. The influence of workplace environment on the positive attitudes of staff toward persons with mental disorder. Jpn Bull Soc Psychiat. 2011;20:94–105 (in Japanese).
Whatley CD. Social attitudes toward discharge mental patients. Soc Probl. 1959;6:313–20.
Makita K. Development and reliability of the Japanese-language version of Social Distance Scale. Jpn Bull Soc Psychiat. 2006;14:231–41 (in Japanese).
Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structural analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6(1):1–55.
Schmitt N. Uses and abuses of coefficient alpha. Psychol Assess. 1996;8(4):350–3.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.
Fayers PM, Machin D. Quality of life: the assessment, analysis and interpretation of patient-reported outcomes. 2nd ed. Chichester, UK: John Wiley & Sons; 2007.
Pelechova M, Wiscarson G, Tracy D. Spirituality and the mental health professions. Psychiatrist. 2012;36(7):249–54.
Koenig HG. Religion, spirituality, and medicine: research findings and implications for clinical practice. South Med J. 2004;97(12):1194–200.
Barczyk AN. Relationship between the public’s belief in recovery, level of mental illness stigma, and previous contact. Community Ment Health J. 2015;51(1):38–47.
Corrigan PW, Powell KJ, Michaels PJ. Brief battery for measurement of stigmatizing versus affirming attitudes about mental illness. Psychiatry Res. 2014;215(2):466–70.
Jacobson N, Greenley D. What is recovery? A conceptual model and explication. Psychiatr Serv. 2001;52(4):482–5.
Link BG, Struening EL, Neese-Todd S, Asmussen S, Phelan JC. Stigma as a barrier to recovery: The consequences of stigma for the self-esteem of people with mental illnesses. Psychiatr Serv. 2001;52(12):1621–6.
Tsang HWT, Tam PKC, Chan F, Cheung WM. Stigmatizing attitudes towards individuals with mental illness in Hong Kong: implications for their recovery. J Community Psychol. 2003;31(4):383–96.
Ando S, Yamaguchi S, Aoki Y, Thornicroft G. Review of mental-health-related stigma in Japan. Psychiatry Clin Neurosci. 2013;67(7):471–82.
Jaeger M, Konrad A, Rueegg S, Rabenschlag F. Measuring recovery: validity of the “Recovery Process Inventory” and the “Recovery Attitudes Questionnaire”. Psychiatry Res. 2013;210(1):363–7.
Rabenschlag F, Hoffmann H, Conca A, Schusterschitz C. Who benefits from peer support in psychiatric institutions? Psychiatr Q. 2012;83(2):209–20.
Bullock WA, Ensing DS, Alloy VE, Weddle CC. Leadership education: evaluation of a program to promote recovery in persons with psychiatric disabilities. Psychiatr Rehabil J. 2000;24(1):3–11.
Dunn EC, Sally Rogers E, Hutchinson DS, Lyass A, MacDonald Wilson KL, Wallace LR, et al. Results of an innovative university-based recovery education program for adults with psychiatric disabilities. Adm Policy Ment Health. 2008;35(5):357–69.
Hutchinson DS, Anthony WA, Ashcraft L, Johnson E, Dunn EC, Lyass A, et al. The personal and vocational impact of training and employing people with psychiatric disabilities as providers. Psychiatr Rehabil J. 2006;29(3):205–13.
Resnick SG, Rosenheck RA. Integrating peer-provided services: a quasi-experimental study of recovery orientation, confidence, and empowerment. Psychiatr Serv. 2008;59(11):1307–14.
Resnick SG, Rosenheck RA. Who attends Vet-to-Vet? Predictors of attendance in mental health mutual support. Psychiatr Rehabil J. 2010;33(4):262–8.
Vreeland B, Minsky S, Yanos PT, Menza M, Gara M, Kim E, et al. Efficacy of the team solutions program for educating patients about illness management and treatment. Psychiatr Serv. 2006;57(6):822–8.
Aston V, Coffey M. Recovery: what mental health nurses and service users say about the concept of recovery. J Psychiatr Ment Health Nurs. 2012;19(3):257–63.
This study was funded by the charitable trust of the Fumiko Yamaji Foundation for Nursing Education and Research, and Gushinkai Foundation, Japan. And it was partially supported by the Ministry of Education, Science, Sports and Culture, Grant-in-Aid for Scientific Research, 25862241.
All authors declare that they have no competing interests.
RC, MU, KG, YM, SY, and NK contributed to conception and design of the study. RC, KG, and MU contributed to acquisition of data. RC wrote the first draft of the manuscript. All of the authors contributed to the development of the Japanese version of the RAQ including forward and back translation procedure, interpretation of data, and have approved the final manuscript.
About this article
Cite this article
Chiba, R., Umeda, M., Goto, K. et al. Psychometric properties of the Japanese version of the Recovery Attitudes Questionnaire (RAQ) among mental health providers: a questionnaire survey. BMC Psychiatry 16, 32 (2016). https://0-doi-org.brum.beds.ac.uk/10.1186/s12888-016-0740-x
- Mental Illness
- Concurrent Validity
- Internal Consistency Reliability
- Japanese Version
- Factorial Validity