Skip to main content

Quality assessment of a consultation-liaison psychiatry service

Abstract

Background

Consultation-Liaison Psychiatry (CLP) provides services for patients with medical-psychiatric comorbidity at the general hospital. Referral satisfaction is considered as one of the most important outcome measures of CLP interventions. Our aim was to assess the levels of satisfaction with the CLP service amongst medical staff at a university hospital in Denmark.

Methods

Medical staff answered an online survey regarding their experience with different aspects of inpatient and outpatient CLP services.

Results

There were 152 responses from 16 medical units, with a survey return rate above 85%. Measured on a 5-point Likert scale, there was a median rating of 4 in response to questions regarding communication and organizational aspects, a median rating of 5 in response to questions regarding overall evaluation of the CLP service on both inpatient and outpatient questionnaire. The questions regarding treatment quality were rated with a median of 4 on the inpatient questionnaire and 2 of the outpatient questionnaire items, and with a median of 5 on 2 outpatient items. Physicians´ evaluations were statistically more positive than nurses´. As a group, respondents already employed before the CLP unit was established and those who used the CLP services more were statistically significantly more satisfied then respondents employed after the establishment of the CLP unit and those who used the CLP service less.

Conclusion

The CLP services were positively appreciated and considered to be valuable among medical hospital staff. We believe that Consultation-Liaison Psychiatry deserves further help to implement and expand its services in general hospital settings. In addition, our results underline the feasibility of surveys as quality measures of clinical care.

Peer Review reports

Background

Individuals with mental disorders are more frequently affected by physical conditions [1, 2], whereas a large proportion of patients suffering from medical conditions also experience mental health problems [3,4,5]. Medical-psychiatric comorbidity is linked to increased length of hospital stay, higher medical costs and often rehospitalization [6]. Consultation-Liaison Psychiatry (CLP) is a subspecialty of psychiatry that provides assessment and treatment for general hospital patients with mental health comorbidities. It also provides teaching and research activities on mental health comorbidity to medical staff of non-psychiatric departments of general hospitals [7]. Although CLP services in the general hospital does not seem to reduce the length of hospitalization [8], they have a positive impact on mental health problems [9], and are cost effective [10]. Joint projects between medical and psychiatric professionals seem to ensure the best way to reduce the existing gap between medical specialties and psychiatry [11]; Consultation-Liaison Psychiatry services perform generally well in this context, with an earlier study showing an overall positive attitude towards CLP services among general medical hospital staff [12].

There is widespread agreement among professionals, managers and policy makers that an ongoing evaluation of CLP service quality using standardized measurements [13] is needed. Different measurement tools and quality indicators have been identified and developed in recent years, to assess consultee satisfaction [14], service utilization and efficiency [15], to secure quality improvement and accreditation [13], to improve service effectiveness [16] and to facilitate quality and outcome assessment and standardization of services [17]. However, a more widespread examination of CLP service quality across different countries [18], with an emphasis on using structured measurement tools [16] is needed. Since referrer satisfaction can be perceived as a proxy for a global measure of CLP service performance [19], it has been advocated that more attention should be paid to evaluating levels of staff satisfaction with different aspects of the CLP service [15].

Although staff feedback is recognized as important, there is a relative paucity of studies examining medical staff satisfaction with the CLP services. A review from 2014 identified only 13 studies on staff feedback between 1977 and 2011 [10], while in the more recent years only a few more studies have assessed consultee satisfaction [15, 20, 21]. Earlier studies solely focused on overall service evaluation rather than examining staff feedback on more specific aspects of the service [10]. To our knowledge no previous studies have assessed the impact of different consultee characteristics and service utilization parameters on satisfaction levels with CLP services.

The aim of the present study was to examine referrer satisfaction with the outpatient and inpatient CLP service across medical, surgical and ICU wards at a university hospital in Denmark, utilizing an online survey measuring predefined quality standards.

Methods

Setting

The CLP team consists of 2 psychiatrists, 2 nurses and one clinical psychologist. The team provides service for a 565-bed university hospital in Aalborg, Denmark, covering routine and urgent mental health assessments and follow-up during working hours for hospitalized medical patients, long-term outpatient follow-up after hospital discharge as well as outpatient assessment and treatment of patients referred from medical and surgical hospital outpatient departments. The CLP team provides outpatient and inpatient services for patients suffering from functional disorders, psychiatric symptoms and disorders associated with and resulting from medical diseases; psychiatric symptoms relating to pre-existing mental health disorders; assessment of suicidality and expert advice regarding psychopharmacological interventions in case of adverse medical events.

The psychiatric department at Aalborg University Hospital has a separate 24-h per day, 7-days per week psychiatric service responding to acute referrals from the general hospital wards and primary care services, as well as urgent referrals from hospital departments outside working hours and during weekends and holidays.

Survey

Referrers’ experience and satisfaction was measured by a questionnaire regarding their experience with the outpatient and inpatient CLP service. The structure and content of the survey was inspired by similar examples [10, 13, 14], from which the relevant topics for measuring CLP were identified and described. The draft survey was sent to three senior physicians and two senior nurses for review and feedback to gather the perspectives of the general hospital staff. The survey was then tailored according to the questions and areas of interest they identified as being significant for measuring CLP performance. The final version of the survey contained 11 items assessing referrer satisfaction with a range of different aspects of the CLP service for the outpatient CLP service and 12 items for the inpatient CLP service (Appendix 1). The level of the responders agreement with the items was largely measured on a 5-point Likert scale ranging from “not-at-all” to “very much”. However one item “The extent of the CLP service” was rated utilizing a 3-point Likert scale ranging from “very unsatisfactory”, “unsatisfactory” to “appropriate”, while item “Overall evaluation of the CLP service” was rated on a 5 point Likert scale ranging from “very bad” to “very good”.

Participants

Units receiving CLP services at a magnitude of at least 15 inpatients and 5 outpatients the preceding year were selected. Leading physicians and nurses at the respective units were asked to identify physicians and nurses who were users of the CLP service. More respondents were contacted at medical units with a higher number of CLP contacts. This was to ensure that the respondents had sufficient experience with and knowledge of the CLP service to make a valid evaluation and to include as many general hospital departments as possible. For general hospital wards with lower CLP contact numbers, the goal was to identify 3 physicians and 5 nurses as respondents, while for those with higher contact numbers 5 physicians and 6 nurses. The number of participants from the wards and outpatient units was chosen arbitrary by the authors.

An online survey tool (SurveyXact) was used to host the survey, to distribute the questionnaires and to collect results. The potential respondents were contacted via e-mail explaining the scope of the study, how data will be collected and stored and containing links to the online surveys. The responses were anonymous. In case of nonresponse, two reminder e-mails were sent with a one-week interval. The survey was performed between 1. November – 18. December 2019.

Statistical analysis

As data is on an ordinal scale, we presented grouped answers as counts and percentages, and as medians with interquartile range (IQR).

For all comparisons of two groups (physicians versus nurses; respondents from wards with both inpatient and outpatient CLP referrals versus respondents from wards with only inpatient referrals and respondents working already before versus responders employed after setting up the CLP unit) we, for each survey-question, tested the hypothesis that the distribution is the same in both groups using Fisher’s exact test. For comparisons of three groups (healthcare professionals being in contact with 0–5 patients versus 6–10 patients versus more than 10 patients assessed by the CLP team) we, for each survey-question, tested the hypothesis that the distribution is the same in all groups using Fisher’s exact test.

When a user answered “I do not know”, that answer was not included in the final analyses. All counts of n = 1 or n = 2 were masked in the presented tables to ensure anonymity of all answers given.

Results

A total of 16 general hospital units at Aalborg University Hospital were included in the survey. They consisted of 11 medical, 3 surgical and 3 ICU wards. All 16 units received inpatient service, and 7 of them had the opportunity to use, and did use, both the inpatient and outpatient services of the CLP unit. Potential respondents from these 7 units were given 2 questionnaires, addressing satisfaction with both the inpatient and outpatient service (i.e. inpatient and outpatient surveys), while only the inpatient survey was distributed to respondents from all 16 units.

For general hospital wards with lower CLP contact numbers, the goal was to identify 3 physicians and 5 nurses as respondents, for those wards with higher CLP contact numbers the goal was for 5 physicians and 6 nurses (though some wards could not fulfill this requirement).

Altogether there were 152 responses (overall response rate: 85,9%), 111 on the inpatient questionnaire (response rate: 82,8%) and 41 on the outpatient questionnaire (response rate: 95,3%). For a detailed description of the responders’ characteristics see Table 1.

Table 1 Sample characteristics

Overall, the answers showed a high satisfaction level with both inpatient and outpatient CLP services. For the inpatient questionnaire, 8 items received a median rating of 4 (“agree much” with the statement), and 4 items received a median rating of 5 (“agree very much” with the statement) on a 5-point Likert scale. For the outpatient questionnaire, 5 items received a median rating of 4, and 6 items received a median rating of 5 (Table 2). We have divided the items of the survey into 4 subgroups (see Appendix 1): Organizational aspects, Communication, Treatment quality and Overall evaluation. Respondents to both the inpatient and outpatient survey gave a median rating of 5 to questions measuring “Overall evaluation”, and a median rating of 4 to questions measuring “Communication” and “Organizational aspects”. Regarding “Treatment Quality”, respondents to the outpatient survey gave a median rating of 4 to 2 questions and a median rating of 5 to the other 2 questions, while respondents to the inpatient survey gave a median rating of 4 to all questions.

Table 2 Satisfaction with the CLP service

We also examined any potential differences to responses on satisfaction between the different subgroups.

There were statistically significant differences in responses on all but two questions between physicians and nurses showing that physicians were more satisfied overall with the communication with the CLP team, the treatment quality provided by the CLP service, some aspects of the organization of the CLP service and expressed a higher satisfaction with the CLP service in general (Table 3).

Table 3 Differences in satisfaction between physicians and nurses

There were no statistically significant differences between assessments from respondents at medical units receiving both outpatient and inpatient service and those receiving only inpatient service, except on one item showing that teams who utilized both inpatient and outpatient CLP services were more satisfied with the communication with the CLP team (Table 4).

Table 4 Differences in satisfaction among responses from units receiving both inpatient and outpatient CLP services vs. units only receiving inpatient service

There were statistically significant differences in evaluations on all but three questions between healthcare professionals who were already working at their respective medical units before the CLP unit was established and those who started working afterwards with data showing referrers who were working before the CLP service was set up were more satisfied with some aspects of the organization of the CLP service and the communication with the CLP team, and more satisfied overall with the treatment quality provided by the CLP service and expressed a higher satisfaction with the CLP service in general (Table 5).

Table 5 Differences in satisfaction between healthcare professionals already working before versus employed after the CLP service was established

There were statistically significant differences on all but one question in the responses from subjects who had more patients assessed and treated by the CLP team compared to responses from those subjects who had fewer patients in contact with the CLP team with data showing referrers who utilized the CLP team more were more satisfied overall with the organization of the CLP service, the communication with the CLP team, the treatment quality provided by the CLP service and expressed a higher satisfaction with the CLP service in general (Table 6).

Table 6 Differences in satisfaction between groups divided on the basis of their number of patients assessed and treated by the CLP unit

At the end of the questionnaires, the respondents were able to add comments. The vast majority of these comments underlined the following: the important role that the CLP service plays; emphasized that CLP service gives a clear boost to the quality of treatment for their patients; highlighted the consultants’ professional, committed and friendly approach and cooperation skills; and praised the CLP service for educating staff at the general hospital. However, a few respondents mentioned some issues with the referral procedure (unclear referral process and criteria), expressed some dissatisfaction with the lack of CLP service during the weekends, and suggested that the service receive more promotion.

Discussion

There is widespread agreement in the literature that medical staff satisfaction is one of the most important performance measures of CLP services. In order to assess the performance of our CLP unit, we investigated the subjective satisfaction with different aspects of the CLP service among a large representative sample of physicians and nurses from 16 different medical, surgical and ICU units at a university hospital.

Overall, the results showed high levels of satisfaction with inpatient and outpatient CLP services, including with specific aspects such as treatment and service quality, organization and communication. Respondents expressed strong levels of agreement that the CLP unit ensures a relevant assessment and treatment of medical patients with mental health problems, improves the patients´ mental state and compliance, resulting in greater benefits from the medical treatment and simultaneously making the treatment of these patients easier for the medical staff. There was also a strong agreement among respondents that the guidelines regarding referral processes to the CLP team were clear and patients were assessed within a relevant timeframe, that the CLP team could be easily contacted and that findings and results were communicated in an appropriate manner. Furthermore, respondents expressed very positive satisfaction levels overall and a very high perceived need for the CLP services. In addition they felt to a very large degree that the CLP unit provided a higher quality of service compared to psychiatric treatment as usual.

From a methodological point of view, because our study sample consisted of a representative group of physicians and nurses with an overall survey return rate above 85%, we believe our results can be generally applicable for medical staff at general hospitals as a whole. Furthermore, the present study underscores the feasibility of evaluating ongoing clinical services utilizing surveys as a measure.

Our work adds to the existing knowledge on the position and quality of CLP services in the general medical hospital. A widespread survey of consultation-liaison organizations in the Western European countries was conducted almost 30 years ago [22], and while more recently the CLP activities in three different countries (2 from Europe and 1 from Asia) were also discussed, the authors concluded that there was still a need for further research on describing the status of CLP in different countries [18]. A systematic review from 2014 [10] which included 13 studies examining staff feedback on CLP services, showed general satisfaction levels between 21 to 100%; the majority of studies reported satisfaction rates between 56 and 86%. A study from 2014 with 41 responses and a response proportion of 59% from consultants at a general hospital [15] showed overall satisfaction with the CLP service as being at 63 to 98% of staff members. Although slightly different rating scales were used, the levels of satisfaction studied were comparable with our results. However, follow-up arrangements and helping staff members' better manage mental health problems in the medically ill reported levels of satisfaction at a lower level than those found in our study regarding the inpatient CLP service. In addition, a study published in 2019 based on 170 responses from nurses and physicians at medical wards showed that increased levels of staff satisfaction with inpatient CL assessment were associated with providing confidence, support and improved communication amongst medical staff [21]. Among the Nordic countries, the nationwide organization and quality of services for CLP has been examined and described in Norway, results show a moderate level of satisfaction among medical staff with the inpatient CLP service (mean of 3.2 on a scale from 1-very poor to 5-very good) [20]. The qualitative evaluation of a 1-year project involving a psychiatric CLP nurse at a medical ward in Denmark [23] concluded that the project helped medical staff treating their patients with comorbid psychiatric problems more efficiently, achieving a better understanding of the mind-body connection and improving their communication skills. In the recent period, there has been a shift from focusing solely on functional disorders to a growing awareness of other areas of possible importance for the CLP services in Denmark [24], with Danish authorities now recognizing the existing unmet needs and pushing for a closer and more structured collaboration between the general hospital and psychiatry via establishing specialized CLP Units [25].

Nurses in our study were significantly less satisfied with every aspect of the CLP service than physicians. This finding stands in contrast with results from a previous study assessing referrer satisfaction with a telepsychiatric CLP service, showing that nursing staff rated the service more positively than general practitioners [26] as well as a more recent study which found no differences in how nurses and physicians respectively rated satisfaction with CLP service [21] There can be several explanations for the fact that our service is seemingly more suited to meet the demands of physicians than nurses. It has been shown that nurses and physicians have different perceptions of and demands from CLP services, with nurses expressing more need for on-the-spot verbal advice, and physicians having more emphasis on written clinical risk evaluations and overall management plans [27]. Referrals to our CLP team were always made by physicians, resulting in the CLP team’s assessment and the consequent management plan being more reflective of the physicians’ referral problem formulation and demands, rather than the nurses’, which were not necessarily directly expressed during the referral process, and thus might be unfamiliar to the CLP team. Although generally highly satisfied with the CLP service, this group possibly felt that their demands were not fully met. On the other hand, it is highly important for referrers from medical units that the CLP team understands the clinical situation as well as the scope of the referral [19]; when this does not happen as expected, the result can be a lesser degree of satisfaction with that particular service, in our case the CLP service. Furthermore, in our clinical experience, there is an implicit perception among nurses that the CLP team should help them cope with a wide range of compliance and behavioral problems, which does not necessarily lie inside the CLP competence, possibly resulting in a perception of unmet demands.

Respondents from units receiving both inpatient and outpatient CLP services were more satisfied with the information after the assessment; otherwise we could not identify further differences compared to those departments who only received CLP inpatient services.

Respondents who had more patients assessed and treated by the CLP team evaluated the service quality as significantly higher. This result is in line with other findings showing that positive attitude towards CLP among medical staff is strongly associated with the number of patients being referred [28]. It is on the other hand also plausible that simply referring more patients and hence gathering more knowledge of the scope and possibilities of the CLP service can result in more satisfaction with the service.

Furthermore, those referrers who were already working at their respective medical units before our CLP service was established were significantly more satisfied with almost all measured aspects of the CLP service, the most striking difference being a significantly more positive evaluation of the CLP service compared to psychiatric service as usual, e.g. on call psychiatrist or general psychiatric outpatient services. It seems plausible, that this finding can be related to the positive effects of the CLP team having a close link and working together with the general hospital staff towards common goals and in the meantime showing high professional standards, as supported by the comments on the questionnaires, which commended the committed and friendly attitude of the CLP team members. Indeed, close working relationships with other medical specialties and appropriate professional behavior of psychiatric team members are considered key factors in improving the existing negative image of psychiatry and closing the gap between psychiatry and medical specialties [11].

The collected responses and comments expressed high levels of satisfaction with the workings of the CLP team, which was described as exceptionally professional and highly effective from several different aspects. The responders emphasized that the CLP service provided the sort of assistance they had needed and lacked for a long time, it helped solving psychological and mental health problems that had so far remained untreated, shortened the treatment period, improved the patients’ ability to cope with their medical disorder, and raised their chances of recovery. Medical staff stressed that their professional competencies and satisfaction with their own work had also improved, in part because they gained a better psychiatric knowledge and understanding of psychological and psychiatric issues, and in part because of the added possibility of referring to the CLP team for assessment and treatment of conditions they had previously not been able to deal with on their own.

Our study has some limitations. Data was collected from a single hospital, and only a relatively modest proportion of medical staff were contacted. Furthermore, we only collected and analyzed data obtained via the survey from referrers to the CLP service, and did not assess other data-capture methods of potential interest for the assessment of CLP service quality (e.g. clinical data, patient reported outcomes etc.). Although the content and structure of our survey was inspired by parameters and standards already identified and outlined in literature, the questionnaire used has not been validated. The fact that surveys were only sent to members of medical staff identified by their respective leaders as users of the CLP services and being interested in answering the surveys, may have artificially inflated the results due to selection bias; furthermore half of the respondents were frequent users of the CLP service, which might further inflate the scores. The present study was designed to collect information on medical staff satisfaction with an already existing CLP service; the study was not designed to identify possibilities to strengthen the CLP service. Future studies should focus more on identifying potential areas of improvement for existing CLP services.

Conclusions

The present study utilized survey data on referrers’ perceived quality of the Consultation-Liaison Psychiatric service from respondents representing a broad and part of general staff from medical, surgical and intensive care units at a university hospital. Data showed a high level of staff satisfaction with treatment and organizational aspects of the CLP service. The present study underscores the feasibility of evaluating ongoing clinical services utilizing surveys as a measure. We believe that our study further contributes to gathering valuable feedback on such an important outcome standard as referrer satisfaction and helping to implement and expand Consultation-Liaison Psychiatry.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. De Hert M, Correll CU, Bobes J, Cetkovich-Bakmas M, Cohen D, Asai I, et al. Physical illness in patients with severe mental disorders. I. Prevalence, impact of medications and disparities in health care. World psychiatr. 2011;10(1):52–77.

    Article  Google Scholar 

  2. Steffen A, Nübel J, Jacobi F, Bätzing J, Holstiege J. Mental and somatic comorbidity of depression: a comprehensive cross-sectional analysis of 202 diagnosis groups using German nationwide ambulatory claims data. BMC psychiatr. 2020;20(2020):1–15.

    Google Scholar 

  3. Moussavi S, Chatterji S, Verdes E, Tandon A, Patel V, Ustun B. Depression, chronic diseases, and decrements in health: results from the World Health Surveys. Lancet (London, England). 2007;370(9590):851–8.

    Article  Google Scholar 

  4. Roy-Byrne PP, Davidson KW, Kessler RC, Asmundson GJ, Goodwin RD, Kubzansky L, et al. Anxiety disorders and comorbid medical illness. Gen Hosp Psychiatry. 2008;30(3):208–25. https://0-doi-org.brum.beds.ac.uk/10.1016/j.genhosppsych.2007.12.006.

    Article  PubMed  Google Scholar 

  5. Woon LS-C, Sidi HB, Ravindran A, Gosse PJ, Mainland RL, Kaunismaa ES, et al. Depression, anxiety, and associated factors in patients with diabetes: evidence from the anxiety, depression, and personality traits in diabetes mellitus (ADAPT-DM) study. BMC psychiatr. 2020;20(2020):1–14.

    Google Scholar 

  6. Jansen L, van Schijndel M, van Waarde J, van Busschbach J. Health-economic outcomes in hospital patients with medical-psychiatric comorbidity: a systematic review and meta-analysis. PLoS One. 2018;13(3):e0194029. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0194029.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Lipowski ZJ. Consultation-liaison psychiatry in general hospital. Compr Psychiatry. 1971;12(5):461–5. https://0-doi-org.brum.beds.ac.uk/10.1016/0010-440X(71)90086-1.

    Article  CAS  PubMed  Google Scholar 

  8. House A, West R, Smith C, Tubeuf S, Guthrie E, Trigwell P. The effect of a hospital liaison psychiatry service on inpatient lengths of stay: interrupted time series analysis using routinely collected NHS hospital episode statistics. BMC psychiatr. 2020;20(2020):27.

    Article  Google Scholar 

  9. Stein B, Müller MM, Meyer LK, Söllner W. Psychiatric and psychosomatic consultation-liaison Services in General Hospitals: a systematic review and meta-analysis of effects on symptoms of depression and anxiety. Psychother Psychosom. 2020;89(1):6–16. https://0-doi-org.brum.beds.ac.uk/10.1159/000503177.

    Article  PubMed  Google Scholar 

  10. Wood R, Wand AP. The effectiveness of consultation-liaison psychiatry in the general hospital setting: a systematic review. J Psychosom Res. 2014;76(3):175–92. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jpsychores.2014.01.002.

    Article  PubMed  Google Scholar 

  11. Sartorius N, Gaebel W, Cleveland HR, Stuart H, Akiyama T, Arboleda-Flórez J, et al. WPA guidance on how to combat stigmatization of psychiatry and psychiatrists. World psychiatr. 2010;9(3):131–44. https://0-doi-org.brum.beds.ac.uk/10.1002/j.2051-5545.2010.tb00296.x.

    Article  Google Scholar 

  12. González M, Calderón J, Olguín P, Flores JL, Ramírez S. In the general hospital: a doctors'perception survey. Eur J Psychiatr. 2006;20(4):224–30.

    Article  Google Scholar 

  13. Palmer L, Cawdron R, Pollock E, Bolton J, Spink J, Eds. Quality Standards for Liaison Psychiatry Services (fourth ed.). London: Royal College of Psychiatrists; 2014.

  14. Lavakumar M, Gastelum ED, Choo TH, Gerkin JS, Kahn D, Lee S, et al. Parameters of consultee satisfaction with inpatient academic psychiatric consultation services: a multicenter study. Psychosomatics. 2015;56(3):262–7. https://0-doi-org.brum.beds.ac.uk/10.1016/j.psym.2015.02.004.

    Article  PubMed  Google Scholar 

  15. Wood R, Wand AP. Quality indicators for a consultation-liaison psychiatry service. Int J Health Care Qual Assurance. 2014;27(7):633–41. https://0-doi-org.brum.beds.ac.uk/10.1108/IJHCQA-02-2014-0019.

    Article  Google Scholar 

  16. Leentjens AFG, van Baalen A, Kuijpers HJH, Lambooij SLE, Schubart CD, Sno HN, et al. The revised guideline on consultation-liaison psychiatry of the Netherlands psychiatric association. J Psychosom Res. 2018;110:12–4. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jpsychores.2018.04.003.

    Article  PubMed  Google Scholar 

  17. van Schijndel MA, Caarls PJ, van Wijngaarden JDH, Wierdsma AI, Lijmer JG, Boenink AD, et al. Identifying value-based quality indicators for general hospital psychiatry. Gen Hosp Psychiatry. 2018;55:27–37. https://0-doi-org.brum.beds.ac.uk/10.1016/j.genhosppsych.2018.09.009.

    Article  PubMed  Google Scholar 

  18. Grassi L, Mitchell AJ, Otani M, Caruso R, Nanni MG, Hachizuka M, et al. Consultation-liaison psychiatry in the general hospital: the experience of UK, Italy, and Japan. Curr Psychiatr Rep. 2015;17(6):44. https://0-doi-org.brum.beds.ac.uk/10.1007/s11920-015-0581-1.

    Article  Google Scholar 

  19. Lavakumar M, Gastelum ED, Hussain F, Levenson J, Wharton RN, Muskin PR, et al. How do you know your consult service is doing a good job? Generating performance measures for C-L service effectiveness. Psychosomatics. 2013;54(6):567–74. https://0-doi-org.brum.beds.ac.uk/10.1016/j.psym.2013.03.001.

    Article  PubMed  Google Scholar 

  20. Weisser KH, Diseth TH, Boye B, Faerden A, Ekeberg Ø. Examining the organization and quality of the psychiatric consultative service in Norway. Nordic J Psychiatr. 2019;73(1):9–15. https://0-doi-org.brum.beds.ac.uk/10.1080/08039488.2018.1525426.

    Article  Google Scholar 

  21. Okoronkwo E. Estimation of costs-savings and improved patient outcomes of implementing a consultation-liaison service at health sciences north. Open J Psychiatr. 2019;9(03):220–34. https://0-doi-org.brum.beds.ac.uk/10.4236/ojpsych.2019.93017.

    Article  Google Scholar 

  22. Mayou R, Huyse F. Consultation-liaison psychiatry in western Europe. The European consultation-liaison workgroup. Gen Hosp Psychiatry. 1991;13(3):188–208. https://0-doi-org.brum.beds.ac.uk/10.1016/0163-8343(91)90143-K.

    Article  CAS  PubMed  Google Scholar 

  23. Stoffer MS. En liaisonsygeplejerske arbejder med sammenhænge. Sygeplejersken. 2013;10:52–3.

    Google Scholar 

  24. Buhl KJ, Birket-Smith M. The future role of liaison-psychiatry. Ugeskr Laeger. 2008;170(42):3319–21.

    PubMed  Google Scholar 

  25. Regioner D. Fremtidens ambulante psykiatri. Danske Regioner; 2008.

    Google Scholar 

  26. Clarke PH. A referrer and patient evaluation of a telepsychiatry consultation-liaison service in South Australia. J Telemed Telecare. 1997;3(Suppl 1):12–4. https://0-doi-org.brum.beds.ac.uk/10.1258/1357633971930788.

    Article  PubMed  Google Scholar 

  27. Solomons LC, Thachil A, Burgess C, Hopper A, Glen-Day V, Ranjith G, et al. Quality of psychiatric care in the general hospital: referrer perceptions of an inpatient liaison psychiatry service. Gen Hosp Psychiatry. 2011;33(3):260–6. https://0-doi-org.brum.beds.ac.uk/10.1016/j.genhosppsych.2011.02.003.

    Article  PubMed  Google Scholar 

  28. Chen KY, Evans R, Larkins S. Why are hospital doctors not referring to consultation-liaison psychiatry? - a systemic review. BMC psychiatry. 2016;16(1):390. https://0-doi-org.brum.beds.ac.uk/10.1186/s12888-016-1100-6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Kristine Bondo Glavind for her support in managing the online survey and to Gerda Kovacs and Katherine Quinteros for her valuable comments during the process of manuscript preparation. We would also like to thank all colleagues, who replied to the survey.

Funding

This research received no specific grant from any funding agency, commercial or not-for-profit sectors.

Author information

Authors and Affiliations

Authors

Contributions

ZK conceived the concept and planning of the study, conducted the data acquisition, contributed to interpretation of data, wrote the first draft of the manuscript and was involved in revising the manuscript. MA contributed to data interpretation, was involved in drafting and revising the manuscript. SG made the data analysis, was involved in drafting and revising the manuscript. REN contributed to data interpretation, was involved in drafting and revising the manuscript. All authors revised the final version and approved for submission.

Corresponding author

Correspondence to Zoltan Kovacs.

Ethics declarations

Ethics approval and consent to participate

Data was collected utilizing online surveys as a method. According to the Danish laws and regulations on research ethics and consent, no ethical approval from ethical committee is needed for survey studies (Bekendtgørelse af lov om videnskabsetisk behandling af sundhedsvidenskabelige forskningsprojekter og sundhedsdatavidenskabelige forskningsprojekter. Section 14, subsection 2. https://www.retsinformation.dk/eli/lta/2020/1338. Accessed 4 April 2021). The study was approved internally by the hospitals internal review board. Participants received written information about the scope of the study, how data will be collected and stored. Because all collected data were anonymized using SurveyXacts anonymization feature, our dataset did not contain any data that could be considered personal data. Data were stored and treated according to current laws and regulations.

Consent for publication

Not applicable.

Competing interests

The authors have no competing interests or other interests that might be perceived to influence the results and/or discussion reported in this paper.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kovacs, Z., Asztalos, M., Grøntved, S. et al. Quality assessment of a consultation-liaison psychiatry service. BMC Psychiatry 21, 281 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12888-021-03281-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12888-021-03281-4

Keywords