Skip to main content

Advertisement

Mental health training programmes for non-mental health trained professionals coming into contact with people with mental ill health: a systematic review of effectiveness

Article metrics

Abstract

Background

The police and others in occupations where they come into close contact with people experiencing/with mental ill health, often have to manage difficult and complex situations. Training is needed to equip them to recognise and assist when someone has a mental health issue or learning/intellectual disability. We undertook a systematic review of the effectiveness of training programmes aimed at increasing knowledge, changing behaviour and/or attitudes of the trainees with regard to mental ill health, mental vulnerability, and learning disabilities.

Methods

Databases searched from 1995 onwards included: ASSIA, Cochrane Central Register of Controlled Clinical Trials (CENTRAL), Criminal Justice Abstracts, Embase, ERIC, MEDLINE, PsycINFO, Social Science Citation Index. Courses, training, or learning packages aimed at helping police officers and others who interact with the public in a similar way to deal with people with mental health problems were included. Primary outcomes were change in practice and change in outcomes for the groups of people the trainees come into contact with. Systematic reviews, randomised controlled trials (RCTs) and non- randomised controlled trials (non-RCTs) were included and quality assessed. In addition non-comparative evaluations of training for police in England were included.

Results

From 8578 search results, 19 studies met the inclusion criteria: one systematic review, 12 RCTs, three prospective non-RCTs, and three non-comparative studies.

The training interventions identified included broad mental health awareness training and packages addressing a variety of specific mental health issues or conditions. Trainees included police officers, teachers and other public sector workers.

Some short term positive changes in behaviour were identified for trainees, but for the people the trainees came into contact with there was little or no evidence of benefit.

Conclusions

A variety of training programmes exist for non-mental health professionals who come into contact with people who have mental health issues. There may be some short term change in behaviour for the trainees, but longer term follow up is needed. Research evaluating training for UK police officers is needed in which a number of methodological issues need to be addressed.

Trial registration

Protocol registration number: PROSPERO: CRD42015015981.

Background

Police officers fulfil numerous roles bringing them into close contact with the general public including people with mental ill health [1]. In the UK the police are signatories of the Mental Health Crisis Care Concordat, a multi-agency initiative aimed at improving outcomes for people experiencing mental health crisis [2]. The Concordat recognises the pivotal role played by the police in identifying and deciding on the most appropriate course of action in situations involving individuals with mental ill health. However, police officers are not experts in mental ill health, and often have to manage complex situations with insufficient training. In the UK, gaps in knowledge have been identified, particularly around police officers’ understanding of Section 136 of the Mental Health Act 1983, which gives them the power to remove from public places anyone who appears to be suffering from mental disorder and take them to a place of safety [1, 3]. Additionally, police officers were not always aware of their responsibilities, even when guidance was provided. The review identified online learning as the main form of training tool for police officers; however there were variations in who had completed the training [1]. Training is a priority for the police, however, the best approach to train officers to respond to people with mental health problems remains unclear. We undertook this systematic review to identify evidence of effectiveness of training approaches to inform the development of a mental health training package for police officers which is currently being assessed in a cluster RCT comparing the new training package with routine training (ISRCTN registry trial ID ISRCTN11685602).

While our main interest was training for police officers, preliminary searches suggested there may be limited studies available specifically in the police. We therefore widened the scope to include non-mental health professionals who may interact with the public in a similar way to the police. Being able to identify problems, deal with situations or refer for professional assistance is expected of people such as teachers and case workers, despite their non-mental health training. It was anticipated that widening the scope would capture a broader range of training approaches that would be relevant in the police setting. We looked at the international literature but as our aim was to inform development of an intervention in the UK, we included a wider range of study designs from the UK to provide context.

We aimed to:

1. Evaluate the evidence on the effectiveness: of training programmes and/or training resources aimed at increasing knowledge and/or changing behaviour or attitudes of the trainees with regard to mental ill health, mental vulnerability, and learning disabilities; and of satisfaction with training and barriers and facilitators to effective training.

2. Identify methods used for evaluating the impact of training interventions.

Methods

The review followed an a priori protocol: details including minor amendments are available in PROSPERO record CRD42015015981.

Selection criteria

Participants/population: specific mental health training programmes targeted at police officers; other police staff who come into contact with the public; members of the criminal justice system; non-mental health trained health professionals working in acute health care, including paramedics; people working in education; any other professions, responsible organisations or mental health charities who interact with the public. We excluded basic training delivered to trainees or newly appointed staff in the police force, but included evaluations of additional training. Studies from Organisation for Economic Co-operation and Development (OECD) countries only were included.

Intervention: Training aimed at increasing knowledge of mental health, mental vulnerability, or learning disabilities of members of the public and/or changing attitudes and/or improving their skills in dealing with people with mental health problems in their role, was included. Any courses, training, learning packages or other training resources delivered by any method, for example face-to-face; self-directed; team based or web-based programmes were included. This includes role modelling, reflection, online or mobile phone apps or written materials. Training could focus on the mental health of children, young people and adults.

We used the UK Mental Health Act 2007 definition of mental ill health to encompass, “any disorder or disability of the mind”, [3] whether or not a formal diagnosis had been made. Learning disabilities (also called intellectual disabilities) were included in line with the National Policing Improvement Agency guidance on responding to people with mental ill health or learning disabilities [4].

Comparator(s): no-training, usual practice or comparison between different training approaches, for example class room based training vs on-line training.

Outcomes: we were interested in seven possible outcomes of training interventions [5,6,7,8]. These were classified into two primary outcomes: change in practice (evaluation of behaviour); and change in outcomes for the groups of people the trainees come into contact with (evaluation of results). The five secondary outcomes were: satisfaction with training (evaluation of reaction), change in attitude towards the importance of mental health, change in confidence, change in knowledge and change in skills (evaluation of learning).

Types of study included: systematic reviews (that reported their inclusion/exclusion criteria, searched at least one database, provided study details and/or a quality assessment, and synthesised included studies); and RCTs. We included non-RCTs and observational studies without a control group for the police group only, to identify relevant interventions to inform development of the training package. Published and unpublished audits and evaluations of police training in mental health in England and Wales were included.

Qualitative studies of views and experiences of training, and barriers and facilitators to implementation were included to capture satisfaction with training delivery and implementation.

Searches

An information specialist searched the following bibliographic databases for English language studies from 1995 onwards: ASSIA, Cochrane Central Register of Controlled Clinical Trials (CENTRAL), Criminal Justice Abstracts, Embase, ERIC, MEDLINE, PsycINFO, Social Science Citation Index. The search strategies are available in Additional file 1. We also scanned the complete list of Campbell Reviews and the Register of Studies produced by the Cochrane Effective Practice and Organisation of Care Group. Restricting the searches to the last 20 years took into account the changing legislation attitudes and awareness of mental health.

We checked the reference lists of included studies and of papers that had cited the included papers. The websites of major UK mental health charities were searched (details in Additional file 1). We also searched PROSPERO and ISRCTN for relevant ongoing or completed but not yet published reviews and trials.

Police training officers in England and Wales were asked for their help in identifying published or unpublished audits or evaluations on the impact of mental health training delivered to police officers and/or staff.

Study selection and data collection

Titles and abstracts of all studies were screened independently by two researchers. Full papers were assessed for inclusion independently by two researchers and at both stages discrepancies were resolved through discussion.

Data extraction forms were developed in Microsoft Excel 2010 and piloted. Data extracted included details of study design (setting, aims, unit of allocation, inclusion criteria, recruitment method etc.), intervention and comparator (type of training, method of delivery, presentation elements, length of training, where delivered, aims of training), and evaluation methods (timing, outcomes measured). Data extraction was undertaken by one researcher and checked by a second; discrepancies were resolved by discussion with a third researcher.

Interventions were classified as didactic if they were exclusively made up of lectures (e.g. presenter determines content, organisation and pace), interactive if they included active participation by the trainees (e.g. case studies, role-play, group work), and mixed if both were used [5,6,7,8].

Risk of bias (quality) assessment

The ROBIS tool [9] was used to assess the risk of bias of the systematic review; the Cochrane Risk of Bias tool for RCTs [10]; the Newcastle-Ottawa Quality Assessment Scale for Cohort Studies [11]; and the National Institutes for Health tool for studies without a control group [12]. Assessment was undertaken by one researcher and independently checked by a second, with discrepancies resolved by discussion.

Strategy for data synthesis

We performed a narrative synthesis as a meta-analysis was not feasible due to the substantial differences in interventions and methodological approaches in the included studies. The small number of studies precluded subgroup analysis of short courses as planned in our protocol. Identified qualitative studies provided insight into the barriers, facilitators and perceived impact of training and are presented in a separate paper.

Results

The search strategies and allied searching identified 8579 references (after deduplication): these were loaded into EndNote ×7 (Thomson Reuters, CA, USA) bibliographic software. Figure 1 shows the flow of studies through the review process. We identified 19 studies for inclusion, and a further eight qualitative studies which are reported separately. Additional file 2 lists the excluded studies.

Fig. 1
figure1

Flow of studies through review process

One systematic review [13], 12 RCTs [14,15,16,17,18,19,20,21,22,23,24,25] and three prospective non-RCTs of police training [26,27,28], were included. In addition we included three non-comparative evaluations of mental health related training interventions specifically for the police in England [29,30,31]. A summary of the characteristics of the included studies is provided in Table 1.

Table 1 Characteristics of included studies

The studies included in the systematic review were all conducted in the USA. Eight of the 19 primary studies included took place in the USA, three in Sweden, three in England, two in Australia, and one each in Canada, Scotland and Northern Ireland. Participants included teachers, public health professionals, university resident advisors, community practitioners, public sector staff, and case workers. Law enforcement participants were trainee, probationary, university campus, and front line police officers.

Where details of the training venue were reported, this was generally in a training facility environment at participants’ place of work: two of the studies held the training in specialist mental health units. Where reported, the number receiving training in a session ranged from 15 to 42 per group. Intervention delivery classed as short (over 1 day or less) ranged from 15 min to 4 h; and longer delivery times ranged from 12 h over 2 days to 47 h with a 1.5 to 2 h annual booster.

Evaluation of outcomes

A summary of the measures used for each of the seven outcome categories for this review is provided in Table 2. The main method of evaluation in the included studies was participant completed questionnaire. Reporting of details of the instrument(s) used was generally incomplete. Most studies used a combination of questionnaires to evaluate different aspects of interest. Some validated instruments were used, but most were then modified by the exclusion of questions and/or addition of new questions [20,21,22, 31]. Many questionnaires were developed by the researchers specifically for their study [14,15,16, 19,20,21, 23,24,25, 29, 30]; most undertook some form of check for internal consistency [14, 19, 20, 22, 24,25,26].

Table 2 Outcome measures used

Three of the RCTs used vignettes combined with a questionnaire to evaluate changes in practice [16], attitude [23], confidence [16], knowledge [25], and behaviour [16, 25]. Other measures used were basic rating scales, for example a categorical measure of the number of residents with whom university resident advisors interacted [21]. None of the included studies undertook an economic evaluation or reported resource use or costs.

Risk of bias within studies

A summary risk of bias table is provided in Additional file 3. Overall the included studies were not well reported, in particular, reporting omissions made it difficult to extract or calculate an intervention effect and 95% confidence interval which would have allowed us to report results across studies.

The systematic review was at high risk of bias [13]. It was unclear whether all the appropriate studies were included in the review, particularly as the authors reported on several studies not identified by their searches. The included studies were not quality assessed and little detail was provided to allow interpretation of the results.

Overall the risk of bias in the RCTs was judged to be unclear because details were not reported, or high risk due to issues with randomisation, blinding or incomplete outcome data [14,15,16,17,18,19,20,21,22,23,24,25]. The risk of bias in the non-RCTs was generally unclear, mainly because of inadequate reporting of the methods [26,27,28]. The quality rating for one of the non-comparative studies was good [31] and the other two had reporting omissions, but were judged as fair [29, 30].

Training interventions

The interventions evaluated in the review [13], four of the RCTs [16, 18, 21, 23] and one non-RCT [28] were based on established training programmes used in other settings. The remaining studies evaluated training which the authors had devised or were involved in developing. Descriptions of the training interventions and their delivery were generally insufficient for reproduction. However, details of the established programmes are available in related publications and four others online [14, 15, 20, 22]. Where details of those delivering the training were reported they generally included trainers with experience of working in mental health, such as social workers. The studies of police officers nearly all included mental health workers and police trainers, but only one also included service users as trainers [31]. Characteristics of the training interventions are given in Table 3.

Table 3 Characteristics of training interventions

Training for police officers: Interventions with a broad mental health focus

The systematic review focussed on CIT programmes originating in Memphis, USA. CIT is a police based response undertaken in collaboration with other services such as mental health professionals and ambulance services. These programmes provide selected officers with specialist training in dealing with mental health related calls. CIT/MHIT trained officers then provide a specialised front-line response to calls with the aim of directing those with mental health problems to treatment services rather than the judicial system.

A review of CIT programs (Compton, 2008) reported that CIT may be an effective component in connecting individuals with mental illnesses who come to the attention of police officers with appropriate psychiatric services. The limited and poor quality research identified indicates that the training component of the CIT model may have a positive effect on officers’ attitudes, beliefs, and knowledge relevant to interactions with people with mental health problems. CIT-trained officers have reported feeling better prepared in handling calls involving individuals with mental illnesses [13]. On a systems level, the review found that CIT, in comparison to other pre- and post-diversion programs, may be associated with a lower arrest rate and lower associated criminal justice costs [13]. However, the review failed to find support for the roll out of CIT.

In a non-RCT, Herrington et al. (2014) evaluated the MHIT programme in Australia [28] which is based on the CIT model. There was little change in practice or perceived quality of relationships between the police and other stakeholders [28]. There were no significant differences between the MHIT trained and non-MHIT trained officers in terms of skills, except once trained, MHIT officers reported spending less time at Mental Health Act events (trained mean 54.5mins; control 99.5 mins).

Two non-comparative studies reported on local collaborations between police forces and professionals in mental health units delivering 1 day mental health awareness training to front line police officers [29, 30]. Forni’s (2009) post training survey found a high degree of satisfaction with the training and officers said it was relevant to their daily work [29]. They also self-reported better understanding of mental health services with some myths being dispelled and terms such as ‘psychotic’ and ‘delusions’ becoming clearer. The mental health professionals who delivered the training also reported a better understanding of the role of the police and the pressures and constraints they operate under. Norris and Cooke (2000) reported a retrospective survey which aimed to establish how useful the training had been in practice [30]. Of the 55 respondents, 53 (96%) had dealt with mentally ill people, 34 (61%) had used their training and 37 (67%) felt the training had increased their ability to deal with people with mental illness. Having regular updates was felt necessary by 15 (27%) respondents.

Hansson and Markstrom’s (2014) non-RCT assessed an anti-stigma course as an addition to the regular police officer training psychiatry course [27]. Rafacz (2012) compared two ways of presenting an on-line anti-stigma programme to campus police officers in a non-RCT: personal experience versus information giving [17]. A non-comparative evaluation of an educational intervention to reduce psychiatric stigma and discrimination in the police force in England was undertaken by Pinfold et al. (2014) [31]. All three studies took a team based approach and used mixed teaching methods. Hansson and Markstrom (2014) and Pinfold (2014) delivered face-to-face training and included people with experience of mental health problems as trainers. Rafacz (2012) used two video presentations: one where the presenter disclosed his mental illness and the other with no disclosure.

Hansson and Markstrom (2014) found improved attitudes, mental health literacy and knowledge, and an increased willingness to interact with people with mental illness post intervention. Improvements were also seen at a 6 month follow-up; however this was based on data from the intervention group only [27]. In comparing anti-stigma videos of personal experience with information giving, Rafacz (2012) found neither was effective in changing attitudes [17]. The analysis suggested that attitudes of the campus police officers were generally non-stigmatising.

The non-comparative evaluation by Pinfold et al. (2003) included a pre and immediate post training satisfaction survey and a 4-week post training survey (data from 109 officers). The training aimed to reduce psychiatric stigma and discrimination [31]. A positive impact on police work post training was identified by 32 (59%) police officers, mostly through a clearer understanding leading to better communications; while 22 (41%) felt the training had made no difference to their practice. Although 77% of officers perceived an increase in their knowledge, there were no significant changes in general knowledge of mental illness and schizophrenia. Positive changes in attitude towards people with mental health problems were seen; however, the sessions did not impact on the officers’ view that people with mental health problems are likely to be violent (61% agreed at baseline, 54% at follow-up).

Training for police officers: Interventions with a specific mental health focus

One RCT [15, 18,19,20, 22, 24] and one non-RCT [26] focussed on training police officers to deal with people with specific mental health conditions.

Bailey et al. (2001) undertook a non-RCT of intellectual disabilities awareness training for probationary police officers [26]. The training was team-based, interactive and delivered face-to-face at the police training centre. The control group received no specific information about people with intellectual disabilities. The pre and post training evaluation showed a statistically significant improvement in attitudes in the intervention group compared with the control group.

One RCT investigated online delivered self-directed, didactic training for police officers about autism. Teagardin et al. (2012) compared front line police officers viewing a video about autism with a control group who did not see the video [15]. Significant differences before and after training were identified for reported confidence in identifying persons with Autism Spectrum Disorder (ASD) and in interacting with persons with ASD. Intervention group knowledge of ASD also significantly improved compared with control group post training.

Training for other non-mental health trained professionals: Interventions with a broad mental health focus

Dorsey et al. ‘s (2012) RCT examined whether a child welfare caseworker training and consultation model would improve knowledge of evidence based practice and ability to identify mental health problems and referral options [25]. Delivered face-to-face, the training was team based and included didactic and interactive elements. This was followed by 4 months of bi-weekly case specific support from a psychologist or social worker. Although the intervention group had significantly increased awareness of evidence based practice, the authors found no significant changes in practice or skills between the intervention and control groups.

The Mental Health First Aid (MHFA) programme started in Australia and has spread to other countries. Aimed originally at training adults in the general population to assist other adults, MHFA has been tailored for use by specific groups. We identified three RCTs evaluating MHFA for teachers [23], university resident advisors [21], and public sector staff such as social workers, human resource managers and employment managers [16]. All three study interventions were team based, involved interactive elements, and were delivered face-to-face, over similar timeframes (12 to 14 h over 2 days). There were no changes in practice detected for MHFA trained resident advisors, nor in take up of mental health services by the students in the care of the resident advisors [21]. However, public sector staff who received the training improved their readiness to provide help to people in mental health crisis compared with the control group, which was sustained at 2 year follow-up [16]. Additionally students of trained teachers were significantly more likely to report that they received information about mental health problems than students of un-trained teachers. Improved attitudes in the intervention group were identified in two studies [16, 23], but no effect in the third [21]. All three studies reported increases in self assessed confidence and knowledge compared with their control groups.

One cluster RCT assessed the Peer Hero Training program, a story-based approach, which was delivered in interactive video format, with self-directed learning to university resident advisors [14]. At 7 month follow-up, the resident advisors reported making more than ten times as many first-aid encounters in the past 30-days for alcohol, drug, mental health, and academic problems compared with resident advisors assigned to training-as-usual. They also reported increased confidence and skills.

Training for other non-mental health trained professionals: Interventions with a specific mental health focus

One RCT investigated online self-directed, didactic training about autism. Hart and More’s (2013) study provided information to student teachers; the group viewing a Podcast performed statistically significantly better on the ASD comprehension test compared with the comparator group who received the same information in written format [24]. This RCT was the only included study to report an underpinning theory that was successfully applied throughout the study [24].

A face-to-face, team based, interactive intervention, “Alternative for Families: A Cognitive-Behavioral Therapy (AF-CBT)” aimed to provide practitioners with skills to use AF-CBT when working with families where there is concern about physical discipline, aggression or abuse of children. The intervention was delivered to community practitioners and outcomes compared with a control group in an RCT by Kolko et al. (2012) [22]. Intervention participants reported high levels of satisfaction with all aspects of the training, in particular the training materials. Compared with the control group at 6 month follow-up, the AF-CBT group reported a significantly greater increase for the teaching processes; knowledge about CBT; skills in dealing with a history of abuse, and general psychological skills. However, at 18 months post training, these differences were no longer significant.

McVey et al. (2008) looked at the feasibility and usefulness of an on-line modular programme to help elementary school teachers and public health practitioners prevent eating disorders [20]. The didactic module was made available to the intervention group for self-directed study any time over a 60 day period: overall a high level of satisfaction with the modules was reported by participants. Compared with the comparator group, teachers in the intervention group reported statistically significant improvements over time in their knowledge about facts concerning restrictive dieting and about peer influences. There were no significant differences between public health professionals for knowledge items; however the intervention group did demonstrate significant increases in self-efficacy to fight weight bias compared with the comparator group. Almost all (94%) of the intervention participants said the information learned would prompt them to make changes to their school environment; 74% said the program had positively influenced their own feelings about their body shape; and 93% reported that the program improved their overall delivery of body image and health eating curriculum to students.

Teachers were randomised to receive an educational package on adolescent depression or waiting list in an RCT by Moor et al. (2007) [19]. The 2 hour training was delivered face-to-face, was team based and included mixed presentation methods. Teacher responses to an attitude questionnaire showed increased confidence compared with the control group, but this did not translate into improved recognition of depressed pupils. Teachers in the experimental group recognized 52% of cases before the intervention and 45% afterwards, whilst the control teachers recognized 41% and 43%, respectively. The training produced no improvement in recognition of depressed pupils.

An RCT examined an existing parent training programme on Attention Deficit Hyperactivity Disorder (ADHD) adapted for delivery in a clinic and for use with teachers and parents [18]. Delivered face-to-face, the team based training included interactive and didactic elements. At 3 month follow up a significant reduction in parent-rated ADHD symptoms and in problematic behaviours were reported in the intervention group. For teacher ratings, significantly reduced emotional problems were found in the control group.

Audits and evaluations carried out by police forces in England and Wales

We received 25 responses from 22 different counties after sending out 75 email requests for audits of police training in mental health. However, this did not provide further data and no audits or evaluations have to our knowledge been undertaken.

On-going or completed but not yet published work

Our searches found a protocol for a cluster RCT on an integrated workplace mental health intervention [32]. The study is investigating whether improved leadership skills and mental health literacy leads to improved psychosocial working conditions for police officers in Southeast Australia. The ISRCTN registration lists the overall trial end date as 30/12/2016.

Discussion

We identified evaluations of a wide variety of training interventions, populations and settings. The training programmes ranged between awareness raising, ways to change practice, and comparison of training delivery methods. The interventions also varied from addressing specific mental health conditions to providing a broad understanding of mental health illnesses and vulnerabilities, with some including how to interact effectively. There were huge variations in the design, delivery method and content of the training, and in the knowledge, experience and skills of those developing and/or delivering the training. Although 12 RCTs were identified, overall the quality of reporting makes it difficult to assess the reliability of their findings.

A number of the training interventions included dramatisations or role play, some with actors or service users. These studies found some positive effect compared with their comparison group [14, 19, 21, 22, 26, 27]. Likewise, the non-comparative studies all included role play and all reported improvement in at least one outcome [29,30,31]. There are a large number of reviews on adult learning practices and methods [33,34,35,36]. Dunst and Trivette (2012) reviewed 58 RCTs and found that training using a variety of presentation methods in groups of less than 40, in applied settings, over 20 h on multiple occasions was optimum for acquiring new knowledge or skills [36]. Where details were reported, most of the interventions included in this review were delivered in line with evidence based best practice.

The trainers who deliver a training package are crucial to the success of changing perceptions and behaviours. Coleman and Cotton (2014), highlight the important role of the trainer in not only delivering effective training but in the success of implementing any related programme [37].The studies of training police officers nearly all used police trainers alongside mental health professionals in delivery of interventions: potentially helping each profession to understand the others organisational culture.

A dilemma when providing training on mental health issues to non-mental health professionals is deciding what trainees need to know and in what detail. There were no studies directly comparing general versus specific training programmes. The gaps in reporting details and the wide variation in the included studies precludes drawing even tentative conclusions about general mental health awareness raising versus condition specific training programs. Over half the studies had specific mental health foci, settings and participants limiting the generalisability of the findings. For example, learning disabilities frequently co-occur with mental ill health, but many of the training interventions focussed on one specific mental health issue without consideration of the potential for other vulnerabilities. Conversely, some of the included studies used pre-existing training packages, but with little reference to previous evaluations. For example, CIT is being rolled out across the USA and elsewhere but there is little robust evidence of its effectiveness [38, 39]. Likewise, the TEMPO (Training and Education about Mental illness for Police Organizations) model for Canadian police personnel, while developed on sound principles and research evidence, has not yet had the rigorous outcome evaluation of implementation recommended by Coleman and Cotton (2014) [37]. None of the studies identified aimed to provide skills that could be used in multiple situations.

Limitations of this review

While our searches were comprehensive it is possible that we failed to find some relevant studies. There were variations in the usefulness of tagging/thesaurus terms used in the databases searched. For example a paper in Criminal Justice Abstracts with the phrase “the impact of police training in mental health” in the title, used the thesaurus terms, “MENTAL health services/MENTAL illness/PEACE officers/POLICE reform”, with no mention of training at all. This risked the paper being missed in the combination of “police AND training”; however the paper was identified in our hand searching. The search strategies were tailored to each individual database, but there is always a balance between sensitivity and specificity. Our use of web searches, forward and backward reference searches and the request for published or unpublished audits and/or evaluations from police trainers in England and Wales may have gone someway to mitigating the risk of publication bias.

Generalisability is limited as the searches were restricted to English language and studies in OECD countries. The participants, settings and interventions were in some cases very specialist, also limiting generalisability [16, 18, 20, 24, 25].

Our research question was broad, therefore the evaluations we identified included a wide variety of training interventions, populations and settings; this could be considered a limitation. We found an overall lack of high quality evidence to inform training decisions for any non-mental health professionals coming into contact with people with a mental health issue.

Given the lack of RCTs of training specifically for police officers, we included methodologically less robust, non-randomised controlled trials: and restricted their inclusion to those in the police setting. Even within the RCTs, the heterogeneity in all aspects of the included studies made a narrative synthesis the only option, limiting the strength of the conclusions that can be drawn. While the outcome categories selected are widely used in research of training, they presented some interpretation challenges when data extracting. This was mainly because of the diversity of outcomes assessed in the included studies and a general lack of detail in the reporting of the results.

Reporting was generally incomplete, but we did not have the resources to contact authors in the hope of receiving further details.

Implications for future research

There is a need for high quality RCTs to evaluate the impact of training programmes for non-mental health trained professionals coming into contact with people with mental health issues, and in police officers in particular. A 2012 study in a police district of 198,000 inhabitants in the Netherlands linked police data with mental health care information [40]. In 1 year the police dealt with 492 crisis situations, and in half those cases the individuals were disengaged from mental health services. The findings confirmed the important role of police officers in linking people with mental ill health to care, and the necessity for appropriate training and understanding of local mental health services and resources for front line police.

We were interested in seven well established expected outcomes of training; however many were not measured in the evaluations identified. The few studies that attempted to measure a change in outcomes for the groups of people the trainees came into contact with found little or no impact [21, 23, 28]. Obtaining good quality service user insight into the effectiveness of training is challenging, particularly when the interaction is with the police. A surrogate measure could be community satisfaction performance indicators related to mental health interactions, as recommended by The Lawrence inquiry (1999) [41]. The short follow up time was an acknowledged limitation in most of the studies. A variety of evaluation tools were used, mostly designed in-house or where a validated tool was used this was modified in some way. A recent systematic review of the measurement properties of tools measuring mental health knowledge recommends using tools with an evidence base which reach the threshold for positive ratings according to the COSMIN checklist [42].

Outcomes measured should include those important for the trainees’ roles and for the people with mental health issues. The development of a set of core outcome measures as part of and/or to inform future studies would be beneficial. The COMET initiative has a database of core outcome measures in effectiveness trials [43]. For example The Engager 2 project is developing a set of outcome measures as part of a larger project to develop and evaluate a complex intervention for prisoners with common mental health problems who are coming to the end of their sentence [44].

Future research would also benefit from more complete reporting. The Equator Network provides a single point of access to a range of useful documents [45] including the TIDierR checklist [46] and CONSORT statement [47] for the accurate reporting of interventions and RCTs respectively. Checklists and guidelines for reporting protocols and other types of studies are also available. Training interventions can include multiple elements, and be influenced by the characteristics of the setting and context in which it is being delivered and implemented. As such they may be considered complex interventions, for which specific reporting guidelines are also available [48].

Conclusions

A variety of training programmes exist for non-mental health professionals who come into contact with people who have mental health issues. There may be some short term change in behaviour for the trainees, but longer term follow up is needed. Research evaluating training for UK police officers is needed in which a number of methodological issues need to be addressed.

Abbreviations

ACPO:

Association of Chief Police Officers

ADHD:

Attention deficit hyperactivity disorder

AF-CBT:

Alternatives for Families: A Cognitive-Behavioural Therapy

ASD:

Autism Spectrum Disorder

CIT:

Crisis Intervention Team

COMET:

Core Outcome Measures in Effectiveness Trials

CONSORT:

Consolidated Standards of Reporting Trials

DH:

Department of Health

ES:

Effect size

ISRCTN:

International Standard Registered Clinical/soCial sTudy Number

MHFA:

Mental Health First Aid

MHIT:

Mental Health Intervention Team

NPIA:

National Policing Improvement Agency

OECD:

Organisation for Economic Co-operation and Development

OR:

Odds ratio

PROSPERO:

International Prospective Register of Systematic Reviews

RCT:

Randomised Controlled Trial

ROBIS:

Risk of bias in systematic reviews

TIDierR:

Template for Intervention Description and Replication

USA:

United States of America

References

  1. 1.

    Her Majesty’s Inspectorate of Constabulary, C.Q.C., Her Majesty’s Inspectorate of Prisons, and Healthcare Inspectorate Wales. A criminal use of police cells? The use of police custody as a place of safety for people with mental health needs. June 2013, Her Majesty’s Inspectorate of Constabulary, Care Quality Commission. London: Her Majesty’s Inspectorate of Prisons, and Healthcare Inspectorate Wales.

  2. 2.

    Department of Health and Concordat signatories, Mental health crisis care concordat improving outcomes for people experiencing mental health crisis. February 2014.

  3. 3.

    Mental Health Act 1983 Section 136. http://www.legislation.gov.uk/ukpga/1983/20/section/136 The Stationery Office. UK.

  4. 4.

    National Policing Improvement Agency on behalf of the Association of Chief Police Officers, Guidance on responding to people with mental ill health or learning disabilities. 2010.

  5. 5.

    Bluestone J, et al. Effective in-service training design and delivery: evidence from an integrative literature review. Hum Resour Health. 2013;11:51.

  6. 6.

    Hutchinson L. Evaluating and researching the effectiveness of educational interventions. BMJ. 1999;318(7193):1267–9.

  7. 7.

    Khan KS, Coomarasamy A. A hierarchy of effective teaching and learning to acquire competence in evidenced-based medicine. BMC Medical Education. 2006;6:59.

  8. 8.

    Wilkes M, Bligh J. Evaluating educational interventions. BMJ: British Medical Journal. 1999;318(7193):1269–72.

  9. 9.

    Whiting P, et al. ROBIS: a new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol. 2015;69:225–34.

  10. 10.

    Higgins JPT, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.

  11. 11.

    Wells GA, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. 28 Apr 2016]; Available from: http://www.ohri.ca/programs/clinical_epidemiology/oxford.htm.

  12. 12.

    National Institutes of Health: and National Heart Lung and Blood Institute. Quality assessment tool for before-after (pre-post) studies with no control group. Systematic Evidence Reviews and Clinical Practice Guidelines. Washington DC: National Institutes of Health; 2014.

  13. 13.

    Compton MT, et al. A comprehensive review of extant research on crisis intervention team (CIT) programs. J Am Acad Psychiatry Law. 2008;36(1):47–55.

  14. 14.

    Thombs D, et al. Resident assistant training program for increasing alcohol, other drug, and mental health first-aid efforts. Prev Sci. 2015;16(4):508–17.

  15. 15.

    Teagardin J, et al. Randomized trial of law enforcement training on autism spectrum disorders. Research in Autism Spectrum Disorders. 2012;6(3):1113–8.

  16. 16.

    Svensson B, Hansson L. Effectiveness of mental health first aid training in Sweden. A randomized controlled trial with a six-month and two-year follow-up. PLoS One. 2014;9(6):e100911.

  17. 17.

    Rafacz, J.D., Anti-stigma programs: stigma in campus police officers. Ann Arbor: ProQuest LLC; 2012.

  18. 18.

    Ostberg M, Rydell AM. An efficacy study of a combined parent and teacher management training programme for children with ADHD. Nord J Psychiatry. 2012;66(2):123–30.

  19. 19.

    Moor S, et al. Improving the recognition of depression in adolescence: can we teach the teachers? J Adolesc. 2007;30(1):81–95.

  20. 20.

    McVey G, et al. A controlled evaluation of web-based training for teachers and public health practitioners on the prevention of eating disorders. Brunner-Mazel Eating Disorders Monograph Series. 2008;17(1):1–26.

  21. 21.

    Lipson SK, et al. Gatekeeper training and access to mental health care at universities and colleges. J Adolesc Health. 2014;55(5):612–9.

  22. 22.

    Kolko DJ, et al. Implementation of AF-CBT by community practitioners serving child welfare and mental health: a randomized trial. Child Maltreatment. 2012;17(1):32–46.

  23. 23.

    Jorm AF, et al. Mental health first aid training for high school teachers: a cluster randomized trial. BMC Psychiatry. 2010;10:51.

  24. 24.

    Hart JE, More CM. Investigating the impact of technology on pre-service teacher knowledge of autism spectrum disorder. Education and Training in Autism and Developmental Disabilities. 2013;48(4):504–13.

  25. 25.

    Dorsey S, et al. Child welfare caseworkers as service brokers for youth in foster care: findings from project focus. Child Maltreatment. 2012;17(1):22–31.

  26. 26.

    Bailey A, Barr O, Bunting B. Police attitudes toward people with intellectual disability: an evaluation of awareness training. J Intellect Disabil Res. 2001;45(Pt 4):344–50.

  27. 27.

    Hansson L, Markstrom U. The effectiveness of an anti-stigma intervention in a basic police officer training programme: a controlled study. BMC Psychiatry. 2014;14:55.

  28. 28.

    Herrington V, Pope R. The impact of police training in mental health: an example from Australia. Polic Soc. 2014;24(5):501–22.

  29. 29.

    Forni C, Caswell N, Spicer J. Delivering mental health awareness training to police officers. Nurs Times. 2009;105(10):12–3.

  30. 30.

    Norris C, Cooke E. Mental health training scheme for police officers. Professional Nurse. 2000;15(10):655–8.

  31. 31.

    Pinfold V, et al. Reducing psychiatric stigma and discrimination--evaluating an educational intervention with the police force in England. Soc Psychiatry Psychiatr Epidemiol. 2003;38(6):337–44.

  32. 32.

    LaMontagne AD, et al. An integrated workplace mental health intervention in a policing context: protocol for a cluster randomised control trial. BMC Psychiatry. 2016;16:49.

  33. 33.

    Tusting K, Barton D. Models of adult learning: a literature review. Leicester: NIACE; 2006.

  34. 34.

    Taylor EW. An update of transformative learning theory: a critical review of the empirical research (1999–2005). Int J Lifelong Educ. 2007;26(2):173–91.

  35. 35.

    Marriott BR, et al. A methodology for enhancing implementation science proposals: comparison of face-to-face versus virtual workshops. Implement Sci. 2016;11(1):1–11.

  36. 36.

    Dunst CJ, Trivette CM. Moderators of the effectiveness of adult learning method practices. J Soc Sci. 2012;8(2):143–8.

  37. 37.

    Coleman T, Cotton D. TEMPO: a contemporary model for police education and training about mental illness. Int J Law Psychiatry. 2014;37(4):325–33.

  38. 38.

    Watson AC, Fulambarker AJ. The crisis intervention team model of police response to mental health crises: a primer for mental health practitioners. Best Practices in Mental Health. 2012;8(2):71.

  39. 39.

    Chappell D, O'Brien A. Police responses to persons with a mental illness: international perspectives. Int J Law Psychiatry. 2014;37(4):321–4.

  40. 40.

    van den Brink RH, et al. Role of the police in linking individuals experiencing mental health crises with mental health services. BMC Psychiatry. 2012;12(1):1–7.

  41. 41.

    Home Office. The Stephen Lawrence inquiry (Macpherson report). London: HMSO; 1999.

  42. 42.

    Wei Y, et al. Measurement properties of tools measuring mental health knowledge: a systematic review. BMC Psychiatry. 2016;16(1):1–16.

  43. 43.

    Williamson P, et al. Comet Initiative: Core Outcome Measures in Effectiveness Trials. 20 July 2016]; Available from: http://www.comet-initiative.org/.

  44. 44.

    Byng R, et al. Engager 2: Developing and evaluating a collaborative care intervention for offenders with common mental health problems, near to and after release. Comet Initiative: Core Outcome Measures in Effectiveness Trials 2013 20 July 2016]; Available from: http://www.comet-initiative.org/studies/details/602.

  45. 45.

    The EQUATOR Network. Equator: Enhancing the QUAlity and Transparency Of health Research. 20 July 2016]; Available from: http://www.equator-network.org/.

  46. 46.

    Hoffmann TC, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ (Clinical research ed). 2014;348:g1687.

  47. 47.

    Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med. 2010;7(3):e1000251.

  48. 48.

    Mohler R, Kopke S, Meyer G. Criteria for reporting the development and evaluation of complex interventions in healthcare: revised guideline (CReDECI 2). Trials. 2015;16:204.

Download references

Acknowledgements

The following collaborators are thanked for their comments on the draft protocol: Richard Anderson, North Yorkshire Police; David Torgerson, and Catherine Hewitt, York Trials Unit, University of York; Martin Webber, and Nicola Moran, Department of Social Policy and Social Work, University of York.

The authors would like to thank Kat Chatterton for assistance with ILLs and formatting. The authors also extend their thanks and appreciation for the time taken by the police personnel who responded to the request for audit or evaluation information.

Funding

This review was undertaken as part of Connect, the Co-production of policing evidence, research and training: focus mental health project (http://connectebp.org/). The project is funded by the Higher Education Funding Council for England (HEFCE) and the Home Office through the College of Policing.

Availability of data and materials

The data extraction and quality assessment tables are available on request.

Authors’ contributions

AB lead the review and was responsible for writing the protocol, study selection, data extraction, validity assessment and writing the final report. KW devised the search strategies and carried out the literature searches and wrote the search methodology section of the paper. AB, AC and AH-M undertook study selection, data extraction and validity assessment. AH-M undertook the forward and backward hand searches and searches of websites. All the authors commented on the draft protocol and the final report. CM provided input at all stages, commented on all draft documents and had overall responsibility for the review. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Not applicable to this systematic review.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Correspondence to Alison Booth.

Additional files

Additional file 1:

Search strategies. (DOCX 74 kb)

Additional file 2:

Table of studies excluded on review of full paper. (DOCX 50 kb)

Additional file 3:

Quality assessments. (DOCX 19 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Booth, A., Scantlebury, A., Hughes-Morley, A. et al. Mental health training programmes for non-mental health trained professionals coming into contact with people with mental ill health: a systematic review of effectiveness. BMC Psychiatry 17, 196 (2017) doi:10.1186/s12888-017-1356-5

Download citation

Keywords

  • Training
  • Mental health
  • Police
  • Systematic review