- Research article
- Open Access
- Open Peer Review
High-intensity therapist-guided internet-based cognitive behavior therapy for alcohol use disorder: a pilot study
© The Author(s). 2017
- Received: 31 January 2017
- Accepted: 12 May 2017
- Published: 26 May 2017
A large proportion of individuals with alcohol problems do not seek psychological treatment, but access to such treatment could potentially be increased by delivering it over the Internet. Cognitive behavior therapy (CBT) is widely recognized as one of the psychological treatments for alcohol problems for which evidence is most robust. This study evaluated a new, therapist-guided internet-based CBT program (entitled ePlus) for individuals with alcohol use disorders.
Participants in the study (n = 13) were recruited through an alcohol self-help web site (www.alkoholhjalpen.se) and, after initial internet screening, were diagnostically assessed by telephone. Eligible participants were offered access to the therapist-guided 12-week program. The main outcomes were treatment usage data (module completion, treatment satisfaction) as well as glasses of alcohol consumed the preceding week, measured with the self-rated Timeline Followback (TLFB). Participant data were collected at screening (T0), immediately pre-treatment (T1), post-treatment (T2) and 3 months post-treatment (T3).
Most participants were active throughout the treatment and found it highly acceptable. Significant reductions in alcohol consumption with a large within-group effect size were found at the three-month follow-up. Secondary outcome measures of craving and self-efficacy, as well as depression and quality of life, also showed significant improvements with moderate to large within-group effect sizes.
Therapist-guided internet-based CBT may be a feasible and effective alternative for people with alcohol use disorders. In view of the high acceptability and the large within-group effect sizes found in this small pilot, a randomized controlled trial investigating treatment efficacy is warranted.
ClinicalTrials.gov (NCT02384278, February 26, 2015).
- Cognitive behavior therapy
- Alcohol use disorders
- Alcohol dependence
- Internet-based psychotherapy
It is well established that alcohol use has major detrimental effects on physical and mental health. Approximately 6% of all deaths in the world are ascribed to alcohol , currently the third leading risk factor for global disease burden . While consumption levels are highest in Europe and North America, alcohol use is rapidly growing in developing countries such as China and India, with a resulting global overall increase in alcohol use during recent years . Individuals with a diagnosed alcohol use disorder (AUD), i.e. those with impaired control over their alcohol consumption and who continue drinking despite serious adverse consequences , are estimated to account for about half of all global alcohol-related harm in developed countries . In particular, the risk of dying from somatic diseases such as liver cirrhosis, cancer and cardiovascular disease is several times higher among people with an AUD . The impact of AUD on morbidity and mortality is monumental, and increasing access to evidence-based treatment is imperative to health care.
Both pharmacological and psychological treatment alternatives for people with AUD can be considered evidence-based . Among the better-known psychological evidence-based treatments are Motivational Interviewing  and cognitive behavior therapies such as Community Reinforcement Approach  and Relapse Prevention . Although evidence-based treatments exist, few people with AUD seek help for their problems. For example, while recent epidemiological data indicated that 29% of adults in the USA had met the DSM-5 criteria for an AUD at some point in their lives, only 20% of these reported ever having sought help for their problems . Similarly, a recent study conducted in a primary care setting in six different European countries found that only one in five people with current alcohol dependence had received professional help for their alcohol problems . Research has identified several reasons why people with alcohol problems seek help to such a low extent. People may not believe that treatment will be effective, they may think that they should be able to deal with the problem on their own, and they may deny having a problem altogether; a further major barrier to seeking help is stigma . In fact, fear of stigmatization has been shown to reduce the probability of seeking help for alcohol problems , a phenomenon that follows from the finding that AUD is the most severely stigmatized psychiatric condition of all. People with AUD provoke more social rejection and negative emotions than people with other psychiatric conditions, and are also held responsible for their condition to a greater extent than people suffering from depression and schizophrenia .
One way of increasing access to psychological treatment is to deliver it online. Advantages of doing this include cost-effectiveness and overcoming geographical barriers . Delivering treatment online may also reduce the stigma associated with having to visit a clinic to receive treatment. There are two distinctly different ways of delivering psychological treatment online: programs available directly to the public, usually brief and without therapist contact but with some levels of automation, and more intensive programs guided by a therapist mirroring traditional manual-based face-to-face therapy  . Internet-based treatment delivered in this latter way is usually based on cognitive behavior therapy, and is then commonly referred to as ICBT . This form of treatment has been developed and extensively studied with psychiatric disorders such as depression and anxiety , and there are examples of successful implementation of ICBT in regular care [18–20]. However, although potentially vast, the reach of ICBT remains quite limited and significantly increasing its accessibility is a challenge that has yet to be addressed .
Most of the online psychological treatments developed to target problematic alcohol use have been rather brief, low-intensity, automated open access programs without guidance from a therapist . Although some of these programs have been based on cognitive behavior therapy [23, 24], most have focused on delivering ‘brief intervention’, a form of prophylactic single-session treatment typically aimed at helping hazardous drinkers moderate their drinking by providing screening and feedback on their alcohol consumption [25, 26]. Effects on alcohol consumption have generally been small , and a recent systematic review noted that the lack of internet interventions addressing AUDs specifically – not only hazardous drinking – hampers any clinical implications . Internet-based treatment based on cognitive behavior therapy and guided by a therapist have, to our knowledge, been tested in three controlled studies [28–30]. Two of these studies evaluated the same treatment content [28, 29] which has been categorized as low-intensity . The third study could be considered high-intensity as the therapist contact was quite extensive and participants were instructed to visit the program daily . Moderate to large effect sizes on alcohol consumption were found in comparison to control groups in these studies (post-treatment 0.59 in Blankers et al. ; 0.75 in Sundström et al. ; 1.21 in Postel et al. ). Although these results are promising, none of the studies conducted standard interview-based diagnostic assessments with participants.
The aim of the present study was to evaluate the feasibility and preliminary effects of a high-intensity therapist-guided ICBT program for people with a diagnosed alcohol use disorder. We hypothesized that ICBT would be acceptable to the participants and that it would be associated with a reduction in alcohol consumption and in other alcohol-related measures.
This was an uncontrolled pilot study intended to evaluate the feasibility and preliminary effects of a comprehensive, therapist-guided CBT program for alcohol use disorders. A within-group design with repeated measures was used.
Procedure and participants
Participants’ demographic characteristics at baseline
n = 13
Age in years, m (sd)
Range in years
Married/living with a partner/in a relationship
Secondary school (grades 10–12)
Compulsory school (grades 1–9)
Current employment in percent (%)
Full time (100%)
Self-perceived economic situation
Neither good nor bad
Years with self-reported alcohol problems
More than 10 years
Previously sought help for alcohol problems
Prior support received when seeking help
Alcohol Use Disorder (DSM-5)
Mild (2–3 criteria)
Moderate (4–5 criteria)
Severe (6 or more criteria)
Readiness to Change (RCQ)
The Timeline Followback (TLFB) is a method of measuring alcohol consumption in terms of standard drinks over a specified length of time . Participants were asked about the number of standard drinks consumed during the preceding seven days. TLFB delivered via computer has been found to yield data that correlate highly with paper and pencil . Test-retest evaluation of a web-administered 7-day version of TLFB showed an intra-class correlation of 0.67, deemed fair . In addition to TLFB, participants registered their preceding calendar week alcohol consumption once a week throughout the treatment by answering the following two questions: 1) How many standard drinks did you have the preceding calendar week? 2) Over how many days were these standard drinks distributed?
The Alcohol Use Disorders Identification Test (AUDIT) is a well-established and widely used 10-item instrument for measuring alcohol consumption and signs of harmful use and dependence related to alcohol consumption . The instrument renders a score between 0 and 40. A score of between 6 and 13 for women and between 8 and 15 for men is considered to denote hazardous use; a score of between 14 and 19 for women, and between 16 and 19 for men is considered harmful use. A score of 20 or above for both men and women is considered probable alcohol dependence . The web-administered Swedish version has shown internal consistency reliability in terms of Cronbach’s α values at 0.80–0.93 .
The Alcohol Abstinence Self-Efficacy Scale (AASE) is a scale measuring self-efficacy related to one’s ability to abstain from alcohol. Several versions of this instrument have been developed. The version used in this study consisted of 12 questions regarding the capacity to abstain from alcohol in various situations of temptation .
The Penn Alcohol Craving Scale (PACS) is a 5-item instrument that measures craving. PACS has been shown to have good convergent and discriminant validity as well as excellent internal consistency (Cronbach’s α of 0.92) . The instrument was translated into Swedish by the first and last authors (CS, AHB).
The MADRS-S is an instrument measuring depression. It consists of nine items, each measuring a different symptom on a seven-point scale with a total scale ranging from 0 to 54 . The instrument has been found to have excellent test-retest reliability and excellent internal consistency as well as to correlate with other similar instruments such as Beck Depression Inventory . The online version has been found to have the same psychometric properties as the paper-and-pen version  with a Cronbach’s α of 0.73–0.90 .
The World Health Organization Quality of Life Scale-abbreviated version (WHOQOL-BREF) consists of 26 questions measuring quality of life on four domains: physical, psychological, social and environmental. The items are measured on a Likert scale of 1 to 5. Scores for each of the four domains are transformed into a score on a scale of 0–100. In a general population sample in Denmark, scores were found to be between 67 and 82 on each domain scale . The instrument has yielded fair to good results for internal consistency, with Cronbach’s α of 0.68–0.82 in multiple language versions . A recent study validated different online versions of the instrument, and found that these generated the same Cronbach’s alpha at levels similar to paper-and-pencil versions .
The Drug Use Disorders Identification Test (DUDIT) is an 11-item questionnaire designed to assess patterns of drug consumption and drug-related problems . The instrument renders a score between 0 and 44, with a score between 8 and 24 considered harmful use , and a score of 25 or above considered probable drug dependence . The DUDIT has shown good internal consistency reliability for a web-administered Swedish version at Cronbach’s α = 0.86 .
The Readiness to Change Questionnaire (RCQ) is an instrument for measuring the respondent’s motivation for changing their relation to alcohol . The instrument contains 12 questions that, taken together, place the respondent in the pre-contemplation, contemplation or action phases of the Trans-Theoretical model of change. The Swedish version has yielded excellent internal consistency (Cronbach’s α = 0.88) . To the authors’ knowledge, there is no validation of the RCQ for online administration.
The Client Satisfaction Scale-8 is an eight-item instrument that measures satisfaction with treatment . Scores range from 0 to 32 with higher scores indicating greater satisfaction. The instrument has been found to have high internal consistency (Cronbach’s α of 0.92). To evaluate acceptability more thoroughly, CSQ-8 was complemented with questions about how the program and the therapist contact was perceived by participants, as well as questions about whether any other form of treatment had been received during the 12-week period. Acceptability was further assessed with a semi-structured interview conducted over telephone by the first author (CS) to assess adverse events .
Summary of the treatment manual: purpose and homework assignments
Purpose of module
Module 1Alcohol Education
T o learn about the effects of alcohol on body and mind and about tolerance and abstinence
Questions pertaining to the text
Module 2 Pros and cons of drinking
To help the participant reflect about pros and cons of drinking
Make a decisional balance
Module 3 Goals and values
To learn the difference between goals and values, and why these are important to establish at the beginning of treatment
Set an alcohol consumption goal during treatment (abstinence or moderate drinking)
Explore and formulate core values in life
Module 4 Analyzing risk situations
To learn what risk situations are, and how to analyze them
Complete a behavioral analysis of one’s own risk situations
Module 5 Dealing with craving
To learn about craving and ways of dealing with it
Make notes on how to deal with craving: who can you call when you feel craving?, what can you do to distract yourself,? where can you surf on your craving?
Module 6 Dealing with thoughts about alcohol
To learn about what thoughts commonly occur among people who have just begun changing their alcohol habits
Make notes on which thoughts about alcohol occur most frequently
Make a situational analysis and choose which specific coping strategies to use when the thoughts appear
Module 7 Dealing with social situations
T o learn about why it can be hard to say no to alcohol in social situations
Practice saying no with a friend or in front of a mirror
Write down answers to specific situations presented in the text
Module 8 Finding other activities
To learn about the ‘’reward trap” (using alcohol as a reward), and the importance of finding other meaningful activities
List activities to engage in that do not include alcohol
Draw up a time schedule for doing them
Module 9 Problem solving
To learn about stress, how it is sometimes associated with alcohol use, and about problem solving as a technique
Go through problem solving and apply it step by step in at least one situation
Module 10 Negative thoughts and interpretation traps
To learn about negative thoughts and about coping strategies to deal with them, cognitive restructuring
Complete a behavioral analysis of negative thoughts and challenge these thoughts
Module 11 Seemingly irrelevant decisions
To learn about the importance of identifying small, seemingly irrelevant decisions that could lead to drinking
Make notes on a situation where irrelevant decisions were involved in one’s drinking
Module 12 Relapse plan
To learn about the concept of relapse, and predict situations that could make it harder to resist drinking
Formulate a relapse plan
Module 13 Life without alcohol problems
To summarize the treatment and look towards the future
Review the initial alcohol consumption goal formulated in Module 1
Set goals for the future, after treatment
SPSS version 22 (SPSS, Chicago, IL) was used for all statistical analyses. Descriptive statistics were calculated to summarize demographic characteristics at screening. To compare the preliminary efficacy of the treatment across time, generalized estimating equations (GEE) with an unstructured correlation matrix were run comparing primary and secondary outcome measures from screening to post-treatment, from screening to 3-month follow-up and from post-treatment to 3-month follow-up. On all outcome measures a normal model was used, apart from TLFB, where a negative binomial model was used due to the assumed non-normal distribution of alcohol consumption . Data were analyzed according to the intention to treat (ITT) principle. Cohen’s d was used to calculate within-group effect sizes [Available, from:, http://www.cognitiveflexibility.org/effectsize/]. Since this was a pilot study intended to measure feasibility and preliminary effects, no power calculation was performed.
Two participants terminated treatment during the first week, one because of simultaneous enrollment in a group treatment for alcohol problems and one due to perceived lack of time. A third participant dropped out of the treatment about halfway through, due to self-reported stress and anxiety associated with partaking in the treatment. All three individuals were retained in the primary analysis according to the intention-to-treat (ITT) principle.
Outcomes and effect sizes
Observed mean (SE), change values (SE) and effect sizes
3 month follow up
Change screening to post-treatment
Change screening to 3-month follow up
Change posttreatment to 3- month follow- up
During the 12-week treatment, the participants sent an average of 16.2 (sd = 7.2) messages to the therapist, ranging from 2 to 28 messages per participant. The therapists sent an average of 16.9 (sd = 10.4) messages to each participant, ranging from 1 to 35 messages per participant. Participants submitted an average of 59% of the 13 homework assignment report forms (m = 7.7, sd = 4.5) ranging from 0 to 13 homework report forms per participant.
Participant satisfaction ratings on the CSQ-8 indicated that satisfaction was excellent with a mean score on the CSQ-8 of 25.7 (range 18–32, SD = 3.98) . Participants also answered evaluation questions specifically about their experiences of the treatment content, program usage, and the therapist contact. Concerning the treatment content, 91% stated that they found the text interesting and relevant, and all participants stated that they read 75% or more of everything there was to read. Concerning program usage, 73% stated that they worked quite actively with the homework assignments. Concerning therapist contact, 73% stated that they felt they had received lot of help from the therapist contact and 82% stated that they thought it was easy to understand what the therapist wrote.
Other treatments and adverse events
One participant reported having initiated medication for alcohol use during the treatment (disulfiram), and four participants reported having received some other form of help for their alcohol use; two of these had visited a doctor, one had visited a self-help web site and one had attended 12-step meetings. No adverse events were reported in the post-treatment interviews. However, as mentioned previously, one participant did terminate treatment due to self-reported stress and anxiety, and although this participant did not define this as an adverse event in the interview, our clinical judgment is that it constituted an adverse event.
The aim of this pilot study was to investigate feasibility and preliminary effects of a comprehensive therapist-guided CBT-program for alcohol use disorders. Participants displayed high satisfaction with the treatment and most were active during the full treatment period; on average almost 60% of the modules were completed by the participants, fully comparable to what has been found in other studies on ICBT . On average, a participant had slightly more than one contact with his or her therapist per week. Furthermore, a large within-group effect size was found on the primary outcome (standard drinks consumed preceding week) and moderate to large within-group effect sizes were found on the secondary outcomes of craving, self-efficacy, depression and quality of life. All improvements were maintained at the 3-month follow-up. In general, the effect sizes are in line with what has been found in other controlled trials investigating therapist-guided internet-based treatment for alcohol problems [28–30].
Internet-based interventions with therapist support have been found to be successful for several common psychiatric disorders and in some cases these interventions are already an integrated part of health care [62, 63]. Interventions for AUD, however, may entail specific challenges due to the potential long-term effects of alcohol on basic neuropsychological functions. Episodic memory deficits and executive dysfunctions have both repeatedly been associated with AUD early in abstinence [64, 65]. If internet interventions are to become an integral part of clinical care for people with AUD, a crucial aspect, after establishing effectiveness, would be to tailor interventions to patients with different neuropsychological profiles. Examples could be offering less text-heavy interventions to patients with episodic memory deficits or offering smart phone apps with automatic reminders to patients with executive dysfunctions . Generally, clinical utility would be widened if neuropsychological aspects were taken into account when designing and developing the interventions. However, it is worth mentioning that about half of the participants in our study reported having had alcohol problems for more than 10 years, indicating that even people with a long history of severe problems can benefit from this form of intervention. More studies are needed to assess whether such tailoring is necessary and if so, under what diagnostic circumstances.
A significant strength of this study is the use of diagnostic assessment interviews conducted with participants to assess severity of alcohol problems. Few studies on internet-based interventions for alcohol problems have made any attempt at all to diagnose the participants, and, to our knowledge, those who did used self-administered online questionnaires, not interviews . Diagnostic assessments facilitate generalizations to clinical populations, an important step if research results are to be translated into clinical practice. A further strength of this study is that we had follow-up data from all participants over all major time points. This is uncommon for studies on psychological interventions in general and for internet-based interventions in particular . Compared to the previously mentioned therapist-guided internet treatment studies on alcohol, Postel et al. 2010 had an attrition rate of 54% , Blankers et al. 2011 had an attrition rate of 30%  and Sundström et al. 2016 had an attrition rate of 25% . A probable explanation for the absence of attrition in this pilot study is that the diagnostic telephone interviews conducted before treatment made participants feel more obligated to participate in the follow-ups.
The purpose of this pilot study was not to evaluate causality, but to assess preliminary effects, acceptability and possible adverse effects. Use of a control group is always a prerequisite for establishing causality, and might be particularly important when attempting to establish efficacy of interventions for alcohol problems given the fact that so many people seem to be able to stop or reduce their drinking on their own without any or little help . This important limitation should naturally be considered when interpreting the results. Furthermore, participants in our study were presumably highly motivated to change, since they were recruited through a self-help site. This high degree of motivation is reflected in the RCQ baseline scores, where almost all participants were in the ‘Action’ stage. Motivation is an important factor in all interventions for alcohol use disorders and the motivation among participants should be taken into consideration if the results are to be applied in clinical settings. Secondly, in our study, participants’ average baseline consumption of 23.1 standard drinks could be considered low. In other comparable studies, baseline consumption for preceding week has usually been somewhere between 30 and 45 standard drinks [23, 28, 30]. Alcohol consumption during the preceding week was not used as an inclusion criterion in our study, and three participants had an alcohol consumption during the preceding week below the recommended weekly limit of 9 standard drinks for women and 14 standard drinks for men at screening. The inclusion of these participants meant that there was little or no room for change in the primary outcome for these participants, thereby decreasing the effect size. It might also indicate that our study included participants with a lower severity of problems compared to other studies. However, several aspects indicate that our participants did have severe alcohol problems despite some of them having a low consumption the week before baseline measurement. The mean AUDIT score at baseline screening in our sample was well over 20, which is the cut-off for probable alcohol dependence, and our diagnostic interviews identified all of our recruited participants as having an AUD according to the diagnostic critieria (2 or more positive criteria) with eight of these (67%) having a severe AUD.
If the preliminary positive results in the current study could be confirmed in a randomized controlled trial, this would have important clinical implications. There are several potential advantages to offering comprehensive and effective treatment packages online for people with alcohol problems. As previously mentioned, it is well known that stigma and shame are common among people with alcohol use disorders, and may hinder seeking adequate help . Online treatment could help reduce the treatment gap, by increasing access to treatment for people who find it difficult and anxiety-provoking to visit a treatment clinic and talk with a therapist about their alcohol problems. Other advantages with digital interventions include the logistical aspect. For example, countries such as Sweden and Australia are sparsely populated, and for people living in rural areas, visiting a clinic in person might mean having to undertake extended travels to receive help. After-care could also be handled with digital interventions, as has been shown in a recent publication where a mobile-phone app was successful in reducing number of risky drinking days . Lastly, it is very common for alcohol treatment to only be offered in support groups. Although support groups are often appreciated, it is important that a variety of treatment options are available for this heterogeneous population.
ICBT seems to be a feasible, safe and acceptable treatment for people with alcohol use disorders. The next step is to validate the effects in a randomized controlled trial.
We thank Karin Romberg, MSc, for helpful comments on an earlier version of the ePlus manual.
This study was supported by grants to author AHB from the Swedish Research Council, nr K2012-61X-22,132-01-6, supporting author CS during manuscript preparation; and grant nr K2012-61P-22,131-01-6, supporting author AHB’s salary throughout the project. All other authors were supported by their employers for their work throughout the project. The funding organizations had no role in the conception of the study, in the analyses of the data, in the writing of the manuscript, nor in the decision to submit it for publication.
Availability of data and materials
The data set supporting the results of this article is available in the Open ICPSR repository with the following identifying information: Berman, A. H. (2017–01-31). High-intensity therapist-guided internet-based cognitive behavior therapy for alcohol use disorders – a pilot study. [Data set]. Ann Arbor, MI: Inter-university Consortium of Political and Social Research [distributor]. http://doi.org/10.3886/E100415V1.
Authors CS, VK, NE, CF and AHB conceived the study together. Data were collected by CS, NE and MK. CS wrote the manuscript with continual input from all authors. All authors reviewed the final article text and are responsible for its contents.
All authors declare that they have no competing interests.
Consent for publication
No individual details on participants such as images, videos or voice recordings were collected; thus specific consent for publication was not deemed necessary.
Ethics approval and consent to participate
All participants were informed about the aim of the study and procedure for data collection. This information included a standard formulation regarding the voluntary nature of study participation as well as the message that participants could leave the study at any time without any negative consequences. Formal ethical approval was granted by the Stockholm Regional Ethical Review Board (ref nr 2015/26–31).
The study was approved by the Regional Ethics Review Board in Stockholm, Sweden (2015/26–31) and registered at ClinicalTrials.gov (NCT02384278 February 26, 2015). Informed consent was collected digitally before screening via the statement “I agree to participate in the study,” with response alternatives “Yes/No.” No separate written consent was collected.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Global status report on alcohol and health 2014. World Health Organization, 2014.Google Scholar
- Lim SS, Vos T, Flaxman AD, Danaei G, Shibuya K, Adair-Rohani H, et al. A comparative risk assessment of burden of disease and injury attributable to 67 risk factors and risk factor clusters in 21 regions, 1990-2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380(9859):2224–60. PubMed PMID: WOS:000312387000017View ArticlePubMedPubMed CentralGoogle Scholar
- Connor JP, Haber PS, Hall WD. Alcohol use disorders. Lancet 2016;387(10022):988-998. Epub 2015/09/08. doi: 10.1016/s0140-6736(15)00122-1. PubMed.
- Rehm J, Baliunas D, Borges GL, Graham K, Irving H, Kehoe T, et al. The relation between different dimensions of alcohol consumption and burden of disease: an overview. Addiction. 2010;105(5):817-843. Epub 2010/03/25. doi: 10.1111/j.1360-0443.2010.02899.x. PubMed PMID: 20331573; PubMed Central PMCID: PMCPmc3306013.
- Roerecke M, Rehm J. Cause-specific mortality risk in alcohol use disorder treatment patients: a systematic review and meta-analysis. Int J Epidemiol 2014;43(3):906-919. Epub 2014/02/12. doi: 10.1093/ije/dyu018. PubMed.
- Rubak S, Sandbaek A, Lauritzen T, Christensen B. Motivational interviewing: a systematic review and meta-analysis. Br J Gen Pract. 2005;55(513):305–12. Epub 2005/04/14. PubMed PMID: 15826439; PubMed Central PMCID: PMCPmc1463134PubMedPubMed CentralGoogle Scholar
- Meyers RJ, Roozen HG, Smith JE. The community reinforcement approach: an update of the evidence. Alcohol Res Health. 2011;33(4):380–8. Epub 2011/01/01. PubMed PMID: 23580022; PubMed Central PMCID: PMCPmc3860533PubMedPubMed CentralGoogle Scholar
- Irvin JE, Bowers CA, Dunn ME, Wang MC. Efficacy of relapse prevention: a meta-analytic review. J Consult Clin Psychol. 1999;67(4):563–70. Epub 1999/08/18. PubMedView ArticlePubMedGoogle Scholar
- Grant BF, Goldstein RB, Saha TD, Chou SP, Jung J, Zhang H, et al. Epidemiology of DSM-5 Alcohol Use Disorder: Results From the National Epidemiologic Survey on Alcohol and Related Conditions III. JAMA Psychiatry 2015;72(8):757-766. Epub 2015/06/04. doi: 10.1001/jamapsychiatry.2015.0584. PubMed.
- Rehm J, Allamani A, Elekes Z, Jakubczyk A, Manthey J, Probst C, et al. Alcohol dependence and treatment utilization in Europe - a representative cross-sectional study in primary care. BMC Fam Pract. 2015;16:90. Epub 2015/07/30. doi: 10.1186/s12875-015-0308-8. PubMed PMID: 26219430; PubMed Central PMCID: PMCPmc4518612.
- Grant BF. Barriers to alcoholism treatment: reasons for not seeking treatment in a general population sample. J Stud Alcohol 1997;58(4):365-371. Epub 1997/07/01. PubMed.Google Scholar
- Keyes KM, Hatzenbuehler ML, McLaughlin KA, Link B, Olfson M, Grant BF, et al. Stigma and Treatment for Alcohol Disorders in the United States. Am J Epidemiol. 2010;172(12):1364–72. doi:10.1093/aje/kwq304.View ArticlePubMedPubMed CentralGoogle Scholar
- Schomerus G, Lucht M, Holzinger A, Matschinger H, Carta MG, Angermeyer MC. The stigma of alcohol dependence compared with other mental disorders: a review of population studies. Alcohol Alcohol 2011;46(2):105-112. Epub 2010/12/21. doi: 10.1093/alcalc/agq089. PubMed.
- Andersson G. The promise and pitfalls of the internet for cognitive behavioral therapy. BMC Med. 2010;8:82. Epub 2010/12/09. doi: 10.1186/1741-7015-8-82. PubMed PMID: 21138574; PubMed Central PMCID: PMCPmc3004806.
- Andersson G, Bergström J, Buhrman M, Carlbring P, Holländare F, Kaldo V, et al. Development of a New Approach to Guided Self-Help via the Internet: The Swedish Experience. J Technol Hum Serv. 2008;26(2–4):161–81. doi:10.1080/15228830802094627.View ArticleGoogle Scholar
- Hedman E. Therapist guided internet delivered cognitive behavioural therapy. BMJ (Clin Res ed). 2014;348:g1977. Epub 2014/03/13. doi: 10.1136/bmj.g1977. PubMed.
- Hedman E, Ljotsson B, Lindefors N. Cognitive behavior therapy via the Internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res 2012;12(6):745-764. Epub 2012/12/21. doi: 10.1586/erp.12.67. PubMed.
- Ljótsson B, Hesser H, Andersson E, Lackner JM, El Alaoui S, Falk L, et al. Provoking symptoms to relieve symptoms: A randomized controlled dismantling study of exposure therapy in irritable bowel syndrome. Behav Res Ther. 2014;55:27-39. doi: http://0-dx.doi.org.brum.beds.ac.uk/10.1016/j.brat.2014.01.007.
- Kaldo V, Haak T, Buhrman M, Alfonsson S, Larsen HC, Andersson G. Internet-based cognitive behaviour therapy for tinnitus patients delivered in a regular clinical setting: outcome and analysis of treatment dropout. Cogn Behav Ther 2013;42(2):146-158. Epub 2013/02/26. doi: 10.1080/16506073.2013.769622. PubMed.
- Titov N, Dear BF, Staples LG, Bennett-Levy J, Klein B, Rapee RM, et al. MindSpot Clinic: An Accessible, Efficient, and Effective Online Treatment Service for Anxiety and Depression. Psychiatr Serv. 2015;66(10):1043–50. Epub 2015/07/02. doi: 10.1176/appi.ps.201400477. PubMedView ArticlePubMedGoogle Scholar
- Fleming TM, de Beurs D, Khazaal Y, Gaggioli A, Riva G, Botella C, et al. Maximizing the Impact of e-Therapy and Serious Gaming: Time for a Paradigm Shift. Front Psych. 2016;7:65. Epub 2016/05/06. doi: 10.3389/fpsyt.2016.00065. PubMed PMID: 27148094; PubMed Central PMCID: PMCPMC4834305.
- Riper H, Blankers M, Hadiwijaya H, Cunningham J, Clarke S, Wiers R, et al. Effectiveness of guided and unguided low-intensity internet interventions for adult alcohol misuse: a meta-analysis. PLoS One. 2014;9(6):e99912. doi:10.1371/journal.pone.0099912. PubMed PMID: 24937483; PubMed Central PMCID: PMC4061051View ArticlePubMedPubMed CentralGoogle Scholar
- Wallace P, Murray E, McCambridge J, Khadjesari Z, White IR, Thompson SG, et al. On-line randomized controlled trial of an internet based psychologically enhanced intervention for people with hazardous alcohol consumption. PLoS One. 2011;6(3):e14740. doi:10.1371/journal.pone.0014740. PubMed PMID: 21408060; PubMed Central PMCID: PMC3052303View ArticlePubMedPubMed CentralGoogle Scholar
- Riper H, Kramer J, Smit F, Conijn B, Schippers G, Cuijpers P. Web-based self-help for problem drinkers: a pragmatic randomized trial. Addiction 2008;103(2):218-227. Epub 2008/01/18. doi: 10.1111/j.1360-0443.2007.02063.x. PubMed.
- Bien TH, Miller WR, Tonigan JS. Brief interventions for alcohol problems: a review. Addiction 1993;88(3):315-335. Epub 1993/03/01. PubMed.Google Scholar
- Donoghue K, Patton R, Phillips T, Deluca P, Drummond C. The effectiveness of electronic screening and brief intervention for reducing levels of alcohol consumption: a systematic review and meta-analysis. J Med Internet Res. 2014;(6):16, e142.Epub 2014/06/04. doi:10.2196/jmir.3193. PubMed PMID: 24892426; PubMed Central PMCID: PMCPmc4060043
- Dedert EA, McDuffie JR, Stein R, McNiel JM, Kosinski AS, Freiermuth CE, et al. Electronic Interventions for Alcohol Misuse and Alcohol Use Disorders: A Systematic Review. Ann Intern Med 2015;163(3):205-214. Epub 2015/08/04. doi: 10.7326/m15-0285. PubMed.
- Blankers M, Koeter MW, Schippers GM. Internet therapy versus internet self-help versus no treatment for problematic alcohol use: A randomized controlled trial. J Consult Clin Psychol 2011;79(3):330-341. doi: 10.1037/a0023498. PubMed.
- Sundström C, Gajecki M, Johansson M, Blankers M, Sinadinovic K, Stenlund-Gens E, et al. Guided and Unguided Internet-Based Treatment for Problematic Alcohol Use - A Randomized Controlled Pilot Trial. PLoS One. 2016;11(7):e0157817. Epub 2016/07/08. doi: 10.1371/journal.pone.0157817. PubMed PMID: 27383389; PubMed Central PMCID: PMCPMC4934861.
- Postel M, de Haan H, ter Huurne E, Becker E, de Jong C. Effectiveness of a Web-based Intervention for Problem Drinkers and Reasons for Dropout: Randomized Controlled Trial. J Int Med Res. 2010;12(4):e68.Google Scholar
- Saunders JB, Aasland OG, Babor TF, De La Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption-II. Addiction. 1993;88(6):791–804. doi:10.1111/j.1360-0443.1993.tb02093.x.View ArticlePubMedGoogle Scholar
- Allen JP, Litten RZ, Fertig JB, Babor T. A review of research on the Alcohol Use Disorders Identification Test (AUDIT). Alcohol Clin Exp Res 1997;21(4):613-619. Epub 1997/06/01. PubMed.Google Scholar
- Svanborg P, Asberg M. A comparison between the Beck Depression Inventory (BDI) and the self-rating version of the Montgomery Asberg Depression Rating Scale (MADRS). J Affect Disord 2001;64(2–3):203-216. Epub 2001/04/21. PubMed.Google Scholar
- Kranzler HR, Kadden RM, Babor TF, Tennen H, Rounsaville BJ. Validity of the SCID in substance abuse patients. Addiction 1996;91(6):859-868. Epub 1996/06/01. PubMed.Google Scholar
- American Psychiatric Association. Diagnostic and and statistical manual of mental disorders. 5th ed. Washington, DC: American Psychiatric Association; 2013.View ArticleGoogle Scholar
- Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59 Suppl 20:22-33;quiz 4-57. Epub 1999/01/09. PubMed.Google Scholar
- Sobell LC, Maisto SA, Sobell MB, Cooper AM. Reliability of alcohol abusers' self-reports of drinking behavior. Behav Res Ther. 1979;17(2):157–60. Epub 1979/01/01. PubMedView ArticlePubMedGoogle Scholar
- Sobell LC, Brown J, Leo GI, Sobell MB. The reliability of the Alcohol Timeline Followback when administered by telephone and by computer. Drug Alcohol Depend. 1996;42(1):49–54. Epub 1996/09/01. PubMedView ArticlePubMedGoogle Scholar
- Thomas BA, McCambridge J. Comparative psychometric study of a range of hazardous drinking measures administered online in a youth population. Drug Alcohol Depend 2008;96(1–2):121-127. Epub 2008/04/15. doi: 10.1016/j.drugalcdep.2008.02.010. PubMed.
- Bergman H, Kallmen H. Alcohol use among Swedes and a psychometric evaluation of the alcohol use disorders identification test. Alcohol Alcohol. 2002;37(3):245–51. Epub 2002/05/11. PubMedView ArticlePubMedGoogle Scholar
- Sinadinovic K, Berman AH, Hasson D, Wennberg P. Internet-based assessment and self-monitoring of problematic alcohol and drug use. Addict Behav 2010;35(5):464-470. doi: 10.1016/j.addbeh.2009.12.021. PubMed.
- Berman AH, Forsberg L, Durbeej N, Kallmen H, Hermansson U. Single-session motivational interviewing for drug detoxification inpatients: effects on self-efficacy, stages of change and substance use. Substance Use Misuse 2010;45(3):384-402. Epub 2010/02/10. doi: 10.3109/10826080903452488. PubMed.
- Flannery BA, Volpicelli JR, Pettinati HM. Psychometric properties of the Penn Alcohol Craving Scale. Alcohol Clin Exp Res. 1999;23(8):1289–95. Epub 1999/09/02. PubMedView ArticlePubMedGoogle Scholar
- Svanborg P, Asberg M. A new self-rating scale for depression and anxiety states based on the Comprehensive Psychopathological Rating Scale. Acta Psychiatr Scand. 1994;89(1):21–8. Epub 1994/01/01. PubMedView ArticlePubMedGoogle Scholar
- Hollandare F, Andersson G, Engstrom I. A comparison of psychometric properties between internet and paper versions of two depression instruments (BDI-II and MADRS-S) administered to clinic patients. J Med Internet Res. 2010;12(5):e49. Epub 2010/12/21. doi: 10.2196/jmir.1392. PubMed PMID: 21169165; PubMed Central PMCID: PMCPmc3057311.
- van Ballegooijen W, Riper H, Cuijpers P, van Oppen P, Smit JH. Validation of online psychometric instruments for common mental health disorders: a systematic review. BMC psychiatry. 2016;16:45. Epub 2016/02/27. doi: 10.1186/s12888-016-0735-7. PubMed PMID: 26915661; PubMed Central PMCID: PMCPmc4766750.
- Noerholm V, Groenvold M, Watt T, Bjorner JB, Rasmussen NA, Bech P. Quality of life in the Danish general population--normative data and validity of WHOQOL-BREF using Rasch and item response theory models. Qual life Res. 2004;13(2):531–540. Epub 2004/04/17. doi:10.1023/B:QURE.0000018485.05372.d6. PubMed.View ArticlePubMedGoogle Scholar
- Skevington SM, Lotfy M, O'Connell KA. The World Health Organization's WHOQOL-BREF quality of life assessment: psychometric properties and results of the international field trial. A report from the WHOQOL group. Qual life Res 2004;13(2):299-310. Epub 2004/04/17. PubMed.Google Scholar
- Shawver Z, Griffith JD, Adams LT, Evans JV, Benchoff B, Sargent R. An examination of the WHOQOL-BREF using four popular data collection methods. Comput Hum Behav. 2016;55, Part A:446-454. doi: http://0-dx.doi.org.brum.beds.ac.uk/10.1016/j.chb.2015.09.030.
- Berman AH, Bergman H, Palmstierna T, Schlyter F. Evaluation of the Drug Use Disorders Identification Test (DUDIT) in Criminal Justice and Detoxification Settings and in a Swedish Population Sample. Eur Addict Res. 2005;11:22–31.View ArticlePubMedGoogle Scholar
- Voluse AC, Gioia CJ, Sobell LC, Dum M, Sobell MB, Simco ER. Psychometric properties of the Drug Use Disorders Identification Test (DUDIT) with substance abusers in outpatient and residential treatment. Addict Behav. 2012;37(1):36–41. doi:10.1016/j.addbeh.2011.07.030.View ArticlePubMedGoogle Scholar
- Sinadinovic K, Wennberg P, Berman AH. Population screening of risky alcohol and drug use via Internet and Interactive Voice Response (IVR): A feasibility and psychometric study in a random sample. Drug Alcohol Depend. 2011;114:55–60.View ArticlePubMedGoogle Scholar
- Rollnick S, Heather N, Gold R, Hall W. Development of a short 'readiness to change' questionnaire for use in brief, opportunistic interventions among excessive drinkers. Br J Addict 1992;87(5):743-754. Epub 1992/05/01. PubMed.Google Scholar
- Forsberg L, Halldin J, Wennberg P. Psychometric properties and factor structure of the readiness to change questionnaire. Alcohol Alcohol 2003;38(3):276-280. Epub 2003/04/25. PubMed.Google Scholar
- Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD. Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann 1979;2(3):197-207. Epub 1978/12/13. PubMed.Google Scholar
- Rozental A, Andersson G, Boettcher J, Ebert DD, Cuijpers P, Knaevelsrud C, et al. Consensus statement on defining and measuring negative effects of Internet interventions. Internet Interv. 2014;1(1):12–9.View ArticleGoogle Scholar
- Larimer ME, Palmer RS, Marlatt GA. Relapse prevention. An overview of Marlatt's cognitive-behavioral model. Alcohol Res Health 1999;23(2):151-160. Epub 2000/07/13. PubMed.Google Scholar
- El Alaoui S, Ljotsson B, Hedman E, Svanborg C, Kaldo V, Lindefors N. Predicting Outcome in Internet-Based Cognitive Behaviour Therapy for Major Depression: A Large Cohort Study of Adult Patients in Routine Psychiatric Care. PLoS One. 2016;11(9):e0161191. Epub 2016/09/13. doi: 10.1371/journal.pone.0161191. PubMed PMID: 27618548; PubMed Central PMCID: PMCPMC 5019371.
- Horton NJ, Kim E, Saitz R. A cautionary note regarding count models of alcohol consumption in randomized controlled trials. BMC Med Res Methodol. 2007;7:9. Epub 2007/02/17. doi: 10.1186/1471-2288-7-9. PubMed PMID: 17302984; PubMed Central PMCID: PMCPMC1810542.
- Smith D, Roche E, O’Loughlin K, Brennan D, Madigan K, Lyne J, et al. Satisfaction with services following voluntary and involuntary admission. J Ment Health. 2014;23(1):38–45. doi:10.3109/09638237.2013.841864.View ArticlePubMedGoogle Scholar
- Gajecki M, Berman AH, Sinadinovic K, Andersson C, Ljotsson B, Hedman E, et al. Effects of baseline problematic alcohol and drug use on internet-based cognitive behavioral therapy outcomes for depression, panic disorder and social anxiety disorder. PLoS One 2014;9(8):e104615. doi: 10.1371/journal.pone.0104615. PubMed PMID: 25122509; PubMed Central PMCID: PMC4133364.
- Hedman E, Ljotsson B, Kaldo V, Hesser H, El Alaoui S, Lindefors N. Effectiveness of Internet-based cognitive behaviour therapy for depression in routine psychiatric care. J Affect Disord. 2014;155:49–58.View ArticlePubMedGoogle Scholar
- El Alaoui S, Hedman E, Kaldo V, Hesser H, Kraepelien M, Andersson E, et al. Effectiveness of Internet-based cognitive–behavior therapy for social anxiety disorder in clinical psychiatry. J Consult Clin Psychol. 2015;83(5):902.View ArticlePubMedGoogle Scholar
- Pitel AL, Beaunieux H, Witkowski T, Vabret F, Guillery-Girard B, Quinette P, et al. Genuine episodic memory deficits and executive dysfunctions in alcoholic subjects early in abstinence. Alcohol Clin Exp Res. 2007;31(7):1169-1178. Epub 2007/05/22. doi: 10.1111/j.1530-0277.2007.00418.x. PubMed PMID: 17511749; PubMed Central PMCID: PMCPMC2895973.
- Maurage P, de Timary P, Billieux J, Collignon M, Heeren A. Attentional alterations in alcohol dependence are underpinned by specific executive control deficits. Alcohol Clin Exp Res 2014;38(7):2105-2112. Epub 2014/05/23. doi: 10.1111/acer.12444. PubMed.
- Moëll B, Kollberg L, Nasri B, Lindefors N, Kaldo V. Living SMART—A randomized controlled trial of a guided online course teaching adults with ADHD or sub-clinical ADHD to use smartphones to structure their everyday life. Internet Interv. 2015;2(1):24–31.View ArticleGoogle Scholar
- Eysenbach G. The law of attrition. J Med Internet Res. 2005;(7, 1):e11. Epub 2005/04/15. doi:10.2196/jmir.7.1.e11. PubMed PMID: 15829473; PubMed Central PMCID: PMCPmc1550631
- Moyer A, Finney JW. Outcomes for untreated individuals involved in randomized trials of alcohol treatment. J Subst Abus Treat 2002;23(3):247-252. Epub 2002/10/24. PubMed.Google Scholar
- Andreasson S, Danielsson AK, Wallhed-Finn S. Preferences regarding treatment for alcohol problems. Alcohol Alcohol 2013;48(6):694-699. Epub 2013/07/12. doi: 10.1093/alcalc/agt067. PubMed.
- Gustafson DH, McTavish FM, Chih MY, Atwood AK, Johnson RA, Boyle MG, et al. A smartphone application to support recovery from alcoholism: a randomized clinical trial. JAMA Psychiat. 2014;71(5):566-572. Epub 2014/03/29. doi: 10.1001/jamapsychiatry.2013.4642. PubMed PMID: 24671165; PubMed Central PMCID: PMCPMC4016167.