This article has Open Peer Review reports available.
Evaluating real-time internet therapy and online self-help for problematic alcohol consumers: a three-arm RCT protocol
© Blankers et al; licensee BioMed Central Ltd. 2009
Received: 14 October 2008
Accepted: 14 January 2009
Published: 14 January 2009
Only a minority of all alcohol- and drug abusers is receiving professional care. In an attempt to narrow this treatment gap, treatment facilities experiment with online healthcare. Therefore, it is important to test the (cost-)effectiveness of online health interventions in a randomized clinical trial.
This paper presents the protocol of a three-arm randomized clinical trial to test the (cost-) effectiveness of online treatment for problem drinkers. Self-help online, therapy online and a waiting list are tested against each other. Primary outcome is change in alcohol consumption. Secondary outcome measures include quality of life and working ability. Incremental cost-effectiveness ratios for self-help online alcohol and therapy online alcohol will be calculated. The predictive validity of participant characteristics on treatment adherence and outcome will be explored.
To our best knowledge, this randomized clinical trial will be the first to test the effectiveness of therapy online against both self-help online and a waiting-list. It will provide evidence on (cost-) effectiveness of online treatment for problem drinkers and investigate outcome predictors.
This trial is registered in the Dutch Trialregister (Cochrane Collaboration) and traceable as NTR-TC1155.
The Netherlands have, compared to most other countries, a fairly accessible network of substance abuse treatment centres (SATCs). However, the target population of these SATCs is not sufficiently addressed: Only a minority of all current alcohol- and drug abusers is receiving professional care . This so-called treatment gap is mainly due to two reasons. As substance dependence is strongly stigmatized, the threshold to visit a treatment centre is high . And as most SATCs offer outpatient facilities during working hours only, many people with jobs cannot find to attend SATCs face-to-face therapy.
Another challenge to healthcare in general and addiction treatment in particular is optimising cost-effectiveness. As the future health spending is expected to increase at a much higher rate than in the past [3, 4], cost-effectiveness is an important parameter in the development of new treatment programs. In general, early interventions, preventive care, and disease self-management, together with the correct implementation of health information technology and internet applications, is believed to have the potential to enhance health status while improving efficiency and reducing healthcare costs .
Substance abuse treatment over the internet has the potential to address these issues: The influence of both stigmatization and restricted opening times of healthcare institutions is reduced when clients do not have to visit a SATC during working hours, but can visit their web-based treatment environment from any place and at any time. Earlier evaluations have shown that a majority of online substance abuse treatment participants manage to hold their jobs [5, 6]. Therefore, improvement in job performance may be expected as a result of successful participation, as problematic drinking habits tend to interfere with working ability in general.
The increasing number of online treatment options worldwide shows that treatment facilities are willing to experiment with online healthcare. A review of the current state of the art in substance abuse treatment over the internet is promising . Some authors report online substance abuse treatment to be successful in addressing an underserved population [5, 6]. Results of the first randomized clinical trials support the use of the internet to extend the treatment options for substance abusers [8–10]. There is preliminary evidence on the cost-effectiveness of early interventions and computer-aided therapy for alcohol related problems [11, 12]. However, as the number of randomized clinical trials for online substance abuse treatment is still sparse, its (cost-)effectiveness is yet to be supported more firmly. This article presents a randomized clinical trial that will extend the knowledge on effectiveness and cost-effectiveness of online treatment for problem drinkers.
The SATC whose interventions are subjected to this trial has pioneered in the development of internet applications for problematic alcohol and substance users. Since 2003, its online treatment programs have been based on two evidence-based techniques: cognitive-behavioural therapy (CBT) and motivational enhancement training. These early experiences have led to the development of online interventions for alcohol-, cannabis-, cocaine- and tobacco-users, and for pathological gamblers. Two online treatment programs for problem drinkers will be compared in this trial. One is an anonymous, online, non-counsellor involved, fully automated self-guided treatment program, referred to as Self-help Online Alcohol (SOA). The other is a real time, online, non anonymous, counsellor-guided therapy program for problem drinkers referred to as Therapy Online Alcohol (TOA).
SOA introduces participants to various CBT elements as a means to monitor and help them change their alcohol consumption. Registration of alcohol consumption, online diary, goal setting, and relapse prevention are among them. A recent study has shown that SOA is highly attractive and promising in its effects . However, participants of SOA did report they missed the opportunity to interact with a counsellor on a regular basis. In response to the participants' suggestions, the online therapy program (TOA) has been developed. Like SOA, TOA is based on CBT and motivational enhancement training, but has a more intensive and stricter structured treatment course and regular counsellor interaction. Contact between client and counsellor takes place online in a one-on-one, private chat-room. TOA resembles to a great extent the conventional face-to-face manual based CBT training program , used in many SATCs in the Netherlands. Treatment elements of TOA include consumption registration, online diary, tailored feedback of recent alcohol consumption, contemplating advantages and disadvantages of drinking, goal setting, self-control methods, investigating risk-situations, coping with craving, emotions and social pressure, and the formulation of emergency plans in case of relapse. These elements are introduced by the counsellor. Working with the treatment elements is part of clients' weekly homework assignments.
The most important difference between SOA and TOA are seven real-time, one-on-one chat sessions with an experienced counsellor trained in TOA. Each chat session lasts for approximately 40 minutes. During these sessions, feedback on homework assignments is provided and the client is motivated to enhance his or her attempt to stop or reduce drinking. Because of it's interactive nature, chat-sessions resemble to a big extent the conversational dynamics of regular, face-to-face therapy contacts. This new element meets the expressed needs of participants of SOA and makes the intervention more similar to the successful face-to-face CBT treatment.
Aims of the trial
This study aims to test the effectiveness and cost-effectiveness of SOA and TOA against a waiting list control group, in a three-arm randomized clinical trial. Primary outcome measure is the change in alcohol consumption from baseline (t0) to the three month follow-up (t1) and to the six month follow-up (t2). Secondary outcome measures are changes in AUDIT scores, quality of life and quality of functioning at work. Incremental cost-effectiveness ratios for SOA and TOA will be calculated. The predictive validity of participant characteristics on treatment adherence and outcome will be explored.
Selection criteria for inclusion
age 18 – 64
prior therapy in addiction treatment centre
internet at home
history of alcohol delirium
AUDIT score > 8
history of drug overdose
alcohol consumption > 14 standard units per week
severe coronary problems
informed consent received
severe intestine diseases
history of stroke
epilepsy in last year
contemplated or attempted suicide in last year
cocaine and or amphetamine use > 4 days last month
cannabis use > 9 days last month
holiday/travelling intention > 2 weeks during trial
Q1a. Do TOA participants reduce their alcohol consumption from t0 to t1 and t2 to a larger extent than SOA and waiting list control participants?
Q1b. Do TOA participants improve to a larger extent on secondary outcome measurement scores from t0 to t1 and t2 than SOA and waiting list control participants?
Q1c. Are TOA participants more often treatment-responders than SOA and waiting list control participants at t1 and t2?
Q1d. Do SOA participants reduce their alcohol consumption to a larger extent from t0 to t1 and t2 than waiting list control participants?
Q1e. Do SOA participants improve on secondary outcome measurement scores from t0 to t1 and t2 to a larger extent than waiting list control participants?
Q1f. Are SOA participants more often treatment-responders than waiting list control participants at t1 and t2?
Q2. What are the comparative costs per quality adjusted life year (QALY) for SOA and TOA?
Q3a. How do participants' demographic characteristics relate to demographics of participants in conventional face-to-face CBT programs?
Q3b. Do scores of working alliance between TOA participants and counsellor predict treatment-response at t1 and t2?
We hypothesize TOA participants will have reduced their alcohol consumption significantly more at the three month follow-up (t1) compared to SOA and waiting list control participants (Q1a). Between t0 and t1, we also expect TOA participants to improve on secondary outcome measurements (quality of life and working abilities) significantly more than SOA and waiting list control participants (Q1b). We hypothesize that a larger percentage of TOA participants will meet the criteria for treatment-responders compared to SOA and waiting list control participants (Q1c). We hypothesize that SOA participants will have reduced their t0 alcohol consumption significantly more at t1 than waiting list control participants (Q1d). Between t0 and t1, we also expect SOA participants to improve on secondary outcome measurements significantly more than waiting list control participants (Q1e). Finally, we hypothesize that a larger percentage of SOA participants will meet the criteria for treatment-responders compared to waiting list control participants (Q1f).
Between t1 and t2, we expect TOA participants to be better able than SOA participants to maintain their achieved changes in alcohol consumption, resulting in a significant time (t1–t2) by group (SOA-TOA) interaction. Alcohol consumption in SOA will be significantly higher at t2 compared to t1, whereas alcohol consumption in TOA will not change significantly during this period.
For question 2, we hypothesize that from t0 to t1 both the costs and the gains in QALY for SOA to be lower than the costs and the gains in QALY for TOA. As this means that both the numerator and the denominator of the cost-effectiveness equation is larger for TOA compared to SOA, we have no preconceptions of whether the incremental cost-effectiveness calculation will favour either SOA or TOA (Q2).
For question 3, we hypothesize our participants to be higher educated, a larger percentage to be working and female, compared to conventional outpatient SATC clients (Q3a). We also hypothesize that higher scores on working alliance will predict a larger proportion of treatment-response at t1 for TOA participants (Q3b).
Dutch mental health thermometer
Quality of life will be measured using two instruments: The EQ-5D [19–21] and the QOL . The EQ-5D is a highly accepted, widely used and easy to administer instrument for measuring quality of life for alcohol and drug dependents [23, 24]. As the scoring algorithm of the EQ-5D generates an index weighted by a preference measure, EQ-5D scores can be used in cost-effectiveness analysis to estimate QALYs . However, it is recommended that the EQ-5D is used in combination with other quality of life instruments. This should be done to minimize its potential limitation in sensitivity until further results confirm EQ-5D validity in alcohol dependent individuals . Therefore, the 'Quality Of Life' scale QOL  is included. According to content validity analysis, this is a valid instrument for measuring quality of life across patient groups and cultures. It is conceptually distinct from health status or other causal indicators of quality of life .
As an earlier evaluation study of SOA has shown that a majority of its participants manage to hold jobs [5, 6], their problematic drinking habit could negatively influence their working ability. To be able to measure this effect, we included two working ability measurement scales. The SF-HLQ, a subscale of the Trimbos/iMTA questionnaire for Costs associated with Psychiatric Illness (TiC-P) , is well able to measure the work related productivity of applicants who held a job in the past two weeks. A more general measure of working ability, which is also eks held a job. A more general applicable for the applicants who are not currently employed, is provided by the 'Working Ability Index' (WAI-work) . This questionnaire measures self-reported ability to work, as opposed to the SF-HLQ which measures the actual working behaviour.
Key demographical characteristics will be measured using subscales of the EuropASI . Baseline psychopathology will be measured using the Brief Symptom Inventory (BSI) [30, 31]. To be able to evaluate the reliability of the self-reported questionnaire data, a 13-item version of the Marlowe Crowne Social Desirability Scale (MCSDS)  is included.
Primary and secondary outcome measures
Primary outcome measures are the differences in alcohol consumption, and the number of participants showing 'treatment response', as defined below. Although de facto a composite score of primary and secondary outcomes, 'treatment response' is considered primary outcome as well. Secondary outcome measurements are AUDIT-score; quality of life as measured by QOL, and EQ-5D, psychopathological symptoms as measured by BSI and ability to work as measured by SF-HLQ and WAI-work.
Definition of treatment-response
Adding treatment-response criteria has an important advantage over the comparison of group mean-scores on primary and secondary outcome measures only. In our opinion, it has more external validity as it is helpful in making a clear statement on who actually improved to a clinical relevant extent. Based on binary treatment-response outcome data, we can calculate relative risk reduction, number needed to treat, and odds ratios. The British Medical Association published guidelines on sensible drinking which suggested that the boundaries for sensible alcohol consumption should be set at a maximum of 21 standard alcohol units per week for men, and 14 standard alcohol units per week for women . To calculate treatment-response outcome, alcohol consumption as measured using Timeline-Follow-Back will be used . Deteriation percentages relate to changes within participants on the secondary outcome measurement scores between t0 and t1. Treatment-response is defined as: 'alcohol consumption within British Medical Association boundaries, and less than 10% deteriation on any of the secondary outcome measures'.
F tests – ANOVA: Fixed effects, omnibus, one-way
A priori: Compute required sample size
Effect size f
α error probability
Power (1-β error probability)
Number of groups
Non-centrality parameter λ
Total sample size
After the t0 measurement is completed, participants are allocated to one of the three trial arms. Because this randomized clinical trial is internet-based, we will organize the allocation procedures online as well. As the number of participants we aim to include in each trial arm (n = 50) is not very large, random variation in baseline characteristics could reduce group equivalence. Online, server-based performance of randomization procedures comes with the advantage of being able to implement stratified allocation or allocation through adaptive randomization relatively easy.
To prevent between-group variability on relevant baseline characteristics, we use an adaptive or biased-coin randomization algorithm for this trial. Adaptive randomization aims to ensure trial arms are balanced with respect to a priori defined participant factors as well as for the number of participants in each group. Simulation studies show that adaptive randomization provides better balanced trial arms when compared with 'normal' randomization  and that it is more efficient in balancing multiple poli-level factors than permutated block stratification . Although not widely used due to organizational complexity, adaptive randomization is a highly effective allocation method, and its wider adaptation in the conduct of randomized clinical trials is recommended . The use of adaptive randomization is supported in the CONSORT statement . We will implement the Pocock & Simon Range Method of adaptive randomization , with D = 'range', G is the sum of D (no factor weighting), and P = 0.60.
For the purpose of this trial we will develop a website to inform potential applicants about the contents of the online treatment, and the procedures associated with this trial. Upon visiting the website, new participants can read all relevant information and ask additional questions through a mail form. For included participants, a secured login system to enter the online interventions is developed and available on the website. Visitors willing to participate fill out a web-based questionnaire to check if they meet the inclusion criteria. If they do not, they are informed so, and an email is sent to this applicant. This email contains additional information about alternative treatment options. Applicants meeting inclusion criteria proceed to the subscription screen. Next, they are once again informed on the conditions of participation in this trial. After reading all information, they decide whether they are willing to participate. If they would like to participate, they are asked for necessary personal information. A confirmation email is sent to them, with the informed consent as an attachment. This confirmation email also contains their personal username and password. With this unique username/password combination, applicants can log in to their private area. Upon logging in for the first time, applicants are shown a screen which requests them to confirm they read, understood and agreed with the informed consent sent to them. Applicants can decide to agree with this informed consent at any time, and can deliberate on whether or not they consent with the participant information for as long as they want. Only after their confirmation they are introduced to the baseline measurement procedure. After completion of the baseline measurement the randomization procedure takes place. Depending on the outcome, participants are allocated to one of three trial arms.
Maximize response rates
Drop-out is a potential threat in every clinical trial. Since attrition rates for online trials tend to be larger than in regular ones , we will make extra efforts to maximize response rates. Following suggestions for successful strategies to maximize response rates [41, 42], we made follow-up questionnaires as short as possible and give participants feedback on the actual length and their proceedings while filling out the questionnaire. We motivate participants to fill out the questionnaires by sending them a reminder if they do not respond within five days after the first emailed invitation. To optimize a feeling of worthiness and to reward participants for their efforts and time, participants will receive gift coupons (€15,-) after filling out a follow-up questionnaire. Participants will be aware of this incentive upon reading the informed consent form. However, participants who do not fill out the questionnaires after a reminder is sent will be contacted by a call centre. Since 2005, this call centre has been collecting regular outcome data of outpatient addiction treatment for SATCs nationwide in the Netherlands. It is experienced in maximizing response rates in hard to reach populations . For this research project, they will collect outcome data by phone from trial participants who do not respond to emailed invitations. All participants are aware of these procedures, provide phone numbers, and consent with receiving phone-calls for follow-up measurements.
Multiple imputation missing data handling procedures will be implemented using MICE  a package for the R Statistical Software Environment. As the quantity of consumed alcoholic drinks is the primary outcome variable in this trial, analysis techniques are chosen that suit the expected data distribution. Baseline measurements of the three trial arms will be compared using t-tests and χ2-tests. Trial arm differences on primary and secondary outcome variables at three months are tested using repeated measures ANOVA. Trial arm differences for SOA and TOA between t1 and t2 are tested with a 2 (group) × 2 (time) repeated measures ANCOVA with between and within contrasts. Effect-sizes will be calculated using Cohen's d . Trial arm differences on treatment-response will be tested using multiple logistic regression analysis. Costs from TOA and SOA will be derived from cost records of the collaborating SATC. Costs will be assessed in correspondence to the recommendations by the U.S. Panel on Cost-effectiveness in Health and Medicine , following a macro-costing approach. QALYs will be calculated from the EQ-5D questionnaire, using algorithm by Dolan , retrieved from the Open Health Measures website . Based on these estimations, costs-per-QALY and an incremental cost-effectiveness ratio can be calculated. The U.S. Panel on Cost-effectiveness has recommended that cost-effectiveness studies should conduct sensitivity analysis, which for this cost-effectiveness analysis will be implemented through the bootstrap method [49–51].
This trial will be executed in compliance to the Helsinki Declaration and is approved by the Medical Ethical Commission of the Academic Medical Center in Amsterdam, the Netherlands.
To our best knowledge, this randomized clinical trial is the first to test the effectiveness of online therapy (TOA) against both a derived self-help program (SOA) and a waiting-list control group. Both SOA and TOA are based on an evidence-based CBT face-to-face treatment programme , implemented by several SATCs in the Netherlands. The counsellors involved in TOA are all working for a well respected, research minded SATC with many years of experience in the counselling of problem drinkers. The AIAR (Amsterdam Institute for Addiction Research) group has over 15 years of experience in both clinical and experimental addiction research. This solid foundation makes a sound opportunity to design and execute a randomized clinical trial to test effectiveness, while on the other hand extending knowledge on how internet technology can be used in healthcare research.
A potential threat for this trial is the so-called 'law of attrition', defined by Eysenbach: 'the phenomenon of participants stopping usage and/or being lost to follow-up, as one of the fundamental characteristics and methodological challenges in the evaluation of eHealth applications' . We intent to implement four measures to reduce the impact of this attrition law. First, data-collection over the telephone, performed by an experienced call centre as a backup method for the follow-up measurements gives us a greater possibility to actively pursuit higher response rates. Second, all participants in this trial have to make a major time investment before being randomized and included in this trial – by filling out a 45 minutes baseline measurement. As an extra incentive for participation to the follow-up measurements, all participants receive gift coupons for their filled-out questionnaires. As a last resolve, all missing data values in the final data set will be multiple imputed according to methodology suggested by Schafer and Graham (2002) .
A second potential risk in this trial would concern the inclusion of participants. The inclusion of enough participants is not our main sorrow. As SOA in the regular context and without promotional efforts is able to attract over 150 new participants each month , we think we will manage to include 150 participants in a one year inclusion period. However, the resemblance of the regular online clientele is our main focus of attention. Due to the high accessibility of online help in the normal context and the relatively high constraints posed on participants in this trial, there is a potential risk that the trial participants do not resemble the regular e-clientele exactly. Whether this actually occurs or not can only be answered afterwards, by comparing data on characteristics of trial participants and regular online clientele data.
A third possible limitation concerns integrity of our collected data. As our t0 and t1/t2 data is self reported without a researcher nearby to oversee data-collection, we rely heavily on the correctness of our participants' answers. Various authors evaluate the self-reported data in alcohol research as reliable [53–55]. Tourangeau and colleagues even concluded that self-reported data is more reliable in the absence of a research confederate . However, as an extra means to check data integrity, we included a social desirability scale, to measure whether these tendencies occur in our research population.
Another point of concern on data integrity in this trial could be made about our suggested statistical procedures. Multivariate statistics relies considerably on data distribution normality . As the distribution of alcohol consumption count data is usually zero-elevated and highly skewed, particularly in subjects with alcohol dependence , multivariate statistics and most statistical tests should be used with caution. To prevent possible in- or deflated α's, we will use bootstrap methods and permutation tests as suggested by Hesterberg and colleagues , to minimize the influence of data distributions on our testing results, if data turn out to be non-normally distributed.
During the planning stage of this trial we have thought of implementing a conventional face-to-face treatment comparison condition as well. However, it is disputable whether in clinical practice, the face-to-face treatment and the online treatment populations are comparable. In previous pilot studies, we found that less than 10% of the internet treatment population was willing to receive conventional treatment . On the other hand, all face-to-face participants who consider themselves as computer-illiterate, or do not have a computer with internet connection at home, would be unsuitable for online treatment. These considerations illustrate not only the methodological difficulties of a hybrid online – face-to-face trial, but also the restricted external validity of it's results. This was for us the main reason not to chose for a conventional – internet therapy comparison.
This trial is registered in the Dutch Trialregister (Cochrane Collaboration) and traceable as NTR-TC1155.
This randomized clinical trial is funded by a grant from the ZonMW Addiction II Program (Risk behaviour and dependency). The SATC referred to in this text as 'collaborating' is Jellinek, a division of Arkin, the Amsterdam based mental health and addiction treatment centre. Jellinek/Arkin supports and facilitates the development of this trial. SOA and TOA have been developed by Jellinek Prevention, a subdivision of this SATC. None of the funders has had any role in the trial design, selection of measurement instruments or the preparation of this article. The authors would like to thank the mentioned call centre for their intentions to assist in data-collection.
- Bijl RV, van Zessen G, Ravelli A: Psychiatrische morbiditeit onder volwassenen in Nederland: het NEMESIS-onderzoek II. Prevalentie van psychiatrische stoornissen. Ned Tijdschr Geneeskd. 1997, 141: 2453-2460.PubMedGoogle Scholar
- Room R: Stigma, social inequality and alcohol and drug use. Drug Alcohol Rev. 2005, 24: 143-155. 10.1080/09595230500102434.View ArticlePubMedGoogle Scholar
- PriceWaterhouseCoopers' Health Research Institute: HealthCast 2020: creating a sustainable future. 2007, PriceWaterhouseCoopersGoogle Scholar
- Ministerie van Volksgezondheid, Welzijn en Sport: Kiezen voor gezond leven 2007–2010. 2006, Den Haag: VWSGoogle Scholar
- Postel M, de Jong C, de Haan H: Does e-therapy for problem drinking reach hidden populations?. Am J Psychiatry. 2005, 162: 2393-10.1176/appi.ajp.162.12.2393.View ArticlePubMedGoogle Scholar
- Blankers M, Kerssemakers R, Schramade M, Schippers GM: Eerste ervaringen met internet-zelfhulp voor probleemdrinkers. Maandblad Geestelijke volksgezondheid. 2007, 62: 1032-1043.Google Scholar
- Copeland J, Martin G: Web-based interventions for substance use disorders: a qualitative review. Journal of Subst Abuse Treat. 2004, 26: 109-116. 10.1016/S0740-5472(03)00165-X.View ArticleGoogle Scholar
- Hester RK, Delaney HD: Behavioral self-control program for Windows: results of a controlled clinical trial. J Consult Clin Psychol. 1997, 65 (4): 686-693. 10.1037/0022-006X.65.4.686.View ArticlePubMedGoogle Scholar
- Kypri K, Saunders JB, Williams SM, McGee RO, Langley JD, Cashell-Smith ML, Gallagher SJ: Web-based screening and brief intervention for hazardous drinking: a double-blind randomized controlled trial. Addiction. 2004, 99: 1410-1417. 10.1111/j.1360-0443.2004.00847.x.View ArticlePubMedGoogle Scholar
- Riper H, Kramer J, Smit F, Conijn B, Schippers GM, Cuijpers P: Web-based self-help for problem drinkers: a pragmatic randomized trial. Addiction. 2008, 103: 218-227. 10.1111/j.1360-0443.2007.02063.x.View ArticlePubMedGoogle Scholar
- Babor TF, Higgins-Biddle JC, Dauser D, Burleson JA, Zarkin GA, Bray J: Brief interventions for at-risk drinking: patient outcomes and cost-effectiveness in managed care organizations. Alcohol Alcohol. 2006, 41: 624-631.View ArticlePubMedGoogle Scholar
- McCollister KE, French MT: The relative contribution of outcome domains in the total economic benefit of addiction interventions: a review of first findings. Addiction. 2003, 98: 1647-1659. 10.1111/j.1360-0443.2003.00541.x.View ArticlePubMedGoogle Scholar
- de Wildt W, Schippers GM: Protocollaire behandeling van patiënten met alcoholproblemen. Motivering, zelfcontroletraining en terugvalpreventie. Protocollaire behandelingen in de ambulante geestelijke gezondheidszorg, II. Edited by: Keijsers G, van Minnen A, Hoogduin CAL. 2004, Houten/Diegem: Bohn Stafleu Van Loghum, 281-319. 2Google Scholar
- JellinekMentrum: Jaarverslag 2007. 2008, Amsterdam: JellinekMentrum, 8-Google Scholar
- Kokkevi A, Hartgers C: EuropASI: european adaptation of a multidimensional assessment instrument for drug and alcohol dependence. Eur Addict Res. 1995, 1: 208-210.View ArticleGoogle Scholar
- Sobell LC, Sobell MB: Timeline Follow-back: A technique for assessing self-reported ethanol consumption. Measuring alcohol consumption: psychosocial and biological methods. Edited by: Allen J, Litten RZ. 1992, Totowa, NJ: Humana Press, 41-72.View ArticleGoogle Scholar
- Carney MA, Tennen H, Affleck G, Del Boca FK, Kranzler HR: Levels and patterns of alcohol consumption using timeline follow-back, daily diaries, and real-time "electronic interviews". J Stud Alcohol. 1998, 59: 447-454.View ArticlePubMedGoogle Scholar
- Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M: Development of the alcohol use disorders identification test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption. Addiction. 1993, 88: 791-804. 10.1111/j.1360-0443.1993.tb02093.x.View ArticlePubMedGoogle Scholar
- EuroQol Group: EuroQol: a new facility for the measurement of health-related quality of life. Health Policy. 1990, 16: 199-208. 10.1016/0168-8510(90)90421-9.View ArticleGoogle Scholar
- Rabin R, de Charro F: EQ-5D: a measure of health status from the EuroQol Group. Ann Med. 2001, 33: 337-343. 10.3109/07853890109002087.View ArticlePubMedGoogle Scholar
- Lamers LM, Stalmeier PF, McDonnell J: Measuring the quality of life in economic evaluations: the Dutch EQ-5D tariff. Ned Tijdschr Geneeskd. 2005, 149: 1574-1578.PubMedGoogle Scholar
- Flanagan JC: A research approach to improving our quality of life. Am Psychol. 1978, 33: 138-147. 10.1037/0003-066X.33.2.138.View ArticleGoogle Scholar
- UKATT Research Team: Cost-effectiveness of treatment for alcohol problems: findings of the randomised UK alcohol treatment trial (UKATT). BMJ. 2005, 331: 544-547. 10.1136/bmj.331.7516.544.View ArticleGoogle Scholar
- Zanden van der BP, Dijkgraaf MGW, Blanken P, de Borgie CA, van Ree JM, Brink van den W: Validity of the EQ-5D as a generic health outcome instrument in a heroin-dependent population. Drug Alcohol Depend. 2006, 82 (2): 111-8. 10.1016/j.drugalcdep.2005.08.012.View ArticlePubMedGoogle Scholar
- Petitti DB: Meta-analysis, decision analysis, and cost-effectiveness analysis. 2000, New York: Oxford University PressGoogle Scholar
- Günther OH, Roick C, Angermeyer MC, König HH: Responsiveness of EQ-5D utility indices in alcohol-dependent patients. Drug Alcohol Depend. 2008, 92: 291-295. 10.1016/j.drugalcdep.2007.07.016.View ArticlePubMedGoogle Scholar
- Burckhardt CS, Anderson KL: The quality of life scale (QOLS): reliability, validity, and utilization. Health Qual Life Outcomes. 2003, 1: 60-10.1186/1477-7525-1-60.View ArticlePubMedPubMed CentralGoogle Scholar
- Hakkaart-van Roijen L, van Straten A, Donker M, Tiemens B: Manual Trimbos/iMTA questionnaire for costs associated with psychiatric illness (TiC-P). 2002, Rotterdam: Institute for Medical Technology Assessment; nual rdam, ted with Pn L.d UKGoogle Scholar
- Tuomi K, Ilmarinen J, Jahkola A, Katajarinne L, Tulkki A: Work Ability Index. 1998, Helsinki: Finnish Institute of Occupational Health, 2Google Scholar
- de Beurs E, Zitman FG: The brief symptom inventory (BSI): the reliability and validity of a brief alternative of the SCL-90. Maandblad Geestelijke Volksgezondheid. 2006, 61: 120-141.Google Scholar
- Derogatis LR, Melisaratos N: The brief symptom inventory: an introductory report. Physol Med. 1983, 13 (3): 595-605.Google Scholar
- Crowne D, Marlowe D: A new scale of social desirability independent of psychopathology. J Consult Clin Psychol. 1960, 24: 349-354.View ArticleGoogle Scholar
- British Medical Association: Guidelines on Sensible Drinking. 1995, London: British Medical AssociationGoogle Scholar
- Erdfelder E, Faul F, Buchner A: GPOWER: a general power analysis program. Behav Res Methods. 1996, 28: 1-11.View ArticleGoogle Scholar
- Rovers MM, Straatman H, Zielhuis GA, Ingels K, Wilt van der GJ: Using a balancing procedure in multicenter clinical trials: simulation of patient allocation based on a trial of ventilation tubes for otitis media with effusion in infants. Int J Technol Assess Health Care. 2000, 16: 276-280. 10.1017/S0266462300161239.View ArticlePubMedGoogle Scholar
- Pocock SJ: Allocation of patients to treatment in clinical trials. Biometrics. 1979, 35: 183-197. 10.2307/2529944.View ArticlePubMedGoogle Scholar
- Scott NW, McPherson GC, Ramsay CR, Campbell MK: The method of minimization for allocation to clinical trials: a review. Control Clin Trials. 2002, 23: 662-674. 10.1016/S0197-2456(02)00242-8.View ArticlePubMedGoogle Scholar
- Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gøtzsche PC, Lang T: The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001, 134: 663-694.View ArticlePubMedGoogle Scholar
- Pocock SJ, Simon R: Sequential treatment assignment with balancing for prognostic factors in the controlled clinical trial. Biometrics. 1975, 31: 103-115. 10.2307/2529712.View ArticlePubMedGoogle Scholar
- Alderson P, Green S: Cochrane Collaboration open learning material for reviewers. 2002, Oxford: The Cochrane Collaboration, 4.1.5:Google Scholar
- Andrews D, Nonnecke B, Preece J: Electronic survey methodology: a case study in reaching hard-to-involve internet users. Int J Hum Comput Interact. 2003, 16: 185-210. 10.1207/S15327590IJHC1602_04.View ArticleGoogle Scholar
- Kaplowitz MD, Hadlock TD, Levine R: A comparison of web and mail survey response rates. Public Opin Q. 2004, 68: 94-101. 10.1093/poq/nfh006.View ArticleGoogle Scholar
- Oudejans S, Schippers GM, Spits M: Benchmark Leefstijltraining in de Verslavingszorg. 2006, Amsterdam: AIARGoogle Scholar
- Schafer JL, Graham JW: Missing data: our view of the state of the art. Psychol Methods. 2002, 7: 147-177. 10.1037/1082-989X.7.2.147.View ArticlePubMedGoogle Scholar
- van Buuren S, Oudshoorn CGM: Flexible multivariate imputation by MICE. 1999, Leiden: TNO Preventie en GezondheidGoogle Scholar
- Cohen J: Statistical power analysis for the behavioral sciences. 1988, Hillsdale, NJ: L. Erlbaum Associates, 2Google Scholar
- Dolan P: Modeling valuations for the EuroQol health states. Med Care. 1997, 35: 1095-1108. 10.1097/00005650-199711000-00002.View ArticlePubMedGoogle Scholar
- Open Health Measures. [http://www.openhealthmeasures.org]
- Whang W, Sisk JE, Heitjan DF, Moskowitz AJ: Probabilistic sensitivity analysis in cost-effectiveness. an application from a study of vaccination against pneumococcal bacteremia in the elderly. Int J Technol Assess Health Care. 1999, 15: 563-72.PubMedGoogle Scholar
- Briggs AH, Wonderling DE, Mooney CZ: Pulling cost-effectiveness analysis up by its bootstraps: a non-parametric approach to confidence interval estimation. Health Econ. 1997, 6: 327-340. 10.1002/(SICI)1099-1050(199707)6:4<327::AID-HEC282>3.0.CO;2-W.View ArticlePubMedGoogle Scholar
- Barber JA, Thompson SG: Analysis of cost data in randomized trials: an application of the non-parametric bootstrap. Stat Med. 2000, 19: 3219-3236. 10.1002/1097-0258(20001215)19:23<3219::AID-SIM623>3.0.CO;2-P.View ArticlePubMedGoogle Scholar
- Eysenbach G: The law of attrition. J Med Internet Res. 2005, 7: e11-10.2196/jmir.7.1.e11.View ArticlePubMedPubMed CentralGoogle Scholar
- Langenbucher J, Merrill J: The validity of self-reported cost events by substance abusers: limits, liabilities and future directions. Eval Rev. 2001, 25: 184-210.View ArticlePubMedGoogle Scholar
- Del Boca FK, Darkes J: The validity of self-reports of alcohol consumption: state of the science and challenges for research. Addiction. 2003, 98: 1-12. 10.1046/j.1359-6357.2003.00586.x.View ArticlePubMedGoogle Scholar
- Sobell LC, Maisto SA, Sobell MB, Cooper AM: Reliability of alcohol abusers' self-reports of drinking behavior. Behav Res Ther. 1979, 17: 157-160. 10.1016/0005-7967(79)90025-1.View ArticlePubMedGoogle Scholar
- Tourangeau R, Steiger DM, Wilson D: Self-administered questions by telephone: evaluating interactive voice responses. Public Opin Q. 2002, 66: 265-278. 10.1086/340029.View ArticleGoogle Scholar
- Tabachnick B, Fidell L: Using Multivariate Statistics. 2007, Boston: Allen and Bacon, 5Google Scholar
- Horton NJ, Kim E, Saitz R: A cautionary note regarding count models of alcohol consumption in randomized controlled trials. BMC Med Res Methodol. 2007, 7: 9-10.1186/1471-2288-7-9.View ArticlePubMedPubMed CentralGoogle Scholar
- Hesterberg T, Moore DS, Monaghan S, Clipson A, Epstein R: Bootstrap Methods and Permutation Tests. Introduction to the Practice of Statistics. Edited by: Moore DS, McCabe GP. 2005, New York: WH Freeman & Company, 14: 1-70. 5Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/9/16/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.