Cost-effectiveness of internet-based cognitive behavior therapy for irritable bowel syndrome: results from a randomized controlled trial
© Andersson et al; licensee BioMed Central Ltd. 2011
Received: 8 November 2010
Accepted: 7 April 2011
Published: 7 April 2011
Irritable Bowel Syndrome (IBS) is highly prevalent and is associated with a substantial economic burden. Cognitive behavior therapy (CBT) has been shown to be effective in treating IBS. The aim of this study was to evaluate the cost-effectiveness of a new treatment alternative, internet-delivered CBT based on exposure and mindfulness exercises.
Participants (N = 85) with IBS were recruited through self-referral and were assessed via a telephone interview and self-report measures on the internet. Participants were randomized to internet-delivered CBT or to a discussion forum. Economic data was assessed at pre-, post- and at 3-month and 1 year follow-up.
Significant cost reductions were found for the treatment group at $16,806 per successfully treated case. The cost reductions were mainly driven by reduced work loss in the treatment group. Results were sustained at 3-month and 1 year follow-up.
Internet-delivered CBT appears to generate health gains in IBS treatment and is associated with cost-savings from a societal perspective.
KeywordsCognitive behavior therapy internet IBS cost-effectiveness analysis
Irritable bowel syndrome (IBS) is a highly prevalent gastrointestinal disorder  that is associated with production losses [2, 3] and increased levels of health service utilization [3, 4]. The high prevalence rate combined with the costs associated for each afflicted individual makes IBS a considerable economic burden for society. Research indicates that psychological interventions - such as cognitive behavior therapy (CBT), hypnotherapy and psychodynamic therapy - can be effective in reducing IBS symptoms . In addition, there is some evidence indicating that psychological treatments are cost-effective. In a study by Creed et al. , 171 patients with IBS were randomized to receive either 8 sessions of individual psychodynamic therapy, paroxetine, or care as usual. At one-year follow-up, the psychotherapy condition was associated with significant reductions in health care consumption when compared to care as usual, whereas the paroxetine group did not show a similar reduction. In a study by McCrone et al. , CBT was found to have a reasonable short-term cost-effectiveness but not beyond 3-month follow-up. In summary, although psychological treatments are effective in reducing IBS symptoms there is insufficient evidence of their cost-effectiveness.
Our research group has recently conducted a randomized controlled trial of internet-delivered CBT for IBS . The main reason for using the internet as method of delivery is to increase the availability of the treatment. Evidence-based psychological treatments are often unavailable due to a lack of properly trained therapists . Internet-delivered CBT with minimal therapist contact has been found to be effective for a number of psychiatric and somatic problems [10, 11], and are likely to be cost-effective and more accessible to patients . However, there is little evidence regarding the economic aspects of internet-delivered CBT.
Participants were eligible for the study if they had been diagnosed with IBS by a physician before applying for the study and if they presently fulfilled the Rome III criteria for IBS . The Montgomery Åsberg Depression Rating Scale - Self report [MADRS-S; ] was used to exclude participants, fulfilling criteria for suicide ideation (item 9 ≥ 4), and severe depressive symptoms(total score ≥ 30). Participants fulfilling criteria for substance dependence according to Alcohol Use Disorders Identification Test [AUDIT; ] or Drug Use Disorders Identification Test [DUDIT; ] and participants suffering from psychosis, manic episode, or anorexia were also excluded.
(n = 85)
(n = 42)
(n = 43)
mean years (sd)
Years since diagnosis
mean years (sd)
The study included pre- and post-treatment assessments for the treatment condition. Follow-up data were collected at 3-month follow-up for the treatment condition. After ten weeks, the participants in the control condition were crossed over to the active treatment. Follow-up data were also collected for all participants in the study approximately one year (15 to 18 months) after receiving the treatment.
The study protocol was approved by the regional ethics committee in Stockholm, Sweden.
The experimental group was given a ten-week internet-delivered cognitive behavioral treatment with therapist support via e-mail. The mean therapist time spent on each participant was 165 minutes (SD = 85 min). The treatment consisted of graded exposure to IBS-symptoms and mindfulness exercises. The treatment protocol is further described in Ljótsson et al.  and Ljótsson et al. . Participants in the control group took part in a discussion forum and could contact a therapist for general support if they wished (mean therapist time was 10 minutes, SD = 23).
Cost data were obtained with the Trimbos and Institute of Medical Technology Assessment Cost Questionnaire for Psychiatry (TIC-P) . In this questionnaire, participants report their health care consumption during the last month (e.g. GP visits), as well as time spent in informal health enhancing activities (e.g. self-help groups and informal care from friends). Participants also report their level of sick leave and reduced work capacity both at work and in the domestic realm and unemployment status during the last month.
These self-reports were used to estimate the costs of each participant's health care consumption, work loss, and work cutback. Medication costs were based on the free market price in Sweden. Costs from health service visits were estimated using established tariffs in Sweden. The human capital approach was used for valuation of the productivity losses, which means that monetary losses associated with work loss and work cutback were based on the participants' gross earning for the full length of their sick leave . Gross earnings were estimated using the average salary in Sweden by education level. Domestic losses were estimated at $ 13.17 per hour, reflecting the free market price of domestic help . The costs were originally computed in Swedish Crowns and then converted into US $ using the purchasing power parities of the OECD for the reference year 2008 .
The direct medical costs associated with the intervention were mainly driven by the costs of therapists. In this study, the therapists were graduate psychology students under supervision, but in the analysis we used the full economic cost price of a licensed clinical psychologist.
The time the therapist spent on treating the participants was registered and multiplied by this cost. We also estimated the costs of the participants' time, again at $13.17/hour, thus equating it with domestic help and assuming that people engaged in the intervention after office hours. The cost estimations of the control group were based on the time spent on the internet discussion forum. The cost estimations in the treatment group were based on the self-reported time the participants spent reading the treatment material and performing homework exercises plus the time spent on the discussion forum,
The analysis was conducted in accordance with the intention to treat principle, which means that all participants were included in analysis regardless of adherence to treatment. Missing data were imputed using the last observation carried forward method. The statistical analysis was conducted in four steps using STATA IC/11.0 (Stata Corp).
First, the cost differences between the treatment and control groups were estimated at pre-treatment and post-treatment. All costs were extrapolated to a 12-month period. Since the cost data were assumed to be non-normally distributed, p-values were estimated using a general linear model while employing non-parametric bootstrap analysis (5,000 replications). Such analyses are considered to generate robust estimates of standard errors of the costs .
Secondly, we compared the counts of clinically significant improvements across the conditions. Using a Poisson regression framework allowed us to test if the rate of favorable treatment responses in the experimental condition was higher than 1 relative to the control condition. The number needed treat (NNT) was computed as the inverse of the risk difference, which was obtained under a linear probability model .
Fourthly, the robustness of the results was tested in four different sensitivity analyses. First, the main analysis was repeated with only the direct medical costs included, hence narrowing the economic evaluation to a health service perspective. Second, the total costs were calculated with the unemployment costs excluded. This was done because the costs due to productivity losses from unemployment are large when accumulated over a 12-month period and could (in spite of randomization) be affected by factors not associated with IBS. Third, the missing data were reanalyzed using linear regression imputation as implemented in STATA. This was done to test whether last observation carried forward was indeed a more conservative imputation method. Fourth, we investigated the long-term impact on the ICER using 3-month and 1-year follow-up economic data. Since the control group was crossed over to treatment there was no comparison group at the follow-up assessment. The 3-month and 1 year follow-up of the treatment group data were therefore compared with the post-treatment data of the control group, thus assuming that the control group would have been unchanged if had been untreated during the follow-up periods. This was done to test whether the extrapolation to a 12-month period was a reliable analysis procedure.
Lastly, since the control group was crossed over to treatment and also participated in the follow-up, the long-term costs were calculated separately for that group.
Mean annual costs
Annual per capita cost ($)
Direct medical costs
Health care visits
Direct non-medical costs
Indirect non-medical costs
Total (excl. intervention costs)
Total (incl. intervention costs)
The fraction of recovered participants in the intervention condition at post treatment was 15/42 = 0.36 and 1/43 = 0.02 in the control condition. Hence, the likelihood ratio for a favorable treatment response was 0.36/0.02 = 15.36, representing a 15-fold increase of the recovery rate in the intervention relative to the control condition (95% confidence interval 2.1 to 111.1). This was statistically significant, Z= 2.64, P < 0.01. The NNT to generate one clinically significant improvement was 2.99 (95%CI 2 to 5), which means that three patients need to receive the intervention to generate one clinically significant improvement. At the 3-month follow-up, the fraction of recovered participants in the CBT condition was 14/42 = 0.33, and at one-year follow-up this figure was 18/42 = 0.43. In sum, the effects appear to be sustained over a 12-month period.
The cost change for the treatment group was 16,988 - 20,867 = -3879. The cost change in the control group was 16,872 - 15,036 = 1835. The incremental cost effectiveness ratio (ICER) was (-3879 - 1835)/(0.36 - 0.02) = -16,806. This means that each significant clinical improvement in IBS is associated with a societal cost-reduction of $16,806. Figure 2 presents the scatter of simulated ICERs across the four quadrants of the ICER plane. If the bulk of simulated ICERs appear in the southeast quadrant of the figure, lower costs are associated with a health gain. From a cost-effectiveness perspective, this is the most favorable outcome. If a majority of the simulated ICERs appear in the northwest quadrant, higher costs are associated with a lowered effectiveness, thus making the new intervention unacceptable from a cost-effectiveness perspective. Nearly all simulated ICERs (96%) were located in the southeast quadrant, indicating that the treatment produced beneficial effects and reduces costs for society compared to a no treatment control condition.
When only including direct medical costs in the estimation, 48% of the simulated ICERs were located in the southeast quadrant. When analyzing all data but excluding the unemployment variable, 41% of the dots were located in the southeast quadrant. Data were reanalyzed using regression imputation of missing data instead of last observation carried forward (4 imputations, R-square = 0.93). A majority (98%) of the simulated ICERs were still located in the southeast quadrant, attesting to the robustness of our findings. Finally in order to investigate the long-term impact, we repeated the analyses with follow-up economic data for the treatment group. Using 3-month and 1-year follow-up data, 97% and 89% of the dots were located in the southeast quadrant, respectively.
The control group at follow up
After the post-treatment the control group was crossed over to treatment. At the 1 year follow-up the group also presented with cost reductions (pre treatment; $15,036, follow-up; $13,008). Additionally 19/43 of the control group participants reported clinically significant symptom relief.
The aim of this study was to determine whether internet-delivered CBT would be a cost-effective or perhaps even a cost-saving intervention for IBS. The results give preliminary evidence of the internet-delivered treatment as a cost-effective way of offering treatment; better still, our observations suggest that the intervention is cost saving from a societal point of view. Participants in the treatment condition demonstrated significant reductions in IBS symptoms compared to the control condition. These improvements were accompanied by cost reductions at post-treatment and at follow-up. While the intervention did introduce some costs of its own, these costs were offset by greater productivity levels both at paid work and in the domestic realm. Thirty-six percent of the participants in the treatment condition were clinically improved and for each case of clinical improvement in IBS symptoms $16,806 of societal costs were saved. Irrespective of modeled scenario and choice of imputation method the online CBT intervention was associated with cost offsets, demonstrating robustness of our findings. The control group showed similar improvements and cost-savings after being crossed over to treatment.
The results from this trial differ from the McCrone et al.  and Creed et al.  studies. In the Creed et al. study, significant reductions in health care costs were found at the one-year follow-up but no significant reductions in work loss for the psychotherapy group. One possible explanation for this difference could be that this study used a broader perspective including both work cutback as well as domestic loss in the cost-effectiveness analysis. In the McCrone et al. study, the CBT group did not show any significant reductions in work loss and the treatment was not cost-effective beyond 3-month follow-up. In the original treatment study that the McCrone et al. report was based on, the participants' improvements in symptom actually declined after the 3-month follow-up . In contrast, the participants in our study demonstrated long-term maintenance of symptom reduction that could explain the long-term cost effectiveness. By and large, the results from this study provide additional evidence for internet-delivered CBT as a cost-effective treatment alternative for IBS.
Our study has several limitations. First, the cost data was collected using self-reports and the accuracy of this methodology can be open-to-question. However, the recall period was relatively short (4 weeks) and there is no reason to assume that inaccuracies overly bias any of the two treatment conditions. In addition, previous research studies have indicated that self-reports are as reliable as administratively recorded data . The TIC-P has been used in numerous studies [29–31] and has the advantage of being a broad measure covering health care uptake and productivity losses both in paid work as well as in the domestic realm. Therefore, the self-report methodology could be regarded as a feasible choice of measurement. Secondly, the use of 50% decline in IBS symptoms measured as criterion for clinically significant improvement might be inappropriate. This criterion has been used in several trials  of psychological treatment but other measures of clinically significant improvement have been proposed. The participants' subjective experience of "adequate relief"  has been used in both pharmacological  and psychological trials . A 50 point reduction in score on the IBS-SSS  has also been used as clinically significant improvement in symptoms. These differences in determining a clinically significant outcome are problematic as they make it difficult to compare trials and treatments. It would therefore have been preferable if at least one of the adequate relief and IBS-SSS measures had been included in this study. Thirdly, the control condition participants were randomized to a waiting list and were therefore aware that they would eventually receive the treatment. This factor could possibly have an impact on the cost-effectiveness results since the study design did not allow control for attention and expectancy of improvement. A proper attention control condition would have provided a more reliable estimate the cost-effectiveness of the specific treatment used. Fourthly, the calculations are based on internet CBT in a research setting and the real market price of such interventions is still unknown. Fifth, we did not directly ask the participants about their gross earning but instead used the average Swedish salary based on the participant's education level. This lack of information could possible produce errors in the mean cost calculations regarding production losses. However, the participants were randomized and potential errors should not affect the between group ICER estimations. Finally, as the control group was crossed over to treatment no comparison group was available at the 3-month and 1 year follow-up. The short experimental time period makes the extrapolated estimates of long-term cost-effectiveness somewhat less reliable. However, when repeating the analyses with 3-month and 1 year follow-up clinical data, the scatter of the simulated ICERs over the cost-effectiveness plane did not differ in any substantial way and would not change our conclusions.
To summarize, the findings from this study indicate that internet-delivered CBT for IBS can both be effective in treating IBS and generate cost savings for the society. Future evaluations should continue to investigate the cost-effectiveness as well as look more closely at the economic ramifications with regard to favorable treatment response. More research is also needed to expand our knowledge concerning the economic impact of internet-delivered CBT for IBS. We recommend that future studies use a more potent placebo condition and longer follow-up periods.
- Lacy BE, Lee RD: Irritable bowel syndrome: a syndrome in evolution. J Clin Gastroenterol. 2005, 39 (5 Suppl 3): S230-42. 10.1097/01.mcg.0000156110.69232.bb.View ArticlePubMed
- Drossman DA, et al: U.S. householder survey of functional gastrointestinal disorders. Prevalence, sociodemography, and health impact. Dig Dis Sci. 1993, 38 (9): 1569-80. 10.1007/BF01303162.View ArticlePubMed
- Hillila MT, Farkkila NJ, Farkkila MA: Societal costs for irritable bowel syndrome--a population based study. Scand J Gastroenterol. 2010, 45 (5): 582-91. 10.3109/00365521003637211.View ArticlePubMed
- Nyrop KA, et al: Costs of health care for irritable bowel syndrome, chronic constipation, functional diarrhoea and functional abdominal pain. Aliment Pharmacol Ther. 2007, 26 (2): 237-48. 10.1111/j.1365-2036.2007.03370.x.View ArticlePubMed
- Ford AC, et al: Efficacy of antidepressants and psychological therapies in irritable bowel syndrome: systematic review and meta-analysis. Gut. 2009, 58 (3): 367-78. 10.1136/gut.2008.163162.View ArticlePubMed
- Creed F, et al: The cost-effectiveness of psychotherapy and paroxetine for severe irritable bowel syndrome. Gastroenterology. 2003, 124 (2): 303-17. 10.1053/gast.2003.50055.View ArticlePubMed
- McCrone P, et al: Cost-effectiveness of cognitive behaviour therapy in addition to mebeverine for irritable bowel syndrome. Eur J Gastroenterol Hepatol. 2008, 20 (4): 255-63. 10.1097/MEG.0b013e3282f2519d.View ArticlePubMed
- Ljotsson B, et al: Internet-delivered exposure and mindfulness based therapy for irritable bowel syndrome--a randomized controlled trial. Behav Res Ther. 48 (6): 531-9. 10.1016/j.brat.2010.03.003.
- Lackner JM, et al: Self-administered cognitive behavior therapy for moderate to severe irritable bowel syndrome: clinical efficacy, tolerability, feasibility. Clin Gastroenterol Hepatol. 2008, 6 (8): 899-906. 10.1016/j.cgh.2008.03.004.PubMed CentralView ArticlePubMed
- Andersson G: Using the Internet to provide cognitive behaviour therapy. Behav Res Ther. 2009, 47 (3): 175-80. 10.1016/j.brat.2009.01.010.View ArticlePubMed
- Spek V, et al: Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med. 2007, 37 (3): 319-28. 10.1017/S0033291706008944.View ArticlePubMed
- Griffiths F, et al: Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res. 2006, 8 (2): e10-10.2196/jmir.8.2.e10.PubMed CentralView ArticlePubMed
- Longstreth GF, et al: Functional bowel disorders. Gastroenterology. 2006, 130 (5): 1480-91. 10.1053/j.gastro.2005.11.061.View ArticlePubMed
- Svanborg P, Åsberg M: A new self-rating scale for depression and anxiety states based on the Comprehensive Psychopathological Rating Scale. Acta Psychiatr Scand. 1994, 89 (1): 21-8. 10.1111/j.1600-0447.1994.tb01480.x.View ArticlePubMed
- Saunders JB, et al: Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption--II. Addiction. 1993, 88 (6): 791-804. 10.1111/j.1360-0443.1993.tb02093.x.View ArticlePubMed
- Berman AH, et al: Evaluation of the Drug Use Disorders Identification Test (DUDIT) in criminal justice and detoxification settings and in a Swedish population sample. Eur Addict Res. 2005, 11 (1): 22-31. 10.1159/000081413.View ArticlePubMed
- Sheehan DV, et al: The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998, 59 (Suppl 20): 22-33. quiz 34-57PubMed
- Ljotsson B, et al: Exposure and mindfulness based therapy for irritable bowel syndrome - An open pilot study. J Behav Ther Exp Psychiatry. 2010
- Svedlund J, Sjodin I, Dotevall G: GSRS--a clinical rating scale for gastrointestinal symptoms in patients with irritable bowel syndrome and peptic ulcer disease. Dig Dis Sci. 1988, 33 (2): 129-34. 10.1007/BF01535722.View ArticlePubMed
- Blanchard EB: Irritable bowel syndrome: Psychosocial assessment and treatment. xi. 2001, Washington, DC, US: American Psychological Association, 1-373.View Article
- Hakkaart-Van Roijen L, Donker M: Manual Trimbos/iMTA questionnaire for costs associated with psychiatric illness (TIC-P). 2002
- Drummond MF, et al: Methods for the economic evaluation of health care programmes. 2005, Oxford: Oxford University Press, Third
- Smit F, et al: Cost-effectiveness of preventing depression in primary care patients: randomised trial. Br J Psychiatry. 2006, 188: 330-6. 10.1192/bjp.188.4.330.View ArticlePubMed
- Organisation for economic co-operation and development. 2008, [http://www.oecd.org]
- Efron B, Tibshirani RJ: An introduction to the bootstrap. 1993, New York: Chapman & HallView Article
- Long JS, Freese J: Regression models for categorical dependent variables using Stata. 2006, College Station, Tex.: StataCorp LP, xxv-527, 2
- Kennedy T, et al: Cognitive behaviour therapy in addition to antispasmodic treatment for irritable bowel syndrome in primary care: randomised controlled trial. BMJ. 2005, 331 (7514): 435-10.1136/bmj.38545.505764.06.PubMed CentralView ArticlePubMed
- Patel A, et al: A comparison of two methods of collecting economic data in primary care. Fam Pract. 2005, 22 (3): 323-327. 10.1093/fampra/cmi027.View ArticlePubMed
- Hakkaart-van Roijen L, et al: Societal costs and quality of life of children suffering from attention deficient hyperactivity disorder (ADHD). Eur Child Adolesc Psychiatry. 2007, 16 (5): 316-26. 10.1007/s00787-007-0603-6.View ArticlePubMed
- van der Feltz-Cornelis CM, et al: Randomised controlled trial of a psychiatric consultation model for treatment of common mental disorder in the occupational health setting. BMC Health Serv Res. 2007, 7: 29-10.1186/1472-6963-7-29.PubMed CentralView ArticlePubMed
- Horn EK, et al: Cost-effectiveness of collaborative care for chronically ill patients with comorbid depressive disorder in the general hospital setting, a randomised controlled trial. BMC Health Serv Res. 2007, 7: 28-10.1186/1472-6963-7-28.PubMed CentralView ArticlePubMed
- Mangel AW, et al: Adequate relief as an endpoint in clinical trials in irritable bowel syndrome. J Int Med Res. 1998, 26 (2): 76-81.PubMed
- Camilleri M, et al: Efficacy and safety of alosetron in women with irritable bowel syndrome: a randomised, placebo-controlled trial. Lancet. 2000, 355 (9209): 1035-40. 10.1016/S0140-6736(00)02033-X.View ArticlePubMed
- Francis CY, Morris J, Whorwell PJ: The irritable bowel severity scoring system: a simple method of monitoring irritable bowel syndrome and its progress. Aliment Pharmacol Ther. 1997, 11 (2): 395-402. 10.1046/j.1365-2036.1997.142318000.x.View ArticlePubMed
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/11/215/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.