Cost-effectiveness of internet-based cognitive behavior therapy for irritable bowel syndrome: results from a randomized controlled trial
BMC Public Health volume 11, Article number: 215 (2011)
Irritable Bowel Syndrome (IBS) is highly prevalent and is associated with a substantial economic burden. Cognitive behavior therapy (CBT) has been shown to be effective in treating IBS. The aim of this study was to evaluate the cost-effectiveness of a new treatment alternative, internet-delivered CBT based on exposure and mindfulness exercises.
Participants (N = 85) with IBS were recruited through self-referral and were assessed via a telephone interview and self-report measures on the internet. Participants were randomized to internet-delivered CBT or to a discussion forum. Economic data was assessed at pre-, post- and at 3-month and 1 year follow-up.
Significant cost reductions were found for the treatment group at $16,806 per successfully treated case. The cost reductions were mainly driven by reduced work loss in the treatment group. Results were sustained at 3-month and 1 year follow-up.
Internet-delivered CBT appears to generate health gains in IBS treatment and is associated with cost-savings from a societal perspective.
Irritable bowel syndrome (IBS) is a highly prevalent gastrointestinal disorder  that is associated with production losses [2, 3] and increased levels of health service utilization [3, 4]. The high prevalence rate combined with the costs associated for each afflicted individual makes IBS a considerable economic burden for society. Research indicates that psychological interventions - such as cognitive behavior therapy (CBT), hypnotherapy and psychodynamic therapy - can be effective in reducing IBS symptoms . In addition, there is some evidence indicating that psychological treatments are cost-effective. In a study by Creed et al. , 171 patients with IBS were randomized to receive either 8 sessions of individual psychodynamic therapy, paroxetine, or care as usual. At one-year follow-up, the psychotherapy condition was associated with significant reductions in health care consumption when compared to care as usual, whereas the paroxetine group did not show a similar reduction. In a study by McCrone et al. , CBT was found to have a reasonable short-term cost-effectiveness but not beyond 3-month follow-up. In summary, although psychological treatments are effective in reducing IBS symptoms there is insufficient evidence of their cost-effectiveness.
Our research group has recently conducted a randomized controlled trial of internet-delivered CBT for IBS . The main reason for using the internet as method of delivery is to increase the availability of the treatment. Evidence-based psychological treatments are often unavailable due to a lack of properly trained therapists . Internet-delivered CBT with minimal therapist contact has been found to be effective for a number of psychiatric and somatic problems [10, 11], and are likely to be cost-effective and more accessible to patients . However, there is little evidence regarding the economic aspects of internet-delivered CBT.
Participants were eligible for the study if they had been diagnosed with IBS by a physician before applying for the study and if they presently fulfilled the Rome III criteria for IBS . The Montgomery Åsberg Depression Rating Scale - Self report [MADRS-S; ] was used to exclude participants, fulfilling criteria for suicide ideation (item 9 ≥ 4), and severe depressive symptoms(total score ≥ 30). Participants fulfilling criteria for substance dependence according to Alcohol Use Disorders Identification Test [AUDIT; ] or Drug Use Disorders Identification Test [DUDIT; ] and participants suffering from psychosis, manic episode, or anorexia were also excluded.
Figure 1 displays participant flow through the selection procedure, randomization and assessments. The participants were recruited through self-referral from the general adult population in Sweden. A total of 193 individuals applied for the study, 98 were interviewed and 86 were included for randomization. Telephone interviews were conducted by graduate psychology students or psychologists and included structured questions about Rome III-criteria and also the Mini-International Neuropsychiatric Interview [MINI; ] to assess any psychiatric co-morbidity that could be cause for exclusion. All interviews were reviewed by the study's gastroenterologist who made the final decision if a participant should be included in the study. After having been randomized to the treatment condition one participant underwent a colostomy and was subsequently excluded from the study and all further data analysis. Demographics for the study participants are displayed in Table 1.
The study included pre- and post-treatment assessments for the treatment condition. Follow-up data were collected at 3-month follow-up for the treatment condition. After ten weeks, the participants in the control condition were crossed over to the active treatment. Follow-up data were also collected for all participants in the study approximately one year (15 to 18 months) after receiving the treatment.
The study protocol was approved by the regional ethics committee in Stockholm, Sweden.
The experimental group was given a ten-week internet-delivered cognitive behavioral treatment with therapist support via e-mail. The mean therapist time spent on each participant was 165 minutes (SD = 85 min). The treatment consisted of graded exposure to IBS-symptoms and mindfulness exercises. The treatment protocol is further described in Ljótsson et al.  and Ljótsson et al. . Participants in the control group took part in a discussion forum and could contact a therapist for general support if they wished (mean therapist time was 10 minutes, SD = 23).
Cost data were obtained with the Trimbos and Institute of Medical Technology Assessment Cost Questionnaire for Psychiatry (TIC-P) . In this questionnaire, participants report their health care consumption during the last month (e.g. GP visits), as well as time spent in informal health enhancing activities (e.g. self-help groups and informal care from friends). Participants also report their level of sick leave and reduced work capacity both at work and in the domestic realm and unemployment status during the last month.
These self-reports were used to estimate the costs of each participant's health care consumption, work loss, and work cutback. Medication costs were based on the free market price in Sweden. Costs from health service visits were estimated using established tariffs in Sweden. The human capital approach was used for valuation of the productivity losses, which means that monetary losses associated with work loss and work cutback were based on the participants' gross earning for the full length of their sick leave . Gross earnings were estimated using the average salary in Sweden by education level. Domestic losses were estimated at $ 13.17 per hour, reflecting the free market price of domestic help . The costs were originally computed in Swedish Crowns and then converted into US $ using the purchasing power parities of the OECD for the reference year 2008 .
The direct medical costs associated with the intervention were mainly driven by the costs of therapists. In this study, the therapists were graduate psychology students under supervision, but in the analysis we used the full economic cost price of a licensed clinical psychologist.
The time the therapist spent on treating the participants was registered and multiplied by this cost. We also estimated the costs of the participants' time, again at $13.17/hour, thus equating it with domestic help and assuming that people engaged in the intervention after office hours. The cost estimations of the control group were based on the time spent on the internet discussion forum. The cost estimations in the treatment group were based on the self-reported time the participants spent reading the treatment material and performing homework exercises plus the time spent on the discussion forum,
The analysis was conducted in accordance with the intention to treat principle, which means that all participants were included in analysis regardless of adherence to treatment. Missing data were imputed using the last observation carried forward method. The statistical analysis was conducted in four steps using STATA IC/11.0 (Stata Corp).
First, the cost differences between the treatment and control groups were estimated at pre-treatment and post-treatment. All costs were extrapolated to a 12-month period. Since the cost data were assumed to be non-normally distributed, p-values were estimated using a general linear model while employing non-parametric bootstrap analysis (5,000 replications). Such analyses are considered to generate robust estimates of standard errors of the costs .
Secondly, we compared the counts of clinically significant improvements across the conditions. Using a Poisson regression framework allowed us to test if the rate of favorable treatment responses in the experimental condition was higher than 1 relative to the control condition. The number needed treat (NNT) was computed as the inverse of the risk difference, which was obtained under a linear probability model .
Thirdly, the incremental cost-effectiveness ratio (ICER) was estimated. We computed pre-post differences in costs and effects. We then computed differences in costs and effects between both conditions taking the cost difference over the effect difference: (C(exp) - C(ctr))/(E(exp) - E(ctr)). C is the difference of the costs of IBS and the intervention between the pre and post assessments. E refers to the treatment response between both conditions . This calculation was repeated 5,000 times (for each bootstrap sample) generating a scatter of simulated ICERs across the ICER plane (see Figure 2).
Fourthly, the robustness of the results was tested in four different sensitivity analyses. First, the main analysis was repeated with only the direct medical costs included, hence narrowing the economic evaluation to a health service perspective. Second, the total costs were calculated with the unemployment costs excluded. This was done because the costs due to productivity losses from unemployment are large when accumulated over a 12-month period and could (in spite of randomization) be affected by factors not associated with IBS. Third, the missing data were reanalyzed using linear regression imputation as implemented in STATA. This was done to test whether last observation carried forward was indeed a more conservative imputation method. Fourth, we investigated the long-term impact on the ICER using 3-month and 1-year follow-up economic data. Since the control group was crossed over to treatment there was no comparison group at the follow-up assessment. The 3-month and 1 year follow-up of the treatment group data were therefore compared with the post-treatment data of the control group, thus assuming that the control group would have been unchanged if had been untreated during the follow-up periods. This was done to test whether the extrapolation to a 12-month period was a reliable analysis procedure.
Lastly, since the control group was crossed over to treatment and also participated in the follow-up, the long-term costs were calculated separately for that group.
Table 2 presents the annual per capita costs of IBS at pre-treatment and post-treatment assessment for both treatment and control groups and 3-month and 1 year follow-up for the treatment group. At post treatment, we found significant cost differences regarding the gross total monetary change, Z = -2.06, P < 0.05, as well as the indirect non-medical costs, Z = -2.20, P < 0.05.
The fraction of recovered participants in the intervention condition at post treatment was 15/42 = 0.36 and 1/43 = 0.02 in the control condition. Hence, the likelihood ratio for a favorable treatment response was 0.36/0.02 = 15.36, representing a 15-fold increase of the recovery rate in the intervention relative to the control condition (95% confidence interval 2.1 to 111.1). This was statistically significant, Z= 2.64, P < 0.01. The NNT to generate one clinically significant improvement was 2.99 (95%CI 2 to 5), which means that three patients need to receive the intervention to generate one clinically significant improvement. At the 3-month follow-up, the fraction of recovered participants in the CBT condition was 14/42 = 0.33, and at one-year follow-up this figure was 18/42 = 0.43. In sum, the effects appear to be sustained over a 12-month period.
The cost change for the treatment group was 16,988 - 20,867 = -3879. The cost change in the control group was 16,872 - 15,036 = 1835. The incremental cost effectiveness ratio (ICER) was (-3879 - 1835)/(0.36 - 0.02) = -16,806. This means that each significant clinical improvement in IBS is associated with a societal cost-reduction of $16,806. Figure 2 presents the scatter of simulated ICERs across the four quadrants of the ICER plane. If the bulk of simulated ICERs appear in the southeast quadrant of the figure, lower costs are associated with a health gain. From a cost-effectiveness perspective, this is the most favorable outcome. If a majority of the simulated ICERs appear in the northwest quadrant, higher costs are associated with a lowered effectiveness, thus making the new intervention unacceptable from a cost-effectiveness perspective. Nearly all simulated ICERs (96%) were located in the southeast quadrant, indicating that the treatment produced beneficial effects and reduces costs for society compared to a no treatment control condition.
When only including direct medical costs in the estimation, 48% of the simulated ICERs were located in the southeast quadrant. When analyzing all data but excluding the unemployment variable, 41% of the dots were located in the southeast quadrant. Data were reanalyzed using regression imputation of missing data instead of last observation carried forward (4 imputations, R-square = 0.93). A majority (98%) of the simulated ICERs were still located in the southeast quadrant, attesting to the robustness of our findings. Finally in order to investigate the long-term impact, we repeated the analyses with follow-up economic data for the treatment group. Using 3-month and 1-year follow-up data, 97% and 89% of the dots were located in the southeast quadrant, respectively.
The control group at follow up
After the post-treatment the control group was crossed over to treatment. At the 1 year follow-up the group also presented with cost reductions (pre treatment; $15,036, follow-up; $13,008). Additionally 19/43 of the control group participants reported clinically significant symptom relief.
The aim of this study was to determine whether internet-delivered CBT would be a cost-effective or perhaps even a cost-saving intervention for IBS. The results give preliminary evidence of the internet-delivered treatment as a cost-effective way of offering treatment; better still, our observations suggest that the intervention is cost saving from a societal point of view. Participants in the treatment condition demonstrated significant reductions in IBS symptoms compared to the control condition. These improvements were accompanied by cost reductions at post-treatment and at follow-up. While the intervention did introduce some costs of its own, these costs were offset by greater productivity levels both at paid work and in the domestic realm. Thirty-six percent of the participants in the treatment condition were clinically improved and for each case of clinical improvement in IBS symptoms $16,806 of societal costs were saved. Irrespective of modeled scenario and choice of imputation method the online CBT intervention was associated with cost offsets, demonstrating robustness of our findings. The control group showed similar improvements and cost-savings after being crossed over to treatment.
The results from this trial differ from the McCrone et al.  and Creed et al.  studies. In the Creed et al. study, significant reductions in health care costs were found at the one-year follow-up but no significant reductions in work loss for the psychotherapy group. One possible explanation for this difference could be that this study used a broader perspective including both work cutback as well as domestic loss in the cost-effectiveness analysis. In the McCrone et al. study, the CBT group did not show any significant reductions in work loss and the treatment was not cost-effective beyond 3-month follow-up. In the original treatment study that the McCrone et al. report was based on, the participants' improvements in symptom actually declined after the 3-month follow-up . In contrast, the participants in our study demonstrated long-term maintenance of symptom reduction that could explain the long-term cost effectiveness. By and large, the results from this study provide additional evidence for internet-delivered CBT as a cost-effective treatment alternative for IBS.
Our study has several limitations. First, the cost data was collected using self-reports and the accuracy of this methodology can be open-to-question. However, the recall period was relatively short (4 weeks) and there is no reason to assume that inaccuracies overly bias any of the two treatment conditions. In addition, previous research studies have indicated that self-reports are as reliable as administratively recorded data . The TIC-P has been used in numerous studies [29–31] and has the advantage of being a broad measure covering health care uptake and productivity losses both in paid work as well as in the domestic realm. Therefore, the self-report methodology could be regarded as a feasible choice of measurement. Secondly, the use of 50% decline in IBS symptoms measured as criterion for clinically significant improvement might be inappropriate. This criterion has been used in several trials  of psychological treatment but other measures of clinically significant improvement have been proposed. The participants' subjective experience of "adequate relief"  has been used in both pharmacological  and psychological trials . A 50 point reduction in score on the IBS-SSS  has also been used as clinically significant improvement in symptoms. These differences in determining a clinically significant outcome are problematic as they make it difficult to compare trials and treatments. It would therefore have been preferable if at least one of the adequate relief and IBS-SSS measures had been included in this study. Thirdly, the control condition participants were randomized to a waiting list and were therefore aware that they would eventually receive the treatment. This factor could possibly have an impact on the cost-effectiveness results since the study design did not allow control for attention and expectancy of improvement. A proper attention control condition would have provided a more reliable estimate the cost-effectiveness of the specific treatment used. Fourthly, the calculations are based on internet CBT in a research setting and the real market price of such interventions is still unknown. Fifth, we did not directly ask the participants about their gross earning but instead used the average Swedish salary based on the participant's education level. This lack of information could possible produce errors in the mean cost calculations regarding production losses. However, the participants were randomized and potential errors should not affect the between group ICER estimations. Finally, as the control group was crossed over to treatment no comparison group was available at the 3-month and 1 year follow-up. The short experimental time period makes the extrapolated estimates of long-term cost-effectiveness somewhat less reliable. However, when repeating the analyses with 3-month and 1 year follow-up clinical data, the scatter of the simulated ICERs over the cost-effectiveness plane did not differ in any substantial way and would not change our conclusions.
To summarize, the findings from this study indicate that internet-delivered CBT for IBS can both be effective in treating IBS and generate cost savings for the society. Future evaluations should continue to investigate the cost-effectiveness as well as look more closely at the economic ramifications with regard to favorable treatment response. More research is also needed to expand our knowledge concerning the economic impact of internet-delivered CBT for IBS. We recommend that future studies use a more potent placebo condition and longer follow-up periods.
Lacy BE, Lee RD: Irritable bowel syndrome: a syndrome in evolution. J Clin Gastroenterol. 2005, 39 (5 Suppl 3): S230-42. 10.1097/01.mcg.0000156110.69232.bb.
Drossman DA, et al: U.S. householder survey of functional gastrointestinal disorders. Prevalence, sociodemography, and health impact. Dig Dis Sci. 1993, 38 (9): 1569-80. 10.1007/BF01303162.
Hillila MT, Farkkila NJ, Farkkila MA: Societal costs for irritable bowel syndrome--a population based study. Scand J Gastroenterol. 2010, 45 (5): 582-91. 10.3109/00365521003637211.
Nyrop KA, et al: Costs of health care for irritable bowel syndrome, chronic constipation, functional diarrhoea and functional abdominal pain. Aliment Pharmacol Ther. 2007, 26 (2): 237-48. 10.1111/j.1365-2036.2007.03370.x.
Ford AC, et al: Efficacy of antidepressants and psychological therapies in irritable bowel syndrome: systematic review and meta-analysis. Gut. 2009, 58 (3): 367-78. 10.1136/gut.2008.163162.
Creed F, et al: The cost-effectiveness of psychotherapy and paroxetine for severe irritable bowel syndrome. Gastroenterology. 2003, 124 (2): 303-17. 10.1053/gast.2003.50055.
McCrone P, et al: Cost-effectiveness of cognitive behaviour therapy in addition to mebeverine for irritable bowel syndrome. Eur J Gastroenterol Hepatol. 2008, 20 (4): 255-63. 10.1097/MEG.0b013e3282f2519d.
Ljotsson B, et al: Internet-delivered exposure and mindfulness based therapy for irritable bowel syndrome--a randomized controlled trial. Behav Res Ther. 48 (6): 531-9. 10.1016/j.brat.2010.03.003.
Lackner JM, et al: Self-administered cognitive behavior therapy for moderate to severe irritable bowel syndrome: clinical efficacy, tolerability, feasibility. Clin Gastroenterol Hepatol. 2008, 6 (8): 899-906. 10.1016/j.cgh.2008.03.004.
Andersson G: Using the Internet to provide cognitive behaviour therapy. Behav Res Ther. 2009, 47 (3): 175-80. 10.1016/j.brat.2009.01.010.
Spek V, et al: Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med. 2007, 37 (3): 319-28. 10.1017/S0033291706008944.
Griffiths F, et al: Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res. 2006, 8 (2): e10-10.2196/jmir.8.2.e10.
Longstreth GF, et al: Functional bowel disorders. Gastroenterology. 2006, 130 (5): 1480-91. 10.1053/j.gastro.2005.11.061.
Svanborg P, Åsberg M: A new self-rating scale for depression and anxiety states based on the Comprehensive Psychopathological Rating Scale. Acta Psychiatr Scand. 1994, 89 (1): 21-8. 10.1111/j.1600-0447.1994.tb01480.x.
Saunders JB, et al: Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption--II. Addiction. 1993, 88 (6): 791-804. 10.1111/j.1360-0443.1993.tb02093.x.
Berman AH, et al: Evaluation of the Drug Use Disorders Identification Test (DUDIT) in criminal justice and detoxification settings and in a Swedish population sample. Eur Addict Res. 2005, 11 (1): 22-31. 10.1159/000081413.
Sheehan DV, et al: The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998, 59 (Suppl 20): 22-33. quiz 34-57
Ljotsson B, et al: Exposure and mindfulness based therapy for irritable bowel syndrome - An open pilot study. J Behav Ther Exp Psychiatry. 2010
Svedlund J, Sjodin I, Dotevall G: GSRS--a clinical rating scale for gastrointestinal symptoms in patients with irritable bowel syndrome and peptic ulcer disease. Dig Dis Sci. 1988, 33 (2): 129-34. 10.1007/BF01535722.
Blanchard EB: Irritable bowel syndrome: Psychosocial assessment and treatment. xi. 2001, Washington, DC, US: American Psychological Association, 1-373.
Hakkaart-Van Roijen L, Donker M: Manual Trimbos/iMTA questionnaire for costs associated with psychiatric illness (TIC-P). 2002
Drummond MF, et al: Methods for the economic evaluation of health care programmes. 2005, Oxford: Oxford University Press, Third
Smit F, et al: Cost-effectiveness of preventing depression in primary care patients: randomised trial. Br J Psychiatry. 2006, 188: 330-6. 10.1192/bjp.188.4.330.
Organisation for economic co-operation and development. 2008, [http://www.oecd.org]
Efron B, Tibshirani RJ: An introduction to the bootstrap. 1993, New York: Chapman & Hall
Long JS, Freese J: Regression models for categorical dependent variables using Stata. 2006, College Station, Tex.: StataCorp LP, xxv-527, 2
Kennedy T, et al: Cognitive behaviour therapy in addition to antispasmodic treatment for irritable bowel syndrome in primary care: randomised controlled trial. BMJ. 2005, 331 (7514): 435-10.1136/bmj.38545.505764.06.
Patel A, et al: A comparison of two methods of collecting economic data in primary care. Fam Pract. 2005, 22 (3): 323-327. 10.1093/fampra/cmi027.
Hakkaart-van Roijen L, et al: Societal costs and quality of life of children suffering from attention deficient hyperactivity disorder (ADHD). Eur Child Adolesc Psychiatry. 2007, 16 (5): 316-26. 10.1007/s00787-007-0603-6.
van der Feltz-Cornelis CM, et al: Randomised controlled trial of a psychiatric consultation model for treatment of common mental disorder in the occupational health setting. BMC Health Serv Res. 2007, 7: 29-10.1186/1472-6963-7-29.
Horn EK, et al: Cost-effectiveness of collaborative care for chronically ill patients with comorbid depressive disorder in the general hospital setting, a randomised controlled trial. BMC Health Serv Res. 2007, 7: 28-10.1186/1472-6963-7-28.
Mangel AW, et al: Adequate relief as an endpoint in clinical trials in irritable bowel syndrome. J Int Med Res. 1998, 26 (2): 76-81.
Camilleri M, et al: Efficacy and safety of alosetron in women with irritable bowel syndrome: a randomised, placebo-controlled trial. Lancet. 2000, 355 (9209): 1035-40. 10.1016/S0140-6736(00)02033-X.
Francis CY, Morris J, Whorwell PJ: The irritable bowel severity scoring system: a simple method of monitoring irritable bowel syndrome and its progress. Aliment Pharmacol Ther. 1997, 11 (2): 395-402. 10.1046/j.1365-2036.1997.142318000.x.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/11/215/prepub
The authors declare that they have no competing interests.
EA was main responsible in interpreting health economic data and performed all statistical analyses. He also performed psychiatric interviews in the study and was responsible for drafting this manuscript. BL was the study project manager. He wrote the treatment manual and participated in the drafting of this manuscript. FS participated in the interpretation of health economic data and statistical analyses. He also contributed to the drafting of the manuscript. BP crosschecked all health economic data and participated in the statistical analyses. He also contributed to the drafting of the manuscript. EH participated in the conception of the study and in revising this manuscript. NL participated in the study conception, its design and management, analysis of data, interpretation and revising this manuscript. GA participated in the study conception, its design and management, analysis of data, interpretation and revising this manuscript. CR participated in the conception of the study and its design, was responsible for psychiatric assessments and in the supervising of this manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Andersson, E., Ljótsson, B., Smit, F. et al. Cost-effectiveness of internet-based cognitive behavior therapy for irritable bowel syndrome: results from a randomized controlled trial. BMC Public Health 11, 215 (2011). https://doi.org/10.1186/1471-2458-11-215