Cost-effectiveness of a national exercise referral programme for primary care patients in Wales: results of a randomised controlled trial
© Edwards et al.; licensee BioMed Central Ltd. 2013
Received: 6 February 2013
Accepted: 14 October 2013
Published: 29 October 2013
A recent HTA review concluded that there was a need for RCTs of exercise referral schemes (ERS) for people with a medical diagnosis who might benefit from exercise. Overall, there is still uncertainty as to the cost-effectiveness of ERS. Evaluation of public health interventions places challenges on conventional health economics approaches. This economic evaluation of a national public health intervention addresses this issue of where ERS may be most cost effective through subgroup analysis, particularly important at a time of financial constraint.
This economic analysis included 798 individuals aged 16 and over (55% of the randomised controlled trial (RCT) sample) with coronary heart disease risk factors and/or mild to moderate anxiety, depression or stress. Individuals were referred by health professionals in a primary care setting to a 16 week national exercise referral scheme (NERS) delivered by qualified exercise professionals in local leisure centres in Wales, UK. Health-related quality of life, health care services use, costs per participant in NERS, and willingness to pay for NERS were measured at 6 and 12 months.
The base case analysis assumed a participation cost of £385 per person per year, with a mean difference in QALYs between the two groups of 0.027. The incremental cost-effectiveness ratio was £12,111 per QALY gained. Probabilistic sensitivity analysis demonstrated an 89% probability of NERS being cost-effective at a payer threshold of £30,000 per QALY. When participant payments of £1 and £2 per session were considered, the cost per QALY fell from £12,111 (base case) to £10,926 and £9,741, respectively. Participants with a mental health risk factor alone or in combination with a risk of chronic heart disease generated a lower ICER (£10,276) compared to participants at risk of chronic heart disease only (£13,060).
Results of cost-effectiveness analyses suggest that NERS is cost saving in fully adherent participants. Though full adherence to NERS (62%) was higher for the economics sample than the main sample (44%), results still suggest that NERS can be cost-effective in Wales with respect to existing payer thresholds particularly for participants with mental health and CHD risk factors.
Current Controlled Trials ISRCTN47680448
KeywordsPublic health policy Exercise referral Mental health Heart disease risk factors Cost-effectiveness
Lack of adequate physical exercise is a contributing factor in CHD risk, musculoskeletal problems, diabetes and depression which places a huge economic burden on the NHS and wider society in the UK  with similar trends worldwide. There is growing interest in general practice (GP) exercise referral schemes. Referred patients access an individually tailored exercise programme, including; exercise classes, swimming, green gyms and yoga.
Economic evaluation of public health interventions places challenges beyond the economic evaluation of clinical interventions in terms of potential wider benefits, multiple stake holders bearing costs, and time horizons over which costs and benefits will be accrued [2, 3]. It is helpful to view such public health interventions as complex interventions with multiple components (in this case, fidelity to specific exercise interventions, compliance (dose) and uptake of the intervention, and mechanisms of behaviour change) [4, 5].
Internationally, cost-effectiveness evidence has been equivocal compared with other population level interventions . Matrix (2006),  reviewed the literature and modelled the cost-effectiveness of four interventions, pedometers, exercise referral, walking and cycling programmes in the community. Cost per QALY estimates for all four interventions were well below the NICE threshold of £20,000 to £30,000 per quality adjusted life year (QALY). Pavey et al. (2011),  showed a 51% probability of GP referral being cost-effective at £20,000 per QALY, 88% at £30,000 per QALY. In Australia, Cobiac et al. (2009),  modelled disability adjusted life years (DALYs) gained from six population level exercise promotion interventions. They found that pedometer use, mass media-based community campaigns, GP exercise referral, healthy transport and internet programmes were within the AUS $50,000 threshold.
There have been few prospective economic evaluations alongside pragmatic, community based RCTs of GP exercise referral schemes. Munro et al. (2004),  calculated a cost per QALY of €17,174 for a community-based exercise programme in over 65 year olds. Owen et al. (2011),  published a list of 200 public health interventions included in NICE guidance, of which exercise referral was one of the 85% of interventions under the £20,000 threshold. The above authors do not explore cost-effectiveness with respect to subgroups or explore how interventions address known inequalities in health, points recognised by Kelly et al. (2005) and Weatherly et al. (2009), [2, 3]. In particular, how effective and cost effective ERS are for participants with a medical diagnosis which may benefit from exercise .
This economic evaluation was conducted alongside a pragmatic randomised controlled trial of the Welsh National Exercise Referral Scheme (NERS) [11, 12]. Detailed effectiveness and headline economic results are published elsewhere . NERS was designed to encourage increased activity in patients at low or medium risk of coronary heart disease or with mild to moderate depression. The scheme was sponsored by the Welsh Government (WG) in partnership with local authorities, National Public Health Service and Local Health Boards. The aim of our economic evaluation was to assess the cost-effectiveness of NERS in Wales from a multi-agency public sector perspective and to use subgroup analysis to explore the effects of medical diagnosis, gender, age, inequalities, referral route and adherence on effectiveness and cost-effectiveness.
A pragmatic, randomised controlled trial, with nested economic evaluation was conducted in 12 of the 22 local health board (LHB) areas in Wales, UK (for full details see study protocol) [11, 12]. Participants aged >16 years, sedentary with risk factors for coronary heart disease (CHD) or minor mental health problems, were recruited by health professionals in primary care and randomised to intervention or control group. The intervention group participants were offered a 16-week exercise programme delivered by qualified exercise professionals (EP) based in local authority leisure centres. Participants allocated to the control group received an information leaflet and preferential access to the scheme after 12 months.
Data collection and economic measures
Postal questionnaires were sent to all participants at baseline, 6 and 12 months. The questionnaire at 12 months included a willingness to pay question. Non-respondents received a reminder two weeks later. The Client Service Receipt Inventory  asked participants to recall their recent contacts with health care services in primary and secondary care, including prescribing. EQ-5D (3 L)  is a generic, preference based instrument for evaluating health-related quality of life. A minimal questionnaire pack was sent at baseline assessing demographics and activity levels to reduce participant burden and facilitate recruitment.
A breakdown of the budget for NERS for 13 local authorities initially providing NERS was obtained from WG. This budget included 50% of local authority exercise coordinators’ salaries, 100% of leisure centre exercise professionals’ (EP) salaries, training; promotional materials, administration, information technology, travel and equipment. Telephone interviews with NERS programme directors at WG and leisure centre managers were conducted to capture additional costs incurred. One local authority incurred costs, although it did not implement the scheme during the trial period.
Cost and cost-effectiveness analysis
referrals to the trial from July 2007 to October 2008, (n = 4779);
participants who accessed NERS during the trial, those in the intervention group (n = 1080) plus people referred to NERS, but not eligible for the trial (n = 1493), minus an estimated 15% who would not attend, (n = 2349).
and an arithmetic mean between our upper and lower estimates, (n = 3530).
Cost-utility analysis was conducted in line with MRC guidelines for the evaluation of complex interventions,  and our standard operating procedure for economic evaluation alongside pragmatic RCTs, . When EQ-5D,  data was missing for one or two domains in the five domain scale, stochastic imputation (assuming data was missing at random) was used (n = 28 scores). Since health-related quality of life was assessed at 6 and 12 month follow-up only, the base-case analysis used area under the curve (AUC) data for the period between 6 and 12 months to estimate QALY change. Sensitivity analyses were conducted using: a) EQ-5D,  scores at 6 months for both intervention and control group as an estimate of baseline differences, and b) using control group mean EQ-5D scores at 6 months as a point estimate of EQ-5D,  score at baseline. Sensitivity analyses were conducted for: different intervention costs (£285, £385 and £579); referral to NERS by GP, nurse, or 50% referral by GP and 50% by nurse; participant payment of £1 per session, and of £2 per session (taking into account Wales Index of Multiple Deprivation; WIMD). Subgroup analyses compared the cost-effectiveness of NERS depending on gender, age group (<44, 44–60 or >60 years), adherence to the Scheme (16 weeks or <16 weeks), and referral reason (CHD and/or mental health risk factors). Cost-utility analyses were carried out using STATA SE 10. Costs and benefits were not discounted as the trial follow-up period was 12 months.
Characteristics of economic sample
The economic sample, for whom full cost and EQ-5D,  data were collected (n = 798), represented 55% of the main effectiveness trial sample . There were no statistically significant differences between the two samples with regard to gender of participants, or the WIMD . However, the economic sample contained fewer younger participants (18%) than the effectiveness sample (30%), and a higher proportion of individuals who were referred because of CHD risk (77%) compared to the main sample (71%). There were no significant differences between the control and intervention groups in the economic sample with regard to demographic characteristics, levels of physical activity at baseline, referral reasons, and the mean number of reported visits to health professionals in the previous six months (Additional file 1: Table S1).
The cost of the national exercise referral programme
NERS set up costs for 13 local authorities in Wales in 2006 – 08 and operational costs for 2007 – 08 based on national budget plus national and local authority additional costs (£) 1
Mean (per LA)
Physical activity specialist (0.2 WTE in yr 1, 0.6 WTE yr 2)
Line Management (0.02 WTE yrs 1&2 Grade 7)
Executive officer (0.2 WTE yr 2)
Exercise professionals training (Level 3)
Resources & printing
Pilot exercise referral project
Additional Local Authority costs
Promotion or advertising
Home working facilities
Total set up
Annual operational costs 2007-08
Physical activity specialist (0.8)
Line Management (0.02 WTE Grade 7)
Executive officers (1.2 WTE)
Exercise professionals (36 WTE)
Printing, stationary and administration
Joint national and local costs
Co-ordinator salary and on-costs (13 WTE 50% funded by WAG & LA)
Local authority costs
Total NERS annual operational cost
£1, 359, 832
Cost per participant in NERS
N or £
Participants in NERS (N)2
Participant cost in 16 week programme based on intervention group 3
All referrals July 2007 – October 2008 (12 months in study period) (N)
Participant cost in 16 week programme 3
Arithmetic mid-point between referrals and participants
Base case intervention per person cost using N above
Participants in the economic analysis who supplied service utilisation data
On an intention-to-treat basis, to estimate the cost per participant in NERS, we divided the total annual operating costs for NERS for 2007/08 (£1,359,832), by 52 (weeks), multiplied by 16 (16 week programme), then divided this figure by the three estimates of number of referrals to NERS across the participating local authorities. We report a base case ICER calculation using the mid point estimate of the cost per participant (£385, n = 3530), in addition to an upper (£579, n = 2349) and lower estimate (£285, n = 4779), (Table 1).
Leisure centre managers reported no lost revenues from providing NERS, as sessions were held at quieter times of the day, thus utilizing underused space.
Use of health services
NERS resource use and costs over 12 months by group
n = 400
n = 398
Primary Care Sector
Mean, median (min, max)
GP consultations, surgery
5.18, 4 (0, 28)
6.00, 5 (0, 46)
0.63, 0 (0, 14)
0.69, 0 (0, 20)
0.12, 0 (0, 20)
0.11, 0 (0, 10)
Practice nurse consultations
2.98, 1 (0, 29)
3.31, 2 (0, 42)
Mental Health Professionals
0.83, 0 (0, 32)
0.71, 0 (0, 53)
Other health professionals
0.65, 0 (0, 32)
1.14, 0 (0, 36)
Secondary Care Sector
2.00, 1 (0, 22)
2.09, 1 (0, 26)
0.87, 0 (0, 42)
0.61, 0 (0, 24)
1.59, 0 (0, 52)
1.66, 0 (0, 48)
Other health professionals seen
0.68, 0 (0, 78)
0.35, 0 (0, 26)
0.32, 0 (0, 18)
0.30, 0 (0, 15)
Inpatient hospital days (all causes)
0.97, 0 (0, 96)
1.05, 0 (0, 32)
Type of Cost 2
(95% CI bootstrapped)
NHS primary care sector
All GP consultation (subtotal)
-29 (-59, -0.3)
Practice nurse consultations
Mental health professional
Other health professionals
Total primary care consultations
-36. 5 (-92, 16)
Primary care prescribing
Total primary care
-76 (-167, 14)
NHS secondary sector
-9 (-51, 33)
11 (-2, 24)
-3 (-31, 26)
Other hospital attendances
38 (-12, 89)
Inpatient hospital days (all causes)
-37 (-246, 210)
2 (-10, 16)
-28 (-64, 7)*
Total secondary care
45 (-208, 351)
TOTAL NHS COST
-58. 4 (-361, 301)
Base case NERS Intervention cost
2 session/week for 16 week
TOTAL NHS, WAG and LOCAL AUTHORITY COST
326 (-2, 660)
Adherence to NERS
Mean effectiveness outcomes by group over 12 months
Outcomes at 12 month follow-up
**EQ5D score (0-1)
0.64 (0.32) n=395
0.61 (0.32) n=391
Exercise per week
305.96 min (386.5) n=298
305.8 min (393.3) n=279
Did not attend
Attended <16 wks
Attended 16 wks
Level of adherence to NERS by variable
Did not attend
Participants’ willingness to pay for exercise classes
At 12 month follow-up, 55% completed the willingness to pay question (n = 441). The amount people were willing to pay was £2.16 (SD £1.50) for those in the intervention group compared with £2.38 (SD £1.78) in the control. This had fallen from the baseline figure of £2.43 (SD £1.67) compared with £2.55 (SD £2.49) in the control (81% response, n = 648). There was a difference in willingness to pay (WTP) depending upon whether people lived in an area of low or high deprivation as measured by the WIMD. At 12 month follow-up people from areas of high deprivation were WTP £1.91 (SD £0.88) compared with £2.05 for those from areas of low deprivation. Similarly, in the control group people were willing to pay £2.09 (SD £1.53) and £2.32 (SD £1.78), respectively. In all groups people valued the intervention more highly if they were in the control group. When considering the WTP by employment status then students were willing to pay the most per session and those seeking work the least.
Results of cost-utility analysis
Incremental cost (£)
ICER point estimate (£) (Bootstrapped one sided 95% CI for ICER (£))
Probability intervention is cost-effective at £20,000 per QALY (%)
Probability intervention is cost-effective at £30,000 per QALY (%)
Cost of intervention £385
EQ-5D at 6 months as estimate of baseline
Control group mean EQ-5D at 6 months as estimate of baseline
Participant payment of £1 per session
Participant payment of £2 per session
Mental health and CHD plus mental health
Adherence to NERS
When EQ-5D,  data at 6 months was used as an estimate of baseline EQ-5D scores, the difference in QALY gain between the intervention and control groups was 0.054, resulting in a decrease in ICER estimate from £12,111 to £6,056. Using the control group mean EQ-5D,  score at 6 months as an estimate of baseline values for both intervention and control groups, produced a QALY difference of 0.046 and an ICER point estimate of £7,109. Probabilistic sensitivity analyses demonstrated that alternative methods of QALY calculation resulted in higher probabilities of NERS being cost-effective compared to our base case, which can be considered conservative (Table 4).
Pragmatic sensitivity analyses were conducted to compare referrals to NERS by a GP or a nurse. When all patients were referred by a GP this resulted in a higher ICER (£13,444) compared to referral by nurse (£12,667) or 50-50% by GP and nurse (£13,074) (probability of being cost-effective was 72%,76% and 75% respectively at £20,000 threshold; and 87%, 89% and 88% respectively at £30,000 threshold). When participant payments of £1 and £2 per session were considered in the cost-utility analysis, the cost per QALY fell from £12,111 to £10,926 and £9,741, respectively. The probability of NERS being cost-effective at £30,000 per QALY increased from 89% to 91% and 92%, with the £1 and £2 per session participants’ contributions (Table 4).
Since the participant sample used in our cost-utility analysis was heterogeneous with relation to age (16–88 years), gender, reason for referral and adherence to NERS, a range of subgroup analyses were conducted to identify population groups which would most benefit from joining the NERS Scheme (Table 4). The cost-effectiveness acceptability curves (CEACs), (Figure 1C-F) demonstrated NERS is more likely to be cost-effective in younger participants (<44 years) than in older individuals. Participants with a mental health risk factor alone or in combination with a risk of chronic heart disease were characterized by a lower ICER (£10,276) compared to participants at risk of chronic heart disease only (£13,060). Subgroup analysis by gender, gave a significantly lower ICER for women (£9,006) than for men (£38,333). Pronounced differences in ICER were found between fully adherent participants and those attending fewer than 16 sessions (Table 4). For participants adhering to NERS, the analysis resulted in a net saving of £18 per patient per year. The probability that NERS is cost-effective in adherent participants was 100% at £20,000 (Figure 1).
The main trial effectiveness findings  demonstrated that the NERS was effective in increasing weekly exercise and improved self-reported mental health at 12 months as compared to the control group. A larger effect was found for women versus men and for persons who completed the 16 week programme, as compared with those who were non-adherent. Results of cost-effectiveness analyses suggest that NERS is likely to be cost saving in fully adherent participants . Our base case analysis and sensitivity analyses, we see that the ICER for NERS under different assumptions falls largely below a payer threshold of £20-30,000. However we recognize the need for caution in interpretation of ICERs which have an upper 95% confidence limit above £20,000 (Table 4). From a methodological viewpoint, the NERS trial shows the benefits of incorporating subgroup analysis and analysis of how public health interventions may impact on inequalities in health through i.e. differing uptake and effects by women and men, and differing willingness to pay by areas of socioeconomic deprivation. Our conservative base case analysis is robust to a range of sensitivity analyses, leading to the conclusion that NERS is likely to be cost-effective, under the £20,000 to £30,000 threshold (89% probability at £30,000).
Decisions based on average measures of cost-effectiveness carry a risk of overlooking potential benefits for a given subset of the population. In the current climate of limited health care resources, there is a clear necessity to maximise population health by delivering healthcare interventions to those recipients who would most benefit, . The proposed ways to account for heterogenity between population groups included: reporting ICER estimates for different subgroups, incorporating covariate adjustment in cost-effectiveness analysis, and using alternative cost-effectiveness indicators, [20–24]. Our analysis revealed wide variations in ICERs between subgroups.
Our analysis shows that adherence to exercise was greater in those areas of high deprivation as measured by the WIMD, . We also found that those people living in areas of high deprivation placed a higher value on NERS than those living in areas of lower socioeconomic deprivation. Our study goes some way to address current thinking in public health economics about the need to consider equity implications of access and uptake, in addition to cost-effectiveness, .
Comparison with other literature
Economic evaluation of exercise referral schemes involving inactive adults in primary care have been conducted as a part of the NIHR Health Technology Assessment programme, . The base-case cost-effectiveness analysis of NERS in Wales generated comparable data with previous reports, [6–9, 25] demonstrating that the exercise referral schemes may be cost-effective under the £30,000 per QALY threshold. However, lifetime modelling exercises indicate a greater uncertainty of the long term cost-effectiveness of such programmes, . Our study suggests that NERS would be also be cost-effective in individuals at risk of CHD and mental health issues, as well as in individuals aged 60 years and over. The NERS may be cost-saving assuming full adherence to the programme.
Strengths and limitations
There have been few rigorous prospective economic studies alongside RCTs of exercise referral interventions. Results of the NERS trial, as a pragmatic policy evaluation, are likely to have high external validity and generalisabilty, . Full details of the methodological design of the NERS trial and its acknowledged limitations are published elsewhere, [11, 12]. The NERS trial set out to explore the potential effectiveness and cost effectiveness of a national exercise referral scheme, integrating motivational interviewing, and making use of existing leisure centres. The NERS trial took a pragmatic approach, in that it was powered to show a difference in reported exercise at 12 months, by telephone, using 7D-PAR, a well validated measure, rather than focussing on load i.e. exercise type, or intensity. The NERS trial did focus on patients with CHD risk factors, mental health problems or both, but did not specify exercise type. Indeed the exercise was tailored, and this tailoring may explain the relatively high adherence rate to the programme. The NERS trial differs from published trials of specific exercise programmes for people with specific diagnoses, and hence economic evaluation of the NERS trial in terms of cost-utility analysis differs from cost-utility analyses of specific exercise programmes for people with specific diagnoses, . The trial specifically recruited patients with CHD risk factors, mental health problems or both conditions. The trial found that NERS was effective in increasing physical activity among those referred with CHD risk factors. Although there was no increase in physical activity among those referred for mental health reasons, anxiety and depression were reduced. These effects were highly dependent on adherence to the programme. To these results , this paper adds cost per QALY estimates for NERS, for comparison with payer thresholds, such as that of NICE, and for comparison with those of other large, community based ERS, . The NERS trial allowed a fully integrated economic evaluation which took a wide perspective, measuring costs and benefits to the WG, local authority leisure centres as well as the NHS. To reiterate, the methodological design of the NERS trial was more about achieving external validity in terms of policy evaluation at a macro level, than about micro level evaluation of a specific exercise programme for a specific diagnosis or patient group, in a sports science context.
A limitation of our study was that baseline EQ-5D,  data was not available. However, on the small set of baseline measures which were taken, activity level, service use over the preceding 6 months, age and gender, the intervention and control groups were similar. Our economic analysis was based on a smaller number of participants, because not all participants completed the economic questionnaires. We acknowledge that using a smaller number of participants in subgroup analysis increases statistical uncertainty. Reported ICER point estimates have a rather explorative value and require further verification.
We cannot extrapolate beyond the 12 month follow up period of the trial which is a limitation common to many trials of public health interventions. A future modeling exercise may help address the question of whether such an exercise intervention could have longer term benefits.
The effectiveness and economic results of the NERS trial suggest that age, gender and adherence all have an important part to play in affecting weekly exercise behaviour and self reported, health related quality of life. Weatherly et al. (2009),  have stressed the need for economic evaluations of public health interventions to examine equity considerations. Our results indicate that people living in areas of higher deprivation who were offered NERS were likely to adhere to the complete programme, although more research would be needed to investigate if this was maintained in the long-term.
Though full adherence to NERS (62%) was higher for the economics sample than the main sample (44%), our base case analysis over a 12 month follow up period, is robust to a range of sensitivity analyses. ICERs were well below the NICE threshold of £20-30,000, though upper 95% confidence limits cross this boundary, indicating the need for caution in the interpretation of results. There is evidence for confidence that NERS is likely to be cost saving in fully adherent participants, leading to the overall conclusion that NERS can be cost-effective.
We thank all participants of the NERS programme and the staff at the local authorities who participated in the study. We thank the scheme’s coordinators, Elaine McNish and Jeannie Wyatt-Williams, and Janine Hale and Chris Roberts of the Welsh Government for providing cost information and on going support to facilitate this study. We thank Alison Shaw for clerical support, Carys Jones who helped with prescribing costs and Joanna Charles for assisting with the preparation of the manuscript. The research was independent and funded by the Welsh Assembly Government. RTE is supported by Public Health Wales. Additional support for LM and SM during write up was provided by The Centre for the Development and Evaluation of Complex Interventions for Public Health Improvement (DECIPHer), a UKCRC Public Health Research: Centre of Excellence. Funding from the British Heart Foundation, Cancer Research UK, Economic and Social Research Council (RES-590-28-0005), Medical Research Council, the Welsh Assembly Government and the Wellcome Trust (WT087640MA), under the auspices of the UK Clinical Research Collaboration, is gratefully acknowledged.
- Wanless D: Securing Good Health for the Whole Population Final Report. http://webarchive.nationalarchives.gov.uk/+/http:/www.hmtreasury.gov.uk/media/D/3/Wanless04_summary.pdf,
- Kelly MP, McDaid D, Ludbrook A, Powell J: Economic appraisal of public health interventions. http://www.nice.org.uk/nicemedia/documents/Economic_appraisal_of_public_health_interventions.pdf,
- Weatherly H, Drummond M, Claxton K, Cookson R, Ferguson B, Godfrey C, Rice N, Sculpher M, Sowden A: Methods for assessing the cost-effectiveness of public health interventions: key challenges and recommendations. Health Policy. 2009, 23: 1-8.Google Scholar
- Medical Research Council (MRC): Developing and evaluating complex interventions: new guidance. http://www.mrc.ac.uk/Utilities/Documentrecord/index.htm?d=MRC004871,
- Payne C, McAllister M, Davies LM: Valuing the economic benefits of complex interventions when maximising health is not sufficient. Health Econ. 2012, doi:10.1002/hec.2795 [Online First]Google Scholar
- Cobiac LJ, Vos T, Barendregt JJ: Cost-effectiveness of interventions to promote physical activity: a modelling study. PLoS Med. 2009, 14: e1000110-doi:10.1371/journal.pmed.1000110 [Online First]View ArticleGoogle Scholar
- Matrix: NICE Rapid review of the economic evidence of physical activity interventions. http://www.nice.org.uk/nicemedia/pdf/Physical_Activity_Economic_Review_April2006.pdf,
- Pavey TG, Anokye N, Taylor AH, Trueman P, Moxham T, Fox KR, Hillsdon M, Green C, Campbell JL, Foster C, Mutrie N, Searle J, Taylor RS: The clinical effectiveness and cost-effectiveness of exercise referral schemes: a systematic review and economic evaluation. Health Technol Assess. 2011, 15: 1-254.View ArticleGoogle Scholar
- Munro JF, Nicholl JP, Brazier JE, Davey R, Cochrane T: Cost effectiveness of a community based exercise programme in over 65 year olds: cluster randomised trial. J Epidemiol Community Health. 2004, 58: 1004-1010. 10.1136/jech.2003.014225.View ArticlePubMedPubMed CentralGoogle Scholar
- Owen L, Morgan A, Fischer A, Ellis S, Hoy A, Kelly MP: The cost effectiveness of public health interventions. J Public Health. 2012, 34: 37-45. 10.1093/pubmed/fdr075.View ArticleGoogle Scholar
- Murphy S, Raisanen L, Moore G, Edwards RT, Linck P, Williams N, Din NU, Hale J, Roberts C, McNaish E, Moore L: A pragmatic randomised controlled trial of the Welsh National Exercise Referral Scheme: protocol for trial and integrated economic and process evaluation. BMC Public Health. 2010, 10: 352-10.1186/1471-2458-10-352.View ArticlePubMedPubMed CentralGoogle Scholar
- Murphy SM, Edwards RT, Williams N, Raisanen L, Moore G, Linck P, Hounsome N, Din NU, Moore L: An evaluation of the effectiveness and cost effectiveness of the National Exercise Referral Scheme in Wales, UK: a randomised controlled trial of a public health policy initiative. J Epidemiol Community Health. 2012, 66: 745-753. 10.1136/jech-2011-200689.View ArticlePubMedPubMed CentralGoogle Scholar
- Knapp M, Beecham J: Costing mental health services: the client service receipt inventory. Psychol Med. 1990, 20: 893-908. 10.1017/S003329170003659X.View ArticlePubMedGoogle Scholar
- EuroQol: User Guide version 2. http://www.euroqol.org/fileadmin/user_upload/Documenten/PDF/Folders_Flyers/EQ-5D-3L_UserGuide_2013_v5.0_October_2013.pdf,
- Department of Health NHS Reference Costs. 2007, http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_098945, –08,
- Curtis L: Unit Costs of Health and Social Care. 2009, http://www.pssru.ac.uk/uc/uc2008contents.htm,Google Scholar
- NHS Information Centre Prescribing Cost Analysis 2008 England. 2008, http://www.ic.nhs.uk/statistics-and-data-collections/primary-care/prescriptions/prescription-cost-analysis-2008,
- Edwards RT, Hounsome B, Linck P, Russell IT: Economic evaluation alongside pragmatic randomised trials: developing a Standard Operating Procedure for clinical trials units. Trials. 2008, 14: 64-65.View ArticleGoogle Scholar
- Wales Index of Multiple Deprivation (WIMD). 2008, http://wales.gov.uk/topics/statistics/publications/wimd08la/?lang=en,
- Sculpher M: Subgroups and heterogeneity in cost-effectiveness analysis. Pharmacoeconomics. 2008, 26: 799-806. 10.2165/00019053-200826090-00009.View ArticlePubMedGoogle Scholar
- Willan AR: On the probability of cost-effectiveness using data from randomized clinical trials. BMC Med Res Methodol. 2001, 1: 8-10.1186/1471-2288-1-8.View ArticlePubMedPubMed CentralGoogle Scholar
- Nixon RM, Thompson SG: Methods for incorporating covariate adjustment, subgroup analysis and between-centre differences into cost-effectiveness evaluations. Health Econ. 2005, 14: 1217-1229. 10.1002/hec.1008.View ArticlePubMedGoogle Scholar
- Ioannidis JPA, Garber AM: Individualized cost-effectiveness analysis. PLoS Med. 2011, 8: e1001058-10.1371/journal.pmed.1001058. doi:10.1371/journal.pmed.1001058 [Online First]View ArticlePubMedPubMed CentralGoogle Scholar
- Espinoza M, Manca A, Claxton K, Sculpher MJ: The value of heterogeneity for cost-effectiveness subgroup analysis: theoretical framework and application. Value Health. 2011, 14: A241-View ArticleGoogle Scholar
- Garrett S, Elley CR, Rose SB, O’Dea D, Lawton BA: Are physical activity interventions in primary care and the community cost-effective? A systematic review of the evidence. Br J Gen Pract. 2011, 61: e125-e133. 10.3399/bjgp11X561249.View ArticlePubMedPubMed CentralGoogle Scholar
- Anokye NK, Trueman P, Green C, Pavey TG, Hillsdon M, Taylor RS: The cost-effectiveness of exercise referral schemes. BMC Public Health. 2011, 11: 954-10.1186/1471-2458-11-954.View ArticlePubMedPubMed CentralGoogle Scholar
- Green LW, Glasgow RE: Evaluating the relevance, generalization, and applicability of research issues in external validation and translation methodology. Evaluation and the Health Professions. 2006, 29: 126-153. 10.1177/0163278705284445.View ArticlePubMedGoogle Scholar
- Gusi N, Tomas-Carus P: Cost-utility of an 8-month aquatic training for women with fibromyalgia: a randomized controlled trial. Arthritis Res Ther. 2008, 10: R24-10.1186/ar2377.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/13/1021/prepub
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.