- Study protocol
- Open Access
- Open Peer Review
Effectiveness and cost-effectiveness of a physical activity loyalty scheme for behaviour change maintenance: a cluster randomised controlled trial
© The Author(s). 2016
- Received: 12 June 2016
- Accepted: 29 June 2016
- Published: 22 July 2016
Increasing physical activity in the workplace can provide employee physical and mental health benefits, and employer economic benefits through reduced absenteeism and increased productivity. The workplace is an opportune setting to encourage habitual activity. However, there is limited evidence on effective behaviour change interventions that lead to maintained physical activity. This study aims to address this gap and help build the necessary evidence base for effective, and cost-effective, workplace interventions.
This cluster randomised control trial will recruit 776 office-based employees from public sector organisations in Belfast and Lisburn city centres, Northern Ireland. Participants will be randomly allocated by cluster to either the Intervention Group or Control Group (waiting list control). The 6-month intervention consists of rewards (retail vouchers, based on similar principles to high street loyalty cards), feedback and other evidence-based behaviour change techniques. Sensors situated in the vicinity of participating workplaces will promote and monitor minutes of physical activity undertaken by participants. Both groups will complete all outcome measures. The primary outcome is steps per day recorded using a pedometer (Yamax Digiwalker CW-701) for 7 consecutive days at baseline, 6, 12 and 18 months. Secondary outcomes include health, mental wellbeing, quality of life, work absenteeism and presenteeism, and use of healthcare resources. Process measures will assess intervention “dose”, website usage, and intervention fidelity. An economic evaluation will be conducted from the National Health Service, employer and retailer perspective using both a cost-utility and cost-effectiveness framework. The inclusion of a discrete choice experiment will further generate values for a cost-benefit analysis. Participant focus groups will explore who the intervention worked for and why, and interviews with retailers will elucidate their views on the sustainability of a public health focused loyalty card scheme.
The study is designed to maximise the potential for roll-out in similar settings, by engaging the public sector and business community in designing and delivering the intervention. We have developed a sustainable business model using a ‘points’ based loyalty platform, whereby local businesses ‘sponsor’ the incentive (retail vouchers) in return for increased footfall to their business.
ISRCTN17975376 (Registered 19/09/2014).
- Physical activity
- Cluster RCT
- Behaviour change maintenance
- Financial incentives
- Economic evaluation
- Behavioural economics
- Mediation analyses
The current global physical inactivity ‘pandemic’  requires a determined, innovative response with a particular emphasis on behaviour change maintenance in light of the modest, short term results of interventions to date [2–4]. Interventions in the workplace have the potential to contribute significantly to the formation of behaviour change maintenance . However, there has been an expansion of sedentary occupations, with less than 1 % of adults in Northern Ireland doing at least 10 min of physical activity at work per week . As well as benefitting the physical and mental health of employees, workplace physical activity interventions have the potential to benefit the organisation, through reduced absenteeism and increased productivity; and the wider economy as a whole by keeping people economically active for longer . If such improvements to health are realised, they could lead to lower healthcare utilisation and costs . The costs of lost productivity are estimated to be £5.5 billion a year from sickness absence and £1 billion a year from the premature death of people of working age .
Indeed, recent NICE guidelines recommend the promotion of physical activity in and around the workplace, particularly through walking and cycling . However, current evidence to support the effectiveness of such interventions is mixed , with reviews [10–12] calling for more robust research on workplace interventions and well-designed RCTs. Previous meta-analyses of workplace physical activity interventions have shown small, positive, short term effects [10–12] on levels of walking but little long term effectiveness is evident . Thus there is a recognised need to develop workplace interventions purposefully designed to encourage physical activity behaviour change maintenance.
The UK and US Governments [13, 14] have encouraged the use of incentives for promoting healthy lifestyles. The use of financial incentives for health-related behaviour change has been met with some scepticism , although their acceptability may be contingent on various factors, such as their effectiveness, type, and the target behaviour . There is evidence to support the use of financial incentives for the initiation of behaviour change, for example, smoking, substance abuse [17–20]. Further, recent research has demonstrated evidence of financial incentives for single, one-off heath behaviours, such as vaccinations , and encouragingly, habitual health-related behaviour change . However, the evidence for their effect on other health behaviours is sparse. Some financial  and non-financial incentives  have been shown to increase levels of physical activity, at least in the short-term and mainly with respect to structured exercise programmes , rather than free-living physical activity. There is a wealth of evidence on reinforcement of behaviour that shows that whilst incentives may be effective at changing behaviour, the effects are unlikely to be maintained when the incentives are withdrawn in the absence of other interventions . Therefore, financial incentives alone may not be sufficient to promote maintained physical activity behaviour change, but may do so when embedded within an evidence-based, theoretically-driven intervention . Further, financial incentive interventions designed using behavioural economic concepts have been shown to be effective for changing behaviour . There is also limited evidence around the cost-effectiveness of interventions to promote physical activity in the workplace [25, 26], or indeed the cost-effectiveness of financial incentive-based interventions . Therefore, to address such gaps in the evidence base and following the successful completion of a pilot study , we aim to conduct a cluster RCT of a complex intervention incorporating financial incentives to encourage physical activity and maintained behaviour change.
To investigate the effectiveness of the intervention to increase employee’s physical activity levels;
To investigate if any change in physical activity behaviour is maintained over time;
To conduct cost-effectiveness, cost-utility and cost-benefit analyses of the intervention;
To investigate how the intervention impacts on other health behaviours and outcomes;
To investigate wider work-related effects including sickness absenteeism and work presenteeism;
To investigate the mediators of (a) uptake and use of the loyalty card, (b) initiation, and (c) maintenance of behaviour change;
To conduct a parallel qualitative study to further identify those who benefitted from the intervention, how and why it worked for them, and explore mediators of behaviour change;
To conduct a Discrete Choice Experiment (DCE) to investigate the possible effective levels of incentives for such interventions;
To conduct a behavioural economic field experiment on inter-temporal and risk preferences to investigate the relationship between behavioural change, discounting and financial incentives.
A workplace-based cluster RCT will evaluate the intervention, incorporating nested behavioural economic experiments, and process evaluation. The study protocol is developed using the MRC framework for complex interventions  and SPIRIT guidelines  and was successfully tested in a pilot study .
Recruitment of workplaces
The study will target public sector employees involved in predominantly office-based occupations whose workplace is within Belfast or Lisburn City Centres, Northern Ireland. People in predominantly office-based jobs spend a large proportion of their day physically inactive while public sector organisations have been reported to have higher sickness absence rates than private sector workplaces [7, 30, 31]. Public sector organisations will be purposively sampled within 2 km radius of the city centre or offer similar physical activity opportunities within a 2 km radius of their location, have a minimum of 100 employees in predominantly office-based occupations, and have similar opportunities for physical activity in the vicinity of the workplace. Meetings will be held with senior management of these organisations to explain the purpose of the study and the practicalities involved if the study were to be implemented within the organisation.
Recruitment of participants
Recruitment methods will include email invitation to employees and posters placed around each workplace advertising the study. Emails and posters will include the website address and a web-link will be added to the organisations’ intranet sites (previously tested in our pilot study ). Potential participants will be able to access further information (including the Participant Information Sheet) and register their interest to participate on the study website.
Potential participants will be asked to complete a screening questionnaire via the study website or by telephone, to confirm their eligibility, based on the following inclusion criteria: based at recruited worksite at least 4 h/day (within core hours of 8 am-6 pm) on at least 3 days/week; current contract lasts for duration of the study (i.e.18 months) (to exclude temporary workers); access to internet at work; able to give informed consent; able to communicate in English; no self-reported recent history of myocardial infarction or stroke or physical limitations that would limit ability to participate in physical activity (assessed using the Physical Activity Readiness Questionnaire) .
All participants who meet the eligibility criteria and consent to participate will be contacted by a member of the research team by telephone or email to complete the baseline assessment. Following this, clusters of participants will be randomised to the Intervention or Control Group using computer generated random numbers. Clusters have been defined as the smallest organisational unit (e.g. a department or office/floor) within each participating workplace.
A random allocation sequence will be drawn up by the trial statistician and group allocation placed in sequentially numbered, sealed opaque envelopes. Group allocation will be stratified to ensure similar numbers of clusters in the Intervention and Control Groups in each participating organisation.
To tailor the intervention, a purposive sample of employees (both men and women across a range of ages) will participate in three focus groups (maximum 10/group) prior to the intervention to explore aspects such as the availability of, and preferences for opportunities for physical activity proximal to the workplace. Sensor locations will be determined from the feedback received in the focus groups regarding popular walking routes. Employees’ opinions on the website interface and the rewards redemption function, for example, will also be considered. To determine incentive levels we will use stated preferences of the participants from the DCEs to assess their mean Willingness to Accept (WTA), Willingness to Pay (WTP) and the trade-offs they would make for the attributes  of the incentive programme, prior to the intervention. This information will help us determine the level of the rewards available for earned ‘points’ (further detail below).
In addition to the financial incentive element, the intervention has several other components designed to enhance the effectiveness of the incentives as advocated by Marteau et al. . These components are delivered via the study website and designed to have multiple effects: (a) to increase usage of the study website, (b) as effective Behaviour Change Techniques (BCTs) in their own right, and (c) as techniques designed to aid the transition from more extrinsically motivated behaviour to more intrinsically motivated habitual behaviour. The techniques include the provision of regular tailored motivational emails, tailored feedback, information on walking routes in the vicinity of the participating workplaces and links to other resources such as physical activity advice and healthy eating guidelines. It also includes self-regulation techniques of goal setting, self-monitoring, and prompts to behaviour .
Underpinning theoretical framework
Those assigned to the waiting-list control condition (n = 388) will be offered the opportunity to participate in the intervention after the 18-month follow-up period. Participants in this group will complete outcome measures at the same time ‘points’ as the Intervention Group.
All outcome measures will be analysed and, where required, collected by a Postdoctoral Research Fellow (PDRF) blinded to group allocation. Self-reported outcome measures will be collected at baseline, 6 months and 18 months (unless otherwise stated), via online questionnaires distributed by email and automatically collated via Qualtrics (www.Qualtrics.com) (successfully employed in our pilot trial ).
The primary outcome is mean steps/day objectively measured by a sealed pedometer (to blind participants to the output) worn on the waistband (Yamax Digiwalker CW-701, Japan), for which reliability and validity has been established [39–41]. Participants will wear the pedometer for 7 consecutive days, complete a wear time diary, and the Global Physical Activity Questionnaire (GPAQ) to elucidate the context of activity undertaken . These measures will be collected at baseline, 6 (immediately post-intervention), 12 (6 months post-intervention) and 18 months (1 year post-intervention). This schedule ensures that we can account for the impact of seasonality of physical activity behaviours on the intervention effect.
Health and wellbeing
Secondary outcome measures of health (Short Form-8 (SF-8)) , Quality of Life (EQ-5D-5 L) [44–46], and well-being (Warwick-Edinburgh Mental Wellbeing Scale (WEMWBS)) [47, 48], are included. Items from the SF-8 questionnaire can be derived to give an indication of both physical and mental health. The WEMWBS comprises 14 positively worded statements, where scores are summed with higher scores indicating greater mental well-being. The EQ-5D-5 L questionnaire is a health state utility measure based on five dimensions of mobility, self-care, usual activities, pain/discomfort, and anxiety/depression, and a visual analogue scale (0–100) EQ-5D-5 L index-based values (utilities) derived from a crosswalk study are then applied to the EQ-5D-5 L levels to translate changes in health states to Quality Adjusted Life Years (QALYs) for use in cost-utility analysis .
Specific questions from the WHO Health and Work Performance Questionnaire  will be used to measure work presenteeism (measurable extent to which physical or psycho-social symptoms and conditions adversely affect the work productivity of those in work ). This validated method comprises three questions with answers on an 11-point Likert scale asking participants to rate their job performance levels, and has been demonstrated to be sensitive for detecting change following a physical activity intervention . Work absenteeism will be measured by asking participants to state the number of day’s sick leave in the past 6 months and will be verified objectively by each organisations’ Human Resource Department where possible.
We will collect data that are hypothesised to mediate loyalty scheme use, initiation (4 weeks) and maintenance of physical activity behaviour (6 months post-baseline). It is hypothesised that change in mediators should be apparent at 4–6 weeks and that mediators of early behaviour change are distinct from those affecting maintenance [52–54]. These theoretical constructs and associated outcome measures have been informed from the mapping of BCT’s from the pilot study and evidence from the relevant literature on behavioural initiation and maintenance [55–60]. Common core theoretical constructs of behaviour change including outcome expectancy , self-efficacy  and intention , motivation, financial motivation, planning, subjective norms, stated WTP and WTA derived from the DCEs, will be collected at baseline and 4 weeks to assess incentives to initiate behaviour change. Subjective social network data will be collected by work colleague nominations, with participants asked to nominate up to five colleagues that they usually socialise with and would also partake in physical activity with at baseline and, 6 and 18-months follow-up. Furthermore, social networks will be inferred when user’s keyfobs are “sensed” at sensors placed at physical activity opportunities in the vicinity of participating workplaces . Perceptions of workplace environment  and objective measures of the workplace environment using Geographical Information Systems (GIS) data including walkability , street connectivity, access to physical activity opportunities (shops, parks, leisure facilities, train/bus stations) will be measured  at baseline. Other measures of web engagement, confidence in using the internet and loyalty scheme usage which may mediate intervention “dose”  and therefore behaviour change have been included.
To assess mediators of behaviour change maintenance, habit using the Self-Report Habit Index , recovery and maintenance self-efficacy , social norms , satisfaction with outcome expectancies , motivation, planning and social support, stated WTP and WTA, will be captured at baseline and 6 months. Data on inter-temporal and risk preferences will be collected at 6 months only (immediate post-intervention). In addition, subjective social network data will be collected at 6 and 18 months.
To assess the impact of the intervention on compensatory behaviours, data on smoking, alcohol and short Food Frequency Questionnaire (FFQ)  will be collected.
The primary economic evaluation will take the form of a within trial cost-utility and cost-effectiveness analysis, with health outcomes expressed in terms of Quality-adjusted Life Years (QALYs). Changes in health-related Quality of Life (as expressed using QALYs using EQ-5D data) will be measured from the participant’s perspective. Utilisation of healthcare resources will be captured using a specially devised online health and social care resource use data collection form. Intervention costs will be obtained using a modified template , explicitly discriminating between intervention and research costs.
Revealed preferences  and stated preferences (i.e. DCE ) questions will be used to gain information on the optimal level of financial incentives necessary to trigger behaviour change. Revealed preferences questions will investigate the current amount of time participants spend on activities including sleeping, leisure, work, transportation, home, physical activity and sedentary activity. The key behavioural decisions in this model are the distinct but related decisions to participate in physical activity and duration of each session of activity . We will then investigate how participants’ wages, hours worked, fixed costs of physical activity (e.g. gym membership fees), and variable costs of physical activity, affect the amount of time participants spend doing physical activity [77, 78] to assess how income and substitution effects affect physical activity. Stated preferences questions and DCE questions will investigate participants’ WTA for physical activity, and the rate of trade-offs between physical activity, other time-related activities and money  to estimate the optimal mean level of the financial incentives that would trigger behaviour change. Information on participants’ discount rates WTA for behaviour change, and behaviour change rates will provide an understanding on how the incentive alters the costs and benefits of this healthy behaviour and why it successfully results in changed behaviour in some participants and not others.
After the intervention (at 6 months), a random sample of 200 participants will participate in a behavioural economic field experiment aimed at eliciting individuals’ inter-temporal preferences and discount rates to identify participants who exhibit exponential discounting, hyperbolic discounting or quasi-hyperbolic discounting . This will help us investigate whether there is a relationship between behaviour change, discounting, and financial incentives. Briefly, the behavioural economic field experiment will be conducted in maximum groups of 20 participants during lunchtimes. Participants will be offered a £20 gift voucher for taking part in the behavioural economic field experiment. Participants will face several dichotomous decision tasks, such as a risk preference choice task and a monetary discount rate choice task. After the choice tasks, the participant will randomly select the choice occasion and the alternative that will count for payment, and will throw a 10-sided die to determine whether the final payment will take place.
Evaluation will employ a triangulated design using both quantitative and qualitative data. The process evaluation is concerned with five core research questions: i) What was participants’ exposure to the intervention? ii) To what extent was the intervention implemented across the participating organisations? iii) How, for whom and under what circumstances does the intervention bring about behaviour change? iv) How, for whom and under what circumstances does the intervention maintain behaviour change?; (v) Whether there were any unintended consequences of the intervention. The process evaluation will encompass the following:
A recording of current health improvement programmes and policies in each participating organisation will be collected throughout the duration of the study period. This will be supplemented by environmental measures, (such as distance to the nearest green space and neighbourhood walkability) and free car parking at work collected at baseline, which will assess the extent of physical activity opportunities for each participating organisation.
Intervention fidelity and “dose”
Fidelity of the intervention will be supported by the use of standardised training manuals and training sessions for those assisting with intervention delivery which includes the collection of the primary outcome data (pedometers) and all email communication with participants. They will be asked to keep a daily record of any problems with implementation using a customised proforma, and report to the project manager on a weekly basis throughout the 6-month intervention period. The research team will assess delivery fidelity using a quality assurance form. Weekly feedback on fidelity will be given to those involved in the delivery of the intervention to assist standardisation and completeness. Establishing intervention “dose” will draw on data regarding PAL scheme usage (minutes of physical activity/week recorded) and website exposure (e.g. frequency of visits; number of hits; number of visitors that accessed specific website content; mean duration of visits). These data will automatically be collected throughout the 6-month intervention. Extent of internet use will be assessed by asking participants how many hours per week on average they spend on the internet and to rate their confidence on using the internet on a 10-point likert scale . In addition, information on those who redeemed their ‘points’ for rewards and who subsequently reimbursed their rewards at nominated retailers will be collected. Compliance with the intervention will be monitored via the PAL scheme usage data, objectively recorded using the tracking system, and the use of the web resources as outlined above.
Participation and reach
Participation will be assessed by collating the actual number of participants recruited versus the number invited to participate. Reach will be assessed by investigating the representativeness of study participants in regards to gender, age, ethnicity, socio-economic position (SEP) (compared to aggregate demographics of workforce in participating departments).
We will assess the experiences of participation, aspects of acceptability for those who engaged versus those who didn’t, and any barriers or facilitators to this. This will draw on exit questionnaires completed at 6 months to assess level of engagement and focus groups at 6 months (n = 5) which will explore their experiences of the intervention and determine the types of participants who benefitted from the intervention, how and why it worked for them. We will purposively sample participants (maximum n = 10/group) to ensure a representative sample, including those actively engaged in the intervention and those not (i.e. dropped out) are recruited. Focus groups will be repeated at 18 months to ascertain the views of those who have maintained behaviour change and those who have not, and why. A schedule of open-ended questions will be used to elicit information about reactions to the intervention; barriers to physical activity and; suggestions for future roll-out of the intervention if proven effective. The final focus group will seek confirmation of the results from the previous focus groups via triangulation of the data. Semi-structured interviews with senior managers of participating employers (n = 7) and participating retailers (n = 5) will be used to explore their perceptions of being involved in the study.
All data will be interpreted in the context of the RE-AIM framework .
This will ensure that we have a clearer understanding of the Reach, Effectiveness, Adoption, Implementation and Maintenance. This framework allows concurrent evaluation of dimensions considered relevant to ‘real world’ implementation, such as the capacity to reach target population and to change physical activity. In particular, we will examine differences across social groups and whether the intervention has impacted on inequalities in physical activity participation in the study population.
For the primary analysis, mean steps per day at 6 months will be the dependent variable. A random intercept will be fitted at the cluster level (all other variables will be fixed effects), with group, organisation (in categories), and baseline mean steps per day added to the model (Objective 1). The main focus for the analysis will be the estimated coefficient representing the difference in mean steps per day between the Intervention and Control Group, adjusted for baseline differences. The model will then be extended through the inclusion of interactions involving group and relevant covariates to test for any differential effects of the intervention (e.g. age, sex, SEP, time discounting function). In light of the multiple testing involved, these subgroup analyses will be cautiously reported as hypothesis generating rather than confirmatory.
The primary analysis will then be repeated using 18-month follow-up data to investigate the effectiveness of the intervention for behaviour change maintenance (Objective 2). These analyses will be repeated with secondary health and wellbeing outcomes, and work-related outcomes (Objective 4 and 5). Further, sensitivity analyses will assess the impact of missing data using Multiple Imputation by Chained Equations (MICE), testing first whether missingness-at-random is plausible .
Mediation analyses of early behaviour change (uptake and initiation) (4 weeks) and behaviour change maintenance (6 months from start of intervention and 12 months from cessation of intervention) will be conducted (Objective 6). Methods for assessing and estimating the direct/indirect effects of intervention in the presence of multiple mediator models will be employed . Bootstrap re-sampling strategies will be used to avoid multivariate normality assumptions in placing confidence limits on the estimates of the proportion of the total intervention effect that is mediated . However, these analyses must be interpreted cautiously given the limitation that the mediation model is assumed to be correctly specified both in functional form and in that no variables are omitted which affect the relationships between independent and mediator or between mediator and dependent variables.
Briefly, social networks will be constructed from the work colleague nomination data at baseline, 6 and 18 months using UCINet 6.9 . These data will be supplemented by objective, real-time proximity data collected throughout the 6 month intervention period. Individual-level network variables, for example, density and centrality measures, will be derived and included in mediation analyses. Further analyses investigating the structure, characteristics, function and evolution of workplace social networks on physical activity behaviour change will be undertaken as part of a NIHR Career Development Fellowship.
The economic evaluation will comprise a cost-effectiveness and cost-utility analysis from the public sector perspective and a cost-benefit type analysis from the employer’s perspective (Objective 3). A cost-effectiveness and cost-utility analysis will compare costs and outcomes associated with the Intervention to those associated with the Control Group at three time-points. For the initial within study analysis, the outcome measures used will be (a) changes in mean steps per day; and (b) a within study measure of QALYs determined from EQ-5D. QALYs will be adjusted for any imbalances between groups at baseline . Thus, the initial analysis will present an estimate of cost-effectiveness of the intervention in terms of the incremental costs associated with increasing physical activity and a cost-utility analysis in terms of incremental costs per QALY gained. The uncertainty surrounding the estimates of cost and effects for the Intervention and Control Group will be investigated through the use of bootstrapping . In a sensitivity analysis we will compare subgroups and assess the uncertainty in their incremental cost-effectiveness ratios (ICERs) by plotting the associated cost-effectiveness acceptability curves. The longer term analysis will employ a decision model, populated with reference to the literature, to link short term study outcomes to longer term impacts on health and wellbeing. The model structure will be informed by a review of other models undertaken in this area, including the modelling work undertaken for NICE (2008) . Data will be embodied in the model through the specification of probability distributions for each parameter, to reflect the uncertainty. Probabilistic sensitivity analysis will be undertaken, using Monte Carlo simulation, to investigate the uncertainty surrounding the longer term estimates of costs, effects and cost-effectiveness of the intervention.
From the public sector perspective, the analysis will involve firstly generating ICERs using healthcare utilisation data and EQ-5D data. Secondly, from the employer’s perspective, the effect of physical activity on absenteeism will be used to estimate potential cost savings to employers (absenteeism model); and thirdly, we will employ an algorithm to translate changes in EQ-5D into quantifiable changes in productivity (productivity model [89–91]). Individual EQ-5D scores at baseline, 6 and 18 months will also be converted into estimated levels of productivity using this algorithm and the total productivity gain over 6 and 18 months for each group will be calculated. To calculate the ICER, from an employer’s perspective, the additional costs will be divided by the additional gain in total employee productivity by the Intervention Group.
Analysis of discrete choice and economic experiments (objective 8 and 9)
To analyse the revealed preferences data we will use a two-step modelling approach to explain an individual’s physical activity in relation to his/her characteristics [73, 74]. The revealed preferences data will be analysed with a Cragg’s double hurdle model [92–94] to first address physical activity participation, and then to analyse the amount of physical activity. We will run separate models for different types of physical activity (e.g. walking, gym) to produce estimates for the effect of wage, cost of physical activity and participants’ characteristics on the amount of physical activity. This model will provide us with a ‘revealed’ implicit monetary value for units of physical activity. A random utility econometric model will be fitted to the DCE data to determine the implied individual thresholds inducing behaviour change . Estimation will take place in a panel specification, and Bayesian posterior estimates of threshold values will be informed by the sequence of responses. Data from the field experiment to assess time and risk preferences will be analysed using maximum likelihood estimates, allowing for within-subject clustered standard errors, as each participant answers more than one time preference choice . The data collected on the amount of physical activity at baseline and after the intervention will allow us to run another Cragg’s double hurdle model for behaviour change, and explore how differences in inter-temporal preferences, baseline physical activity levels, incentives and other participant’s characteristics affect behaviour change. The Cragg’s double hurdle model will allow us to investigate the two-step process in behaviour change: firstly, relating to the decision to do more physical activity compared to baseline; secondly, the decision of how much physical activity to do.
Process evaluation analyses
Focus groups and semi-structured interviews will be audio-recorded and analysed using thematic content analysis  whereby identified themes will be represented in a matrix for further analysis and interpretation [96, 97] (Objective 7). Qualitative data will be entered into NVivo, which will be used to manage the relevant data and to explore inter-relationships between themes. Each transcript will be coded independently by two researchers. Analysis will explore implementation and receipt of rewards and contextual factors affecting these. Potential causal pathways will be explored in order to develop hypotheses relevant to secondary moderator and mediator analyses. Additionally, quantitative data from PAL scheme usage and web usage will be used in the analyses of intervention fidelity, using simple descriptive statistics. Within the context of the RE-AIM Framework, we will compare the characteristics of our trial population with the target population, to gauge the potential generalisability and impact of our results. Propensity scores will be used to compare the characteristics of trial participants with the inactive working population as a whole in Northern Ireland, using available population-level data . These propensity scores will also be used as to ascertain whether a weighting method can be employed, using the scores, to generalise the results to the target population.
Update on study progress
During the recruitment phase for the study, a revised power calculation was undertaken assuming a less demanding effect size estimate taken from the recent literature together with our actual baseline data on mean and variance of cluster size and an intra-class correlation co-efficient of 0.029. In the original protocol, the sample size calculation for the trial was determined using an anticipated effect size of d = 0.21 (based upon a previous meta-analysis of workplace based physical activity interventions). However none of the included studies were incentive-based interventions for physical activity. More recent literature has been published [99, 100], including a meta-analysis in which a mean effect size for incentive based interventions of 16 min of MVPA per day was estimated, equating to an effect size of approximately 1600 steps (d = 0.40). Additionally, in the TRIPPA study , which is examining the influence of financial incentives on the effectiveness of a wireless-upload pedometer to encourage weekly physical activity goals, the study was powered to detect a difference of a minimum of 30 min of MVPA per week between groups and power calculations were based on considerably higher effect size than assumed in our original protocol (0.35). Therefore, under the assumption that our original estimate was too conservative, the power calculation has been updated. For an effect size of 0.40, a study of 330 per group (or 660 in total) would have 90 % power at the 5 % significance level. Assuming a 15 % drop-out, the study would need to randomise 776 participants.
Given the rise in physical inactivity and associated health conditions, such as diabetes, heart diseases and cancer, worldwide, there is a growing need for scalable, effective, and affordable public health interventions. This study will provide necessary research concerning the potential effectiveness and cost-effectiveness of a novel workplace physical activity intervention and an understanding of assumed pathways of behaviour change initiation and maintenance. Further, detailed cost-effectiveness analyses will assess whether financial incentives are an appropriate use of government and private sector resources. The scope for introducing financial incentives in public health is extensive, but there is much to learn.
The study is designed to maximise the potential for roll-out in similar settings, by engaging the public sector and business community in designing and delivering the intervention. In collaboration with retail partners, an existing “proven” mechanism that delivers behaviour change in the private sector was applied to a public health setting using a sustainable “Physical Activity Loyalty Card.” We have developed a sustainable business model using a ‘points’ based loyalty platform, whereby local businesses ‘sponsor’ the incentive (retail vouchers) in return for increased footfall to their business, which is aligned to precepts of the Department of Health Public Health Responsibility Deal . For financial incentive schemes to be worthwhile in the longer term, they must be based on a sustainable model. The UK Government and the U.S. government have encouraged those involved in public health to work collaboratively with business. This study provides an example of how researchers can successfully engage with the business sector in public health.
BCTs, behaviour change techniques; BMI, body mass index; DCE, discrete choice experiment; EQ-5D-5 L, euro-Qol 5 dimension 5 level questionnaire; FFQ, food frequency questionnaire; GIS, geographical information systems; GPAQ, global physical activity questionnaire; ICER, incremental cost-effective ratio; Km, kilometres; m, metres; MICE, missing imputation by chain equations; MRC, medical research council; MVPA, moderate-vigorous physical activity; NHS, national health service; NICE, national institute for health and care excellence; NIHR, national institute for health research; PAL, physical activity loyalty; QALY, quality adjusted life year; RCT, randomised controlled trial; RE-AIM, reach, effectiveness, adoption, implementation, maintenance; SD, standard deviation; SEP, socio-economic position; SF-8, short form-8; SPIRIT, standard protocol items: recommendations for intervention trials; TRIPPA, trial of economic incentives to promote physical activity; UK, United Kingdom; US, United States; WEMWBS, Warwick Edinburgh mental wellbeing scale; WHO, World health organisation; WTA, willingness to accept; WTP, willingness to pay
The study team would like to acknowledge the Institute of Electronics, Communications and Information Technology (ECIT), Queen’s University Belfast, Club Marketing Services Ltd, Lisburn City Centre Management, and support from project partners, the South Eastern Health and Social Care Trust and Lisburn and Castlereagh City Council.
The views and opinions expressed therein are those of the authors and do not necessarily reflect those of the Public Health Research programme, NIHR, NHS or the Department of Health.
This study has been funded via the National Institute for Health Research Public Health Research Programme; Award no: 12/211/82. The funding body had no role in the design of the study or collection, analysis, and interpretation of data or in writing the manuscript. The study team would also like to acknowledge funding from the Public Health Agency and South Eastern Health and Social Care Trust. RH is supported by a NIHR Career Development Fellowship and acknowledges funding support from the HSC Research and Development Division. The work was undertaken under the auspices of the UKCRC Centre of Excellence for Public Health Research Northern Ireland and Centre for Diet and Activity Research (CEDAR), UKCRC Public Health Research Centres of Excellence which are funded by the British Heart Foundation, Cancer Research UK, Economic and Social Research Council, Medical Research Council, the National Institute for Health Research, and the Wellcome Trust.
Availability of data and material
The study dataset may be passed onto a 3rd party (e.g. other academic researchers) and made publicly available (e.g. for other researchers to access) on request and will be completely anonymised and an audit trail available (Additional file 1). Please contact corresponding author regarding this.
All authors contributed to the development of the study protocol and to the critical revision of the paper and approved the final version. RH (Study Director) and FK (Principal Investigator) led the pilot trial, had the initial idea for the study and led the development of the protocol and funding application. In addition, AL, CP, DF, EMcI, GH, JA, MT, LP (co-investigators) contributed to the design and writing of the original protocol and funding application. SB, JT, OS and JM (employed on the NIHR PHR project grant) have subsequently contributed to the refinements of the study protocol. RH wrote the first draft of the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
This study has received ethical approval from the Office of Research Ethics Committees Northern Ireland (ORECNI) on 21st May 2014 (REC ref: 14/NI/0090). All participants provided written informed consent prior to participation.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Kohl 3rd HW, Craig CL, Lambert EV, Inoue S, Alkandari JR, Leetongin G, Kahlmeier S, for the Lancet Physical Activity Series Working Group. The pandemic of physical inactivity: global action for public health. Lancet. 2012;380:294–305.View ArticlePubMedGoogle Scholar
- Conn VS, Hafdahl AR, Mehr DR. Interventions to increase physical activity among healthy adults: meta-analysis of outcomes. Am J Public Health. 2011;101:751–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Foster C, Hillsdon M, Thorogood M, Kaur A, Wedatilake T. Interventions for promoting physical activity. Cochrane Database Syst Rev. 2012;1:CD003180.Google Scholar
- National Institute for Health and Clinical Excellence (NICE). Walking and cycling: local measures to promote walking and cycling as forms of travel or recreation. 2012 [https://www.nice.org.uk/guidance/ph41]. Accessed Jan 2016.Google Scholar
- National Institute for Health and Clinical Excellence (NICE). Physical activity in the workplace. 2008 [https://www.nice.org.uk/guidance/ph13/chapter/1-Recommendations]. Accessed Jan 2016.Google Scholar
- Sport Northern Ireland. The Northern Ireland Sport and & Physical Activity Survey (SAPAS). 2010 [http://www.scribd.com/doc/73014459/The-Northern-Ireland-Sport-and-Physical-Activity-Survey-2010-SAPAS]. Accessed Jan 2016.Google Scholar
- Black C, Frost D. Health at work-an independent review of sickness absence. 2011. [http://www.dwp.gov.uk/policy/welfare-reform/sickness-absence-review/]. Accessed Jan 2016.Google Scholar
- Alemayehu B, Warner KE. The lifetime distribution of health care costs. Health Serv Res. 2004;39:627–42.View ArticlePubMedPubMed CentralGoogle Scholar
- Hutchinson AD, Wilson C. Improving nutrition and physical activity in the workplace: a meta-analysis of intervention studies. Health Promot Int. 2012;27:238–49.View ArticlePubMedGoogle Scholar
- Abraham C, Graham-Rowe E. Are worksite interventions effective in increasing physical activity? A systematic review and meta-analysis. Health Psychol Rev. 2009;3:108–44.View ArticleGoogle Scholar
- Conn VS, Hafdahl AR, Cooper PS, Brown LM, Lusk SL. Meta-analysis of workplace physical activity interventions. Am J Prev Med. 2009;37:330–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Rongen A, Robroek SJ, van Lenthe FJ, Burdorf A. Workplace health promotion: A meta-analysis of effectiveness. Am J Prev Med. 2013;44:406–15.View ArticlePubMedGoogle Scholar
- Department of Health. Healthy lives, healthy people. Our strategy for public health in England. 2010. [www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_121941]. Accessed Jan 2016.Google Scholar
- National Institutes of Health (NIH). NIH science of behavior change: meeting summary. 2009 [https://commonfund.nih.gov/sites/default/files/SOBC_Meeting_Summary_2009.pdf]. Accessed Jan 2016.Google Scholar
- House of Lords Report. Behaviour change. Science and Technology Select Committee, 2nd report of session. 2010–12.Google Scholar
- Promberger M, Dolan P, Marteau TM. “Pay them if it works”: Discrete choice experiments on the acceptability of financial incentives to change health related behaviour. Soc Sci Med. 2012;75:2509–14.View ArticlePubMedPubMed CentralGoogle Scholar
- Marteau TM, Ashcroft RE, Oliver A. Using financial incentives to achieve behaviour change. BMJ. 2009;338:b1415.View ArticlePubMedGoogle Scholar
- Higgins ST, Silverman K, Sigmon SC, Naito NA. Incentives and health: an introduction. Prev Med. 2012;55(Suppl):S2–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Giles EL, Robalino S, McColl E, Sniehotta FF, Adams J. The effectiveness of financial incentives for health behaviour change: systematic review and meta-analysis. PLoS One. 2014;11:9:e90347.Google Scholar
- Mantzari E, Vogt F, Shemilt I, Wei Y, Higgins JP, Marteau TM. Personal financial incentives for changing habitual health-related behaviors: A systematic review and meta-analysis. Prev Med. 2015;75:75–85.View ArticlePubMedPubMed CentralGoogle Scholar
- Charness G, Gneezy U. Incentives to exercise. Econometrica. 2009;77:909–31.View ArticleGoogle Scholar
- Johannesson M, Ostling R, Ranehill E. The effect of competition on physical activity: A randomized trial. B E J Econom Anal Policy. 2010;10:1–29.Google Scholar
- Johnston M. What more can we learn from early learning theory? The contemporary relevance for behaviour change interventions. Br J Health Psychol. 2016;21:1–10.View ArticlePubMedGoogle Scholar
- Haff N, Patel MS, Lim R, Zhu J, Troxel AB, Asch DA, Volpp KG. The role of behavioral economic incentive design and demographic characteristics in financial incentive-based approaches to changing health behaviors: a meta-analysis. Am J Health Promot. 2015;29:314–23.View ArticlePubMedGoogle Scholar
- National Institute for Health and Clinical Excellence (NICE). Workplace Health Promotion: How to Encourage Employees to be Physically Active: A Rapid Review of Economic Literature. 2007 [https://www.nice.org.uk/guidance/ph13/documents/workplace-physical-activity-economics-review2]. Accessed Jan 2016.Google Scholar
- Department of Health (DH). Choosing activity: a physical activity action plan. Department of Health Choosing activity: a physical activity action plan. London: Department of Health; 2005 [http://www.physicalactivityplan.org/resources/UK.pdf]. Accessed Jan 2016.Google Scholar
- Hunter RF, Tully MA, Davis M, Stevenson M, Kee F. Physical activity loyalty cards for behaviour change. A quasi-experimental study. Am J Prev Med. 2013;45:56–63.View ArticlePubMedGoogle Scholar
- Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.View ArticlePubMedPubMed CentralGoogle Scholar
- Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krlezˇa-Jeric ´K, Hro´ bjartsson A, Mann H, Dickersin K, Berlin JA, Dore ´CJ, Parulekar WR, Summerskill WSM, Groves T, Schulz KF, Sox HC, Rockhold FW, Rennie D, Moher D. SPIRIT Guidelines 2013 Statement: Defining standard protocol items for clinical trials. Ann Intern Med. 2013;158:200–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Dallat MA, Hunter RF, Tully MA, Cairns KJ, Kee F. A lesson in business: cost-effectiveness analysis of a novel financial incentive intervention for increasing physical activity in the workplace. BMC Public Health. 2013;13:953.View ArticlePubMedPubMed CentralGoogle Scholar
- Hamilton MT, Hamilton DG, Zderic TW. The role of low energy expenditure and sitting on obesity, metabolic syndrome, type 2 diabetes, and cardiovascular disease. Diabetes. 2007;56:2655–67.View ArticlePubMedGoogle Scholar
- Adams R. Revised Physical Activity Readiness Questionnaire. Can Fam Physician. 1999;45:992,995,1004-5.PubMedGoogle Scholar
- Department of Health. UK physical activity guidelines. 2011. [http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_128209]. Accessed Jan 2016.Google Scholar
- The Physical Activity Loyalty Scheme. [https://www.palscheme.org/]. Accessed Jan 2016.
- Grisolia JM, Longo A, Hutchinson G, Kee F. Trading off dietary choices, physical exercise and cardiovascular disease risks. Soc Sci Med. 2013;93:130–8.View ArticlePubMedGoogle Scholar
- Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol. 2009;28:690–701.View ArticlePubMedGoogle Scholar
- Carver CS, Scheier MF. Attention and self-regulation: a control-theory approach to human behaviour. New York: Springer Verlag; 1981.View ArticleGoogle Scholar
- Bandura A. Self efficacy: The exercise of control. New York: Freeman; 1997.Google Scholar
- Bravata DM, Smith-Spangler C, Sundaram V, Gienger AL, Lin N, Lewis R, Stave CD, Olkin I, Sirard JR. Using pedometers to increase physical activity and improve health: a systematic review. JAMA. 2007;298:2296–304.View ArticlePubMedGoogle Scholar
- Bassett DR, Ainsworth BE, Leggett SR, Mathien CA, Main JA, Hunter DC, Duncan GE. Accuracy of five electronic pedometers for measuring distance walked. Med Sci Sports Exerc. 1996;28:1071–7.View ArticlePubMedGoogle Scholar
- Schneider PL, Crouter SE, Lukajic O, Bassett DR. Accuracy and reliability of 10 pedometers for measuring steps over a 400-m walk. Med Sci Sports Exerc. 2003;35:1779–84.View ArticlePubMedGoogle Scholar
- Bull FC, Maslin TS, Armstrong T. Global Physical Activity Questionnaire (GPAQ): nine country reliability and validity study. J Phys Act Health. 2009;6:790–804.View ArticlePubMedGoogle Scholar
- The SF-8 Health Survey. [www.sf-36.org/tools/sf8.shtml]. Accessed Jan 2016.
- EuroQol Group. EuroQol: a new facility for the measurement of health-related quality of life. Health Policy. 1991;16:199–208.Google Scholar
- Oppe M, Devlin N, van Hout B, Krabbe P, de Charro F. A Program of Methodological Research at the New International EQ-5D-5 L Valuation Protocol. Value Health. 2014;17(4):445–53.View ArticlePubMedGoogle Scholar
- EuroQol Group. [http://www.euroqol.org/news-list/article/status-update-5l-valuation-studies.html]. Accessed Jan 2016.
- Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, Parkinson J, Secker J, Stewart-Brown S. The Warwick-Edinburgh Mental Well-Being Scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5:63.View ArticlePubMedPubMed CentralGoogle Scholar
- Lloyd K, Devine P. Psychometric properties of the Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) in Northern Ireland. J Ment Health. 2012;21:257–63.View ArticlePubMedGoogle Scholar
- Kessler RC, Barber C, Beck A, Berglund P, Cleary PD, McKenas D, Pronk N, Simon G, Stang P, Ustun TB, Wang P. The World Health Organisation Health and Work Performance Questionnaire (HPQ). J Occup Environ Med. 2003;45:156–74.View ArticlePubMedGoogle Scholar
- Chapman LS. Presenteeism and its role in worksite health promotion. Am J Health Promot. 2005;19:1–8.PubMedGoogle Scholar
- Brown HB, Burton N, Gilson ND, Brown W. Measuring presenteeism: Which questionnaire to use in physical activity research? J Phys Act Health. 2014;11:241–8.View ArticlePubMedGoogle Scholar
- Rothman AJ, Baldwin AS, Hertel AW, Fuglestad PT. Self-regulation and behavior change: Disentangling behavioral initiation and behavioral maintenance. In: Vohs KD, Baumeister RF, editors. Handbook of Self-regulation: Research, Theory, & Applications. New York: Guilford Press; 2011. p. 106–22.Google Scholar
- Schwarzer R, Schüz B, Ziegelmann JP, Lippke S, Luszczynska A, Scholz U. Adoption and maintenance of four health behaviors: Theory-guided longitudinal studies on dental flossing, seat belt use, dietary behavior, and physical activity. Ann Behav Med. 2007;33:156–66.View ArticlePubMedGoogle Scholar
- Kassavou A, Turner A, Hamborg T, French DP. Predicting maintenance of attendance at walking groups: Testing constructs from three leading maintenance theories. Health Psychol. 2014;33:752–6.View ArticlePubMedGoogle Scholar
- Michie S, Ashford S, Sniehotta FF, Dombrowski SU, Bishop A, French DP. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: The CALO-RE taxonomy. Psychol Health. 2011;26:1479–98.View ArticlePubMedGoogle Scholar
- Baranowski T, Anderson C, Carmack C. Mediating variable framework in physical activity interventions. How are we doing? How might we do better? Am J Prev Med. 1998;15:266–97.View ArticlePubMedGoogle Scholar
- Bauman AE, Sallis JF, Dzewaltowski DA, Owen N. Toward a better understanding of the influences on physical activity. The role of determinants, correlates, causal variables, mediators, moderators, and confounders. Am J Prev Med. 2002;23 Suppl 2:5–14.View ArticlePubMedGoogle Scholar
- Hampton B, Brinberg D, Peter P, Corus C. Integrating the Unified Theory and Stages of Change to create targeted health messages. J Appl Soc Psychol. 2009;39:449–71.View ArticleGoogle Scholar
- Hardeman W, Kinmonth AL, Michie S, Sutton S. Theory of planned behaviour cognitions do not predict self-reported or objective physical activity levels or change in the ProActive trial. Br J Health Psychol. 2011;16:135–50.View ArticlePubMedGoogle Scholar
- Bauman AE, Reis RS, Sallis JF, Wells JC, Loos RJF, Martin BW, for the Lancet Physical Activity Series Working Group. Correlates of physical activity: why are some people physically active and others not? Lancet. 2012;380:258–71.View ArticlePubMedGoogle Scholar
- Finch EA, Linde JA, Jeffery RW, Rothman AJ, King CM, Levy RL. The effects of outcome expectations and satisfaction on weight loss and maintenance: Correlational and experimental analyses-a randomized trial. Health Psychol. 2005;24:608–16.View ArticlePubMedGoogle Scholar
- Marcus BH, Selby VC, Niaura RS, Rossi JS. Self-efficacy and the stages of exercise behavior change. Res Q Exerc Sport. 1992;63:60–6.View ArticlePubMedGoogle Scholar
- Fishbein M, Ajzen I. Belief, attitude, intention, and behaviour: An introduction to theory and research. Reading: Addison-Wesley; 1980.Google Scholar
- Hunter RF, McAneney H, Davis M, Tully MA, Valente TW, Kee F. "Hidden" social networks in behavior change interventions. Am J Public Health. 2015;105:513–6.View ArticlePubMedGoogle Scholar
- Ogilvie D, Mitchell R, Mutrie N, Petticrew M, Platt S. Perceived characteristics of the environment associated with active travel: development and testing of a new scale. Int J Behav Nutr Phys Act. 2008;5:32.View ArticlePubMedPubMed CentralGoogle Scholar
- Frank LD, Sallis JF, Saelens BE, Leary L, Cain K, Conway TL, Hess PM. The development of a walkability index: application to the Neighborhood Quality of Life Study. Br J Sports Med. 2010;44:924–33.View ArticlePubMedGoogle Scholar
- Dalton AM, Jones AP, Panter JR, Ogilvie D. Neighbourhood, route and workplace-related environmental characteristics predict adults’ mode of travel to work. PLoS One. 2013;8:e67575.View ArticlePubMedPubMed CentralGoogle Scholar
- Brouwer W, Kroeze W, Crutzen R, de Nooijer J, de Vries NK, Brug J, Oenema A. Which intervention characteristics are related to more exposure to internet-delivered healthy lifestyle promotion interventions? A systematic review. J Med Internet Res. 2011;13:e2.View ArticlePubMedPubMed CentralGoogle Scholar
- Verplanken B, Orbell S. Reflections on past behavior: A self-report index of habit strength. J Appl Soc Psychol. 2003;33:1313–30.View ArticleGoogle Scholar
- Scholz U, Sniehotta FF, Schwarzer R. Predicting physical exercise in cardiac rehabilitation: The role of phase-specific self-efficacy beliefs. J Sport Exerc Psychol. 2005;27:135–51.View ArticleGoogle Scholar
- Ball K, Jeffrey RW, Abbott G, McNaughton SA, Crawford D. Is healthy behavior contagious: associations of social norms with physical activity and healthy eating? Int J Behav Nutr Phys Act. 2010;7:86.View ArticlePubMedPubMed CentralGoogle Scholar
- Harrington J, Perry IJ, Lutomski J, Fitzgerald AP, Shiely F, McGee H, Barry MM, Morgan K, Shelley E. Living longer and feeling better: healthy lifestyle, self-rated health, obesity and depression in Ireland. Eur J Public Health. 2010;20:91–5.View ArticlePubMedGoogle Scholar
- Ritzwoller D, Sukhanova A, Gaglio B, Glasgow R. Costing behavioural interventions: a practical guide to enhance translation. Ann Behav Med. 2009;37:218–27.View ArticlePubMedGoogle Scholar
- Bockstael NE, McConnell KE. Environmental and resource valuation with revealed preferences. Dordrecht: Springer; 2007.Google Scholar
- Louviere JJ, Hensher DA, Swait JD. Stated choice methods: Analysis and applications. Cambridge: Cambridge University Press; 2000.View ArticleGoogle Scholar
- Cawley J. An economic framework for understanding physical activity and eating behaviors. Am J Prev Med. 2004;27(3 Suppl):117–25.View ArticlePubMedGoogle Scholar
- Humphreys BR, Ruseski JE. Participation in physical activity and government spending on parks and recreation. Cont Econ Policy. 2007;25:538–52.View ArticleGoogle Scholar
- Humphreys BR, Ruseski JE. An economic analysis of participation and time spent in physical activity. B E J Econom Anal Policy. 2011;11:1–36.Google Scholar
- Brown DS, Finkelstein EA, Brown DR, Buchner DM, Johnson FR. Estimating older adults’ preferences for walking programs via conjoint analysis. Am J Prev Med. 2009;36:201–7.View ArticlePubMedGoogle Scholar
- Laury SK, McInnes MM, Swarthout JT. Avoiding the curves: Direct elicitation of time preferences. J Risk Uncertain. 2012;44:181–217.View ArticleGoogle Scholar
- Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89:1322–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Royston P, White IR. Multiple Imputation by Chained Equations (MICE): Implementation in Stata. J Stat Softw. 2011;45:1–20.View ArticleGoogle Scholar
- MacKinnon DP. Introduction to statistical mediation analysis. New York: Erlbaum; 2008.Google Scholar
- Preacher KJ, Hayes AF. Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavl Res Methods. 2008;40:879–91.View ArticleGoogle Scholar
- Borgatti SP, Evereyy MG, Freeman LC. UCINet 6 for Windows: Software for Social Network Analysis. [computer program]. Cambridge: Analytic Technologies; 2002.Google Scholar
- Manca A, Hawkins N, Sculpher MJ. Estimating mean QALYs in trial-based cost-effectiveness analysis: the importance of controlling for baseline utility. Health Econ. 2005;14:487–96.View ArticlePubMedGoogle Scholar
- Briggs AH, O’Brien BJ, Blackhouse G. Thinking outside the box: recent advances in the analysis and presentation of uncertainty in cost-effectiveness analysis. Annu Rev Public Health. 2002;23:377–401.View ArticlePubMedGoogle Scholar
- Bending M, Beale S, Hutton J. An economic analysis of workplace interventions that promote physical activity, PHIAC Report. York: York Health Economics Consortium; 2008.Google Scholar
- Krol M, Stolk E, Brouwer W. Productivity predictions based on EQ-5D: An explorative study. Zurich: ECHE; 2012.Google Scholar
- Brouwer WB, Meerding WJ, Lamers LM, Severens JL. The relationship between productivity and health-related QOL: an exploration. Pharmacoeconomics. 2005;23:209–18.View ArticlePubMedGoogle Scholar
- Lamers LM, Meerding WJ, Severens JL, Brouwer WB. The relationship between productivity and health-related quality of life: an empirical exploration in persons with low back pain. Qual Life Res. 2005;14:805–13.View ArticlePubMedGoogle Scholar
- Heckman JJ. Shadow prices, market wages, and labor supply. Econometrica. 1974;42:679–94.View ArticleGoogle Scholar
- Heckman JJ. The common structure of statistical models of truncation, sample selection and limited dependent variables and a simple estimator for such models. Ann Econ Soc Meas. 1976;5:475–92.Google Scholar
- Wooldridge JM. Econometric analysis of cross section and panel data (2nd edn). Massachusetts: Institute of Technology; 2010.Google Scholar
- Green J, Thorogood N. Qualitative methods for health research. 2nd ed. London: Sage; 2009.Google Scholar
- Ritchie J, Spencer L, O’Connor W. Carrying out qualitative analysis. In: Ritchie J, Lewis J, editors. Qualitative Research Practice: A Guide for Social Science Students and Researchers. London: Sage; 2003. p. 199–218.Google Scholar
- Prior L. Content Analysis. In: Leavy P, editor. Oxford Handbook of Qualitative Research Methods. New York: Oxford University Press; 2014.Google Scholar
- Stuart P, Cole SR, Bradshaw CP, Leaf PJ. The use of propensity scores to assess the generalizability of results from randomized trials. J R Statist Soc A. 2011;174:369–86.View ArticleGoogle Scholar
- Giles EL, Robalino S, McColl E, Sniehotta FF, Adams J. The effectiveness of financial incentives for health behaviour change: systematic review and meta-analysis. PLoS One. 2014;9(3):e90347.View ArticlePubMedPubMed CentralGoogle Scholar
- Finkelstein EA, Sahasranaman A, John G, Haaland BA, Bilger M, Sloan RA, Nang EE, Evenson KR. Design and baseline characteristics of participants in the TRial of Economic Incentives to Promote Physical Activity (TRIPPA): a randomised controlled trial of a six month pedometer program with financial incentives. Contemp Clin Trials. 2015;41:238–47.View ArticlePubMedGoogle Scholar