A cluster randomised trial of an intervention to increase the implementation of physical activity practices in secondary schools: study protocol for scaling up the Physical Activity 4 Everyone (PA4E1) program
A cluster randomised trial of an intervention to increase the implementation of physical activity practices in secondary schools: study protocol for scaling up the Physical Activity 4 Everyone (PA4E1) program
The implementation of interventions at-scale is required to maximise population health benefits. ‘Physical Activity 4 Everyone (PA4E1)’ was a multi-component school-based program targeting adolescents attending secondary schools in low socio-economic areas. An efficacy trial of the intervention demonstrated an increase in students’ mean minutes of moderate-to-vigorous physical activity (MVPA) per day and lower weight gain at low incremental cost. This study aims to assess the effectiveness and cost effectiveness of a multi-component implementation support intervention to improve implementation, at-scale, of the evidence based school physical activity (PA) practices of the PA4E1 program. Impact on student PA levels and adiposity will also be assessed, in addition to the cost of implementation.
A cluster randomised controlled trial, utilising an effectiveness-implementation hybrid design, will be conducted in up to 76 secondary schools located in lower socio-economic areas across four health districts in New South Wales (NSW), Australia. Schools will be randomly allocated to a usual practice control arm or a multi-component implementation support intervention to embed the seven school PA practices of the PA4E1 program. The implementation support intervention incorporates seven strategies including executive support, in-School Champion, teacher training, resources, prompts, audit and feedback and access to an external Support Officer. The primary trial outcome will be the proportion of schools meeting at least four of the seven physical activity practices of the program, assessed via surveys with Head Physical Education teachers at 12 and 24-months. Secondary outcomes will be assessed via a nested evaluation of student PA and adiposity at 12-months (Grade 8 students) and 24 months (Grade 9 students) undertaken in 30 schools (15 per group). Resource use associated with the implementation intervention will be measured prospectively. Linear mixed effects regression models will assess program effects on the primary outcome at each follow-up period.
This study is one of few evidence-based multi-component PA programs scaled-up to a large number of secondary schools and evaluated via randomised controlled trial. The use of implementation science theoretical frameworks to implement the evidence-based program and the rigorous evaluation design are strengths of the study.
Australian New Zealand Clinical Trials Registry ACTRN12617000681358 registered 12th May 2017. Protocol Version 1.
Physical inactivity is the fourth leading cause of mortality globally  and accrues a substantial negative economic impact . Physical inactivity is a major risk factor in the development of non-communicable diseases, including coronary heart disease, type II diabetes and certain cancers . Adolescence is considered a critical period, when physical inactivity adversely impacts on physical, mental and social health [4,5,6], and physical activity (PA) habits track into adulthood . Despite the widely accepted benefits of PA during adolescence, less than 10% of adolescents globally (including Australia) accumulate sufficient PA to accrue the associated health benefits .
Secondary schools are a key setting to provide opportunities for PA, as they provide access to adolescents and their families for ongoing periods in a critical development phase. In addition, schools have the resources, professional skills of teachers and policies to encourage physically active lifestyles [9, 10]. School-based PA programs for children can be effective at increasing mean duration of daily moderate-to-vigorous physical activity (MVPA), the proportion of students meeting PA guidelines, and can reduce weight, as demonstrated in a number of systematic reviews [9, 11,12,13]. Additionally, whilst research is currently limited, there is also some evidence suggesting a sustained impact of the school-based PA programs beyond the initial intervention period . However, few programs targeting adolescents have had beneficial effects on whole day PA [15,16,17,18], particularly those targeting adolescents from lower socioeconomic background who are most at-risk of inactivity , and most trials targeting adolescents have not been evaluated using whole day objective PA measures [17, 18]. The implementation of comprehensive school PA programs and the use of the Health Promoting Schools (HPS) framework for school based programs can enhance PA outcomes [13, 20, 21], with systematic review evidence supporting the effectiveness of interventions that address: the curriculum (physical education (PE) and sport) ; the school environment (e.g. recess and lunch activities and equipment) ; and the broader school community (partnerships with community PA providers and parents) .
Our recent cluster randomized controlled trial ‘Physical Activity 4 Everyone (PA4E1)’, conducted in ten (5 intervention) secondary schools in socio-economically disadvantaged areas in Australia, demonstrated an increase in adolescent daily minutes of MVPA and a smaller increase in unhealthy weight gain over two years [15, 25]. Furthermore, the PA4E1 program delivered these improved health outcomes at a low incremental cost [15, 26]. Briefly, the PA4E1 efficacy trial consisted of seven PA practices including increased PA within physical education (PE), development of student personal PA plans, enhanced school sport programs, recess and lunchtime PA, school PA policy, links with community PA providers and links with parents. Secondary schools were supported to adopt the seven PA practices via six implementation support strategies including location of a change agent within the school one day per week.
In order to improve adolescent PA levels, the implementation at-scale of effective programs and practices, such as PA4E1, is required to achieve population level health benefits . However, a review of PA interventions that have been scaled-up (fifty or more sites), identified that only six of the 16 interventions were within the school setting, and none within the secondary school setting . Furthermore, a review of implementation trials  conducted within the school setting identified that of the 27 trials included in the review, only six interventions focused on school-based PA and had evaluated the effectiveness of methods to improve the implementation of evidence based policies, programs or practices. None of these school-based PA implementation trials had been conducted within the secondary school setting. The review concluded that whilst modest improvements in implementation appeared possible, the quality of evidence was poor and the characteristics and cost of effective implementation strategies remains relatively unknown . Identifying the barriers or enablers to program implementation via formative evaluation and consultation with key stakeholders, co-development of contextually-relevant implementation support strategies and the use of theories and/ or frameworks to guide intervention design were recommended to be incorporated into future trials to maximize the likelihood of the effective of implementation.
To address this gap in the evidence base, the aim of this study is to assess the effectiveness of a multi-component implementation support strategy to improve implementation, at-scale, of evidence-based school PA practices of the PA4E1 program within socio-economically disadvantaged secondary schools, compared to usual school practice. The impact of the intervention on student PA levels (overall and school day MVPA) and adiposity will be assessed as secondary outcomes, in addition to the cost and cost effectiveness of implementation.
This study will employ a cluster randomised controlled design (Fig. 1). A type III hybrid implementation-effectiveness trial will be conducted combining both implementation outcomes and individual student level PA and anthropometric outcomes .
The research will be conducted and reported in accordance with the requirements of the Consolidated Standards of Reporting Trials (CONSORT) Statement [31, 32] and the Standards for Reporting Implementation Studies (StaRI) Statement . Secondary schools will be randomised to receive either the multi-component implementation support intervention, or to a control arm (usual school practices) after baseline data collection. Assessment of school PA practices will occur at baseline, 12 months (mid intervention) and 24 months. A nested study involving 15 schools per arm will be used to evaluate student level outcomes, objectively measured student PA via accelerometers (overall minutes of MVPA per day, and minutes of MVPA within school hours) and indicators of adiposity (weight, Body Mass Index (BMI)), measured at 12 and 24 months (Fig. 1). Approval will be obtained from relevant ethics committees. The trial has been prospectively registered ACTRN12617000681358.
The study will be conducted across four local health districts in the state of NSW, Australia (Hunter New England (HNE), South Western Sydney (SWS), Central Coast (CC) and Mid North Coast (MNC)). These districts are geographically widespread and encompass major city (SWS, CC, HNE) and regional/rural areas (HNE,MNC, CC) .
Sample and participants
Secondary schools in NSW cater for students aged 12 to 18 years old (Grades 7–12) and operate over four terms per calendar year. Schools are required to ensure students undertake 300 h of Health and PE each year, from Grades 7 to 10 . Schools should also provide opportunities for students to engage in PA through school sport, PE and other associated informal opportunities in line with NSW Department of Education policy; to provide a minimum of 150 min of planned moderate intensity PA, with some vigorous intensity, to students each week in government schools .
Secondary schools within the study regions that meet the following criteria will be eligible to participate in the study: (1) Government and Catholic schools; (2) enrol students in Grades 7–9; (3) located in areas classified as being disadvantaged by the SEIFA Index of Relative Socio-economic Disadvantage (suburb in lower 50% of NSW) ; (4) not fully selective/sports/performing arts/agriculture/boarding schools; (5) not participating in other major whole school PA trials or initiatives. Eligibility against the first four criteria will be determined from publicly available data , and for the remaining criteria, based on contact with schools during recruitment. The study will recruit up to 76 schools. A nested sample of 30 schools will be selected for student level data. The nested sample (n = 30) will include co-educational schools only and will be randomly selected from the main study sample.
At baseline, 12- and 24-months, Head and all PE teachers within each school will be invited to participate in the study assessments.
All students within Grade 8 (12 month follow-up) and Grade 9 (24 month follow-up) from the schools in the nested sample (n = 30) will be invited to participate in study measures. Classes catering for students with severe physical or mental disabilities will be excluded from eligibility for collection of student measures.
Prior to recruitment, the study will be promoted to school sector Regional Directors within the NSW Department of Education (DoE) and the relevant Catholic school dioceses, and to Government school staff in relevant regions through existing electronic communication systems (e.g. email). A list of schools deemed eligible and within strata (based on local health district (four) and school sector (two) will be assembled). The list of schools will be randomly ordered within their strata using a random number function in Microsoft Excel by a statistician not involved in contacting schools or in the study delivery . A letter inviting schools will be emailed to all Principals, requesting the information be shared with the Head PE teacher. The Principal and/ or Head PE teacher will be contacted by telephone by a dedicated recruitment project officer with PE teacher training. A face-to-face or telephone meeting will be offered to outline the requirements of the study and confirm eligibility.
Following school consent, all PE staff will be provided with a study information letter that outlines the purpose of the study and level of involvement expected.
Students (nested sub study)
Parents and students will be provided with letters outlining the study and a student consent form. The form will allow consent to be provided separately for participation in accelerometry, anthropometric measures, and student surveys. Parents will be provided with a telephone number to leave a message if they do not want to be prompted about consent or do not want their child to participate in study measurements. Parents who have not returned a consent form or left a message within two weeks will be telephoned by staff employed through the education sector who will explain the study and seek verbal consent using a standardised script .
As some schools will have Aboriginal student enrolments of 10% or greater , the study will adopt strategies to facilitate involvement of Aboriginal parents and students (with Principal permission) including: information on study letters on how to make contact with an Aboriginal member of the research team; contact with a school Aboriginal staff member to make them aware of the study and seek advice on ways the schools would usually communicate with parents; offer information to Aboriginal Education Consultative Groups (AECGs) through school channels; and having an Aboriginal staff member present on data collection days. As some schools will have high proportions of students with parents who speak languages other than English (LOTE) at home , the study will adopt strategies to facilitate involvement of such parents and students, including (with Principal’s permission): strategies the schools would usually use to communicate with such parents, including translation of study letters and consent forms into the major languages; adapting telephone prompting protocols to allow involvement of interpreters or school staff; and having appropriate staff members present at data collection sessions.
Consenting schools will be randomised to either program or control condition using a random number function in Microsoft Excel. Block randomisation (1:1) will be undertaken within the strata (four local health districts and two school sectors). Principals will be notified of their school allocation following baseline collection of school practice measures. Schools consenting to student level data (nested study) will be randomly selected within strata using a random number generator in Excel, and at stratum sizes proportional to that observed in the main study. Schools will be notified of student level measurement involvement when notified of group allocation.
Due to the inability to blind schools and teachers to the program strategies, the study will be conducted as an open trial. Data collectors will not be informed of group allocation, however blinding cannot be assured as this may be disclosed by school staff or students. The statistician undertaking data analysis will be blinded to study group, by using treatment numerical codes only.
The Health Promoting Schools (HPS) Framework and the Social Ecological Theory underpin the seven evidence-based school PA practices used in the initial efficacious PA4E1 trial  and in the current trial. The Behaviour Change Wheel  and the Theoretical Domains Framework  were used to develop the multi-component implementation support strategies.
School physical activity promotion practices
Table 1 provides an overview of the school PA practices that are the focus for the current trial. The expectation is that schools use one school term for planning, and then will commence practice implementation in the second term with a focus on incoming Grade 7 students (age 12–13). Practice implementation builds over two school years (8 school terms) and is designed to be ongoing.
Implementation support intervention
The multi-component implementation support intervention will consist of seven strategies delivered over two school years (Table 2). As outlined below, the implementation support intervention was developed for the original trial, then adapted for scale-up for this study.
Adaptation of the PA4E1 program school practices and implementation support intervention for implementation at scale
For this study, minor adaptations were made to the school physical activity promoting practices to address barriers raised regarding their implementation identified in the original trial. The multi-component implementation support strategies were similarly adapted to address barriers to their delivery and utility in the original trial, and to aid their implementation at-scale. The adaptations were made based on a review of existing models and factors for scaling up public health interventions  and a scoping review of frameworks for adapting public health interventions .
The key steps for adapting the implementation support strategies were undertaken iteratively, and involved: i) identifying barriers and enablers to change based on a review of the literature, focus groups with PE teachers and students, key informant interviews with school executives participating in the initial trial and Aboriginal stakeholder meetings and; ii) using the Theoretical Domains Framework (TDF)  and Behaviour Change Wheel (BCW)  to map the identified barriers to school implementation of PA practices and to evidence based implementation support strategies (behaviour change techniques); iii) revising the PA practices and implementation support strategies and delivery modes based on scalability (using the APPEASE criteria ) and iv review of the resulting adaptations by expert researchers and practitioners.
The main adaptations to the school physical activity promotion practices were: a broader focus on quality PE  rather than solely on ‘active PE’; and the use of a modified enhanced school sport program developed in partnership with the NSW Department of Education, designed to meet the needs of schools and supported by the Education system known as ‘Resistance Training for Teens’  (rather than Program X ). These adaptations were made to support delivery at scale and synchronise with existing systems.
Adaptations to the multi-component implementation support intervention strategies were: 1) embedding school staff by appointing and funding an in-School Champion along with access to a local health promotion Support Officer to replace the external change agent model used in the original trial; 2) a change in the modality of teacher professional learning from face-to-face training to online where possible, and use of accredited education sector courses where possible rather than project specific learning programs, to allow teachers to include attendance at these courses within their professional accreditation ; 3) the provision of tools (such as PE observation forms) and resources via a program website rather than paper-based; 4) prompts and reminders and performance monitoring and feedback automated to each school (via completion of termly progress surveys) to occur via the program website rather than verbal/email prompts and manually generated feedback reports.
Additional file 1: Table S1 presents an overview of the identified barriers to school implementation and scale-up, the mapping of these barriers to the TDF  and BCW , the behaviour change techniques selected to address the barriers, and a further description of how these have been incorporated into the multi-component implementation support intervention used in the current trial.
Control schools will participate in study measures and continue delivering usual PE lessons, school sport and other PA programs and practices. PA4E1 program materials, inclusive of access to the program website will be available to these schools on study completion.
Data collection procedures and measures
An overview of data collection is shown in Table 3. The primary outcome will be the proportion of schools in each group implementing any four of the seven PA practices (the prior trial showed a significant effect on student MVPA at 12 month mid-point , by which time schools had implemented 4 of the 7 practices). Secondary outcomes will be the mean number of PA practices achieved, whether or not schools implement each of the seven PA practices (to determine compliance with each practice), as well as student level outcomes (objectively measured PA and adiposity indicators). Economic outcomes will include: 1) the direct cost of the multi-component implementation support intervention from multiple stakeholder perspectives; 2) average and incremental cost-effectiveness ratios, subject to assessment of effectiveness, and 3) budget impact calculated from a public finance perspective.
A separate process evaluation protocol will be developed and published elsewhere.
School characteristics/ Head PE teacher characteristics
Publicly available data  will provide information on school sector, postcode, size (total enrolments), Indigenous enrolments, and students who speak a LOTE at home enrolment for all schools approached for consent. For schools participating in the project the following characteristics will be obtained through a Head PE teacher computer assisted telephone interview: number of PE teachers and full time equivalent PE positions; language groups most commonly represented when the school has more than 10% of LOTE students.
Computer assisted telephone interviews with Head PE teachers and online surveys with all PE teachers conducted at baseline, 12 and 24 months, will ask for background information including sex, PE training, years of teaching experience, how long they’ve taught PE at their current school, and grades they teach in the current year.
Measures of the seven PA practices shown in Table 1 will be undertaken via the computer assisted telephone interviews with Head PE teachers, administered by trained interviewers. The items will be adapted from those used to collect process data in the previous PA4E1 trial [15, 25, 47] and will be forwarded by email to participants prior to the interview.
Student level variables (nested sub study)
Physical activity: Whole-day objective PA measurement will be undertaken using wrist worn Actigraph GT9X-BT or GT3X+ accelerometers , distributed to students at school within class, at the same time as students’ complete anthropometric measures and surveys. Accelerometers have displayed acceptable intra- and inter-instrumental reliability and provide a valid and reliable estimate of PA in young people [48, 49]. Students will be asked by trained research assistants to wear the accelerometers on their non-dominant wrist during waking hours for seven consecutive days. To improve compliance, student and/ or parent mobile phone numbers will be requested via the consent form, and a text message sent by the researchers each morning reminding students to wear the accelerometer . School start and finish times that apply during the assessment period will be requested from schools.
Research assistants will be trained in measuring height and weight (used to calculate body mass index; BMI) using the International Society for the Advancement of Kinanthropometry (ISAK) procedures . Where possible, all measurements will be taken in the morning . Weight will be measured in light clothing without shoes using a portable digital scale (Model no. UC-321PC, A&D Company Ltd., Tokyo Japan) to the nearest 0.1 kg. Height will be recorded to the nearest 0.1 cm using a portable stadiometer (Model no. PE087, Mentone Educational Centre, Australia). The physical assessments will be conducted in a sensitive manner, with student measurements taken behind a privacy screen. Body mass index (BMI) will be calculated as weight/height squared (kg/m2). Weight status will be determined using International Obesity Taskforce definitions .
The student survey, which will take approximately 20 min, will be undertaken to assess: student socio-demographic characteristics (age, sex, Aboriginal or Torres Strait Islander status, languages spoken at home, postcode of residence); which years they have attended the school; self-reported PA ; school PA behaviour (items from Questionnaire Assessing School Physical Activity Environment Q-SPACE ); autonomous motivation for PA (intrinsic motivation and identified regulation subscales of the Behavioural Regulation in Exercise Questionnaire 2 (BREQ-2) ), social support for PA ; perceptions of school PA environment (items from or adapted from scales including Q- SPACE , Student Engagement in School Questionnaire , Teacher as Social Context questionnaire  controlling teacher scale ; and general health and well-being (KIDSCREEN 10 ). The survey will be completed by students at 12 and 24-months via a tablet provided by the research team.
Cost data pertaining to the development and implementation of the intervention will be collected prospectively using a resource use capture tool. The tool, developed in MS Excel (2013), allows the input of resource use data from each of the stakeholders involved in implementing the intervention for the following cost categories: labour (health service), labour (non-health service), materials, joint costs and miscellaneous costs. Management logs routinely used by the Support Officers will inform the identification and measurement of resource use associated with the intervention. Interviews and surveys with teachers will also inform the identification and measurement of resource use from the perspective of the schools.
Implementation process outcomes
A full process evaluation protocol, with detailed aims, will be published separately. Briefly, the evaluation of implementation outcomes for the trial will be aligned to the assessment of domains recommended by Proctor et al. 2011  including appropriateness, acceptability, adoption, feasibility, fidelity, penetration (reach) and sustainability. In addition, usability and engagement with the program website will be investigated . A mixed-methods assessment will use data obtained from a variety of sources including PE Teacher and in-School Champion termly implementation surveys from program schools (Table 3). Appropriateness, acceptability and feasibility will be assessed using validated survey items developed by Wiener et al. . Adoption (primary trial outcome) will be assessed via computer assisted telephone interviews with Head PE teachers. Fidelity and dosage (and context) will be assessed via a fidelity monitoring log  and a project specific fidelity checklist. Reach and sustainability will be assessed using items developed by the project team, specific to the program. Qualitative data sources will include in-School Champion focus groups and semi-structured interviews with PE teachers, as well as talk-aloud surveys relating to the engagement, usability and user experience with the program website.
The online surveys of PE teachers in program and control schools will provide data on practice barriers (Table 3).
Supporting schools with data collection
All schools will be offered half a day of teacher relief ($175AUD) at each practice data collection point (baseline, mid-point and follow-up) to reimburse the school for their time in assisting with data collection. In addition, schools participating in student data collection (nested sub study) will be offered 1.5 days teacher relief ($525AUD) at each of the 12 and 24 month collections, plus additional funding if school staff are involved in parent consent gaining calls. This will allow a school staff member to be present during the student data collection sessions. Prior to data collection days, a list of students with parental consent will be provided to the school so schools can consider whether additional research staff may be required to assist students with limited literacy.
School characteristics will be summarised separately for schools participating in the trial and those refusing participation, and for program and control schools. Student characteristics (nested sample) will also be summarised for each group for the 12 month (Grade 8) and 24 month (Grade 9) samples.
The primary outcome is the proportion of schools implementing at least four of the seven PA practices  based on the Head PE teacher computer assisted telephone interview data. The analysis will follow intention-to-treat principles, with multiple imputation the primary method of dealing with missing data. Per protocol analyses will also be performed, based on those schools receiving the full implementation support intervention.
Differences between treatment groups in the primary outcome at 12 and 24-months will be assessed using generalised linear regression models (a separate analysis conducted for each time point). A log link and binomial distribution function will be used (a logistic link will be utilised if the analysis model fails convergence). The stratification variables will be included in the models as covariates.
Secondary outcomes will include the mean number of PA practices achieved and the proportion of schools meeting each of the practices (Table 1). Analysis will be undertaken similarly to the primary outcome, with a normal distribution function for the mean number of practices outcome.
Student level measures (nested sub study)
Student data will be analysed if accelerometers are worn for ≥480 min per day on ≥3 days . Appropriate cut-points based on emerging evidence and expert advice for wrist worn accelerometers will be used to categorize different intensities of PA . Analysis will use all available data and follow the intention to treat principle. Analysis of minutes of MVPA per day (overall, within school hours as determined by school timetables) at each of the two follow-up time-points (corresponding to 12 and 24 month follow-up) will be undertaken using linear mixed models, including school level random intercept to model the clustering (30 clusters) of students within schools, and a random intercept for individuals. Analyses will adjust for demographic characteristics (sex, age, Aboriginal and Torres Strait Islander background). Least square mean differences between intervention and control students will be presented at both time points, together with 95% confidence intervals and p-values. A similar analysis will be undertaken for anthropometry outcomes, weight, BMI, BMI z scores. Exploratory subgroup analyses will be undertaken by sex, Aboriginality and LOTE.
The economic evaluation will be performed as a within-trial analysis, indicating that only costs and effects that accumulate within the trial duration are included. In this study, the prospective, trial-based economic evaluation will involve (i) resource use modelling to describe the investment required to develop and execute the implementation-intervention from all relevant stakeholder perspectives; (ii) a cost consequence analysis to identify, measure and value all associated costs and outcomes associated with the program compared to usual practice and (iii) subject to assessment of effectiveness, a cost-effectiveness analysis based on both primary school level outcome and secondary, student level outcomes.
The cost model will be based on the concept of opportunity cost, that is, the value of the benefit forgone in not employing a resource in a different use. In this analysis, market prices will be used as a proxy for this value. Labour costs will include an overhead to allow for additional costs of employment. Materials refer to non-abour cost items such as stationary (education materials) or electronic hardware or software. Joint costs are defined as those costs incurred in connection with multiple projects. For example, the maintenance costs of a website portal supporting different interventions. Capital costs refer to major one-off investments such as the purchase of additional office buildings or motor vehicles. Miscellaneous costs are considered to be those costs not easily classified into the other categories. The primary outcome from the cost model will be an estimate of the mean cost per school of implementing the intervention. Costs for each of the intervention elements will be reported separately and jointly. The analysis will adhere to cost and economic analysis guidelines [67,68,69]. To maintain a conservative approach to cost estimation, the non-capital implementation costs are not amortised.
Cost consequence analysis
Cost consequence analysis, the listing of all cost/benefit implications of each alternative, represents the simplest form of economic evaluation. In this analysis, where the collection of outcomes is diverse, it has value in being able to inform spending decisions by capturing the range of returns generated by the investment.
Cost effectiveness analysis
Subject to assessment of effectiveness, the trial-based evaluation will include assessment of cost-effectiveness. It has been suggested that one of the ways to improve efficiency in conducting economic evaluations of implementation interventions, is to confine the study to measures of the care process or intermediate outcomes . This is the approach adopted in this study, where the cost-effectiveness outcomes, the incremental cost effectiveness ratios (ICER) will be: (i) incremental cost per percent change in the proportion of schools implementing at least four of the seven PA practices, reflective of the primary trial outcome and (ii) incremental cost per unit changes in student-level outcomes (minutes of MVPA per day, % reduction in BMI and metabolic equivalent (MET) hours gained). The ICERs will be calculated as the arithmetic mean difference in cost between the intervention and usual practice arms divided by the arithmetic mean difference in effect [68, 71].
Uncertainty analysis will be conducted using parametric and non-parametric bootstrapping techniques and sensitivity analyses will be conducted to explore the robustness of the economic outcomes to any uncertainty associated with key parameters.
Budget impact analysis
A budget impact analysis considers specific requirements of policy makers taking account of local perspective and time horizons. Subject to assessment of effectiveness, the results of the cost and cost-consequence analyses will be reconfigured as a budget impact statement reflecting the costs and outcomes falling directly within specific budgets and within the usual timeframe of the budget holder.
All of the analyses will be constructed in Microsoft Excel and will adhere to international reporting standards for economic evaluations .
A mixed methods process evaluation based on Proctor et al.  will be undertaken using a descriptive analysis that will be detailed in a separate protocol.
Based on publicly available data there are approximately 120 potentially eligible schools. Based on school consent rates in previous trials conducted by the researchers of around 65–70% , a sample of 76 schools (38 per arm) will provide 80% power to detect an absolute increase of ~ 35% between groups in the proportion of schools implementing at least 4 of the 7 items at 12 and 24-months (alpha 0.025 to allow for program effect at 12 or 24 months). Without prior data on baseline levels of school practices, this calculation makes the conservative assumption that 40% of schools in the usual care arm achieve this target at follow-up.
For student level variables it is estimated that a nested sample of 30 schools and a student consent rate of 65% will yield about 1200 students (600 per group) with valid accelerometer data. Using an ICC of 0.03  and a standard deviation of 23 min of MVPA, will allow a 6.2 min  difference in the mean difference between groups at each separate follow-up to be detected with 80% power and a 2.5% type 1 error rate.
Trial discontinuation or modification
It is not anticipated that any events would occur that would warrant discontinuing the trial. Any unforeseen adverse events will be reported to the Hunter New England Human Research Ethics Committee (primary approval committee) and advice sought regarding required action. The trial registration record will be updated with any protocol modifications and any deviations from original protocol will be reported in study outcome papers.
Implementation research is a neglected area of scientific investigation, particularly within community settings . Research evaluating methods for increasing implementation of effective health policies, programs or practices represents just 1% of health promotion research publications.  Similarly, recent systematic reviews have identified few implementation intervention trials across a variety of community settings and health behaviours, and a scarce number of implementation trials conducted at-scale [29, 72, 74]. Rigorous trials of theoretically based implementation interventions provide the best evidence to identify solutions to bridge this evidence-practice gap and assist in providing critical information needed to support implementation at scale. Scaling up effective public health interventions is the ultimate goal, as unless interventions are delivered at scale, they offer little benefit to population health . This trial is one of few large-scale, randomised trials of an intervention to improve PA practice implementation at-scale in a non-clinical setting. Using a systematic, theoretically grounded approach, this trial will provide critical information to develop more efficient and effective next generation trials focused on implementation scaling-up and scaling-out.
This will be the first implementation study at-scale of a PA intervention targeting PA practices in socio-economically disadvantaged secondary schools. The findings will inform future efforts to support schools to implement health promoting policies and programs. Further, the findings could provide a basis for supporting implementation of other evidence based policies in this setting.
Body Mass Index
Health Promoting Schools
Language other than English
moderate-to-vigorous intensity physical activity
New South Wales
Physical Activity 4 Everyone
World Health Organization. Global health risks: mortality and burden of disease attributable to selected major risks. Geneva: World Health Organization; 2009. p. 62.
Ding D, Lawson KD, Kolbe-Alexander TL, Finkelstein EA, Katzmarzyk PT, van Mechelen W, et al. The economic burden of physical inactivity: a global analysis of major non-communicable diseases. Lancet. 2016;388(10051):1311–24. https://doi.org/10.1016/S0140-6736(16)30383-X.
Lee IM, Shiroma EJ, Lobelo F, Puska P, Blair SN, Katzmarzyk PT, et al. Effect of physical inactivity on major non-communicable diseases worldwide: an analysis of burden of disease and life expectancy. Lancet. 2012;380(9838):219–29. https://doi.org/10.1016/S0140-6736(12)61031-9.
Janssen I, Leblanc AG. Systematic review of the health benefits of physical activity and fitness in school-aged children and youth. Int J Behav Nutr Phys Act. 2010;7:40. https://doi.org/10.1186/1479-5868-7-40.
Eime RM, Young JA, Harvey JT, Charity MJ, Payne WR. A systematic review of the psychological and social benefits of participation in sport for children and adolescents: informing development of a conceptual model of health through sport. Int J Behav Nutr Phys Act. 2013;10:98. https://doi.org/10.1186/1479-5868-10-98.
Cooper AR, Goodman A, Page AS, Sherar LB, Esliger DW, van Sluijs EM, et al. Objectively measured physical activity and sedentary time in youth: the International children's accelerometry database (ICAD). Int J Behav Nutr Phys Act. 2015;12:113. https://doi.org/10.1186/s12966-015-0274-5.
Kriemler S, Meyer U, Martin E, van Sluijs EMF, Andersen LB, Martin BW. Effect of school-based interventions on physical activity and fitness in children and adolescents: a review of reviews and systematic update. Br J Sports Med. 2011;45(11). https://doi.org/10.1136/bjsports-2011-090186.
Pate RR, Davis MG, Robinson TN, Stone EJ, McKenzie TL, Young JC. Promoting physical activity in children and youth: a leadership role for schools: a scientific statement from the American Heart Association Council on nutrition, physical activity, and metabolism (physical activity committee) in collaboration with the councils on cardiovascular disease in the Young and cardiovascular nursing. Circulation. 2006;114(11):1214–24. https://doi.org/10.1161/CIRCULATIONAHA.106.177052.
Dobbins M, Husson H, DeCorby K, LaRocca RL. School-based physical activity programs for promoting physical activity and fitness in children and adolescents aged 6 to 18. Cochrane Database Syst Rev. 2013;2:CD007651. https://doi.org/10.1002/14651858.CD007651.pub2.
Langford R, Bonell C, Jones H, Pouliou T, Murphy S, Waters E, et al. The World Health Organization's health promoting schools framework: a Cochrane systematic review and meta-analysis. BMC Public Health. 2015;15:130. https://doi.org/10.1186/s12889-015-1360-y.
Lai SK, Costigan SA, Morgan PJ, Lubans DR, Stodden DF, Salmon J, et al. Do school-based interventions focusing on physical activity, fitness, or fundamental movement skill competency produce a sustained impact in these outcomes in children and adolescents? A systematic review of follow-up studies. Sports Med. 2014;44(1):67–79. https://doi.org/10.1007/s40279-013-0099-9.
Sutherland RL, Campbell EM, Lubans DR, Morgan PJ, Nathan NK, Wolfenden L, et al. The Physical Activity 4 Everyone cluster randomized trial: 2-year outcomes of a school physical activity intervention among adolescents. Am J Prev Med. 2016;51(2):195–205. https://doi.org/10.1016/j.amepre.2016.02.020.
Lubans DR, Morgan PJ, Callister R, Collins CE. Effects of integrating pedometers, parental materials, and E-mail support within an extracurricular school sport intervention. J Adolesc Health. 2009;44(2):176–83. https://doi.org/10.1016/j.jadohealth.2008.06.020.
Borde R, Smith JJ, Sutherland R, Nathan N, Lubans DR. Methodological considerations and impact of school-based interventions on objectively measured physical activity in adolescents: a systematic review and meta-analysis. Obes Rev. 2017;18(4):476–90. https://doi.org/10.1111/obr.12517.
Love R, Adams J, van Sluijs EMF. Are school-based physical activity interventions effective and equitable? A meta-analysis of cluster randomized controlled trials with accelerometer-assessed activity. Obes Rev. 2019;20(6):859-70. https://doi.org/10.1111/obr.12823.
Carson RL, Castelli DM, Pulling Kuhn AC, Moore JB, Beets MW, Beighle A, et al. Impact of trained champions of comprehensive school physical activity programs on school physical activity offerings, youth physical activity and sedentary behaviors. Prev Med. 2014;69(Suppl 1):S12–9. https://doi.org/10.1016/j.ypmed.2014.08.025.
Russ LB, Webster CA, Beets MW, Phillips DS. Systematic review and meta-analysis of multi-component interventions through schools to increase physical activity. J Phys Act Health. 2015;12(10):1436–46. https://doi.org/10.1123/jpah.2014-0244.
Lonsdale C, Rosenkranz RR, Peralta LR, Bennie A, Fahey P, Lubans DR. A systematic review and meta-analysis of interventions designed to increase moderate-to-vigorous physical activity in school physical education lessons. Prev Med. 2013;56(2):152–61. https://doi.org/10.1016/j.ypmed.2012.12.004.
Wang Y, Cai L, Wu Y, Wilson RF, Weston C, Fawole O, et al. What childhood obesity prevention programmes work? A systematic review and meta-analysis. Obes Rev. 2015;16(7):547–65. https://doi.org/10.1111/obr.12277.
Sutherland R, Campbell E, Lubans DR, Morgan PJ, Okely AD, Nathan N, et al. A cluster randomised trial of a school-based intervention to prevent decline in adolescent physical activity levels: study protocol for the ‘Physical Activity 4 Everyone’ trial. BMC Public Health. 2013;13(1):57. https://doi.org/10.1186/1471-2458-13-57.
Sutherland R, Reeves P, Campbell E, Lubans DR, Morgan PJ, Nathan N, et al. Cost effectiveness of a multi-component school-based physical activity intervention targeting adolescents: the ‘Physical Activity 4 Everyone’ cluster randomized trial. Int J Behav Nutr Phys Act. 2016;13(1):94. https://doi.org/10.1186/s12966-016-0418-2.
Wolfenden L, Milat AJ, Lecathelinais C, Skelton E, Clinton-McHarg T, Williams C, et al. A bibliographic review of public health dissemination and implementation research output and citation rates. Prev Med Rep. 2016;4:441–3. https://doi.org/10.1016/j.pmedr.2016.08.006.
Reis RS, Salvo D, Ogilvie D, Lambert EV, Goenka S, Brownson RC. Scaling up physical activity interventions worldwide: stepping up to larger and smarter approaches to get people moving. Lancet. 2016;388(10051):1337–48. https://doi.org/10.1016/S0140-6736(16)30728-0.
Wolfenden L, Nathan NK, Sutherland R, Yoong SL, Hodder RK, Wyse RJ, et al. Strategies for enhancing the implementation of school-based policies or practices targeting risk factors for chronic disease. Cochrane Database Syst Rev. 2017;(11). https://doi.org/10.1002/14651858.CD011677.pub2.
Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26. https://doi.org/10.1097/MLR.0b013e3182408812.
Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, et al. Standards for reporting implementation studies (StaRI) statement. BMJ. 2017;356:1–9. https://doi.org/10.1136/bmj.i6795.
Australian Bureau of Statistics (ABS). Statistical Geography Volume 1- Australian Standard Geogrphical Classification (ASGC). Canberra: Commonwealth of Australia; 2006.
NSW Department of Education. Sport and Physical Activity Policy 2018 [cited 2018 05/12/2018]. Available from: https://perma.cc/7WDH-ZKPS.
Australian Bureau of Statistics (ABS). Technical Paper:Census of Population and Housing: Socio-Economic Indexes For Australia (SEIFA). Cat. no 2033.0.55.001. Canberra: Commonwealth of Australia; 2016.
Australian Curriculum, Assesment and Reporting Authority. My School is a resource for parents, educators and the community to find information about each of Australia's schools. 2019 [cited 2019 19/02/2019]. Available from: https://myschool.edu.au/.
Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42. https://doi.org/10.1186/1748-5908-6-42.
Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7(1):37. https://doi.org/10.1186/1748-5908-7-37.
Lubans DR, Lonsdale C, Cohen K, Eather N, Beauchamp MR, Morgan PJ, et al. Framework for the design and delivery of organized physical activity sessions for children and adolescents: rationale and description of the ‘SAAFE’ teaching principles. Int J Behav Nutr Phys Act. 2017;14(1):24. https://doi.org/10.1186/s12966-017-0479-x.
NSW Department of Education. School Sports Unit - Developing procedures for school sport 2019. [20/02/2019]. Available from: www.Gdurl.com/wEEE
Escoffery C, Lebow-Skelley E, Udelson H, Boing EA, Wood R, Fernandez ME, et al. A scoping study of frameworks for adapting public health evidence-based interventions. Transl Behav Med. 2018. https://doi.org/10.1093/tbm/ibx067.
Dollman J, Okely AD, Hardy L, Timperio A, Salmon J, Hills AP. A hitchhiker's guide to assessing young people's physical activity: deciding what method to use. J Sci Med Sport. 2009;12(5):518–25. https://doi.org/10.1016/j.jsams.2008.09.007.
Marfell-Jones MOT, Stew A, Carter L. International standards for anthropometric assessment. International standards for anthropometric assessment. Lower Hutt: The International Society for the Advancement of Kinanthropometry; 2006.
Routen AC, Edwards MG, Upton D, Peters DM. The impact of school-day variation in weight and height on National Child Measurement Programme body mass index-determined weight category in year 6 children. Child Care Health Dev. 2011;37(3):360–7. https://doi.org/10.1111/j.1365-2214.2010.01204.x.
Cole TJ, Bellizzi MC, Flegal KM, Dietz WH. Establishing a standard definition for child overweight and obesity worldwide: international survey. BMJ. 2000;320(7244):1240–3. https://doi.org/10.1136/bmj.320.7244.1240.
Markland D, Tobin V. A modification to the Behavioural regulation in exercise questionnaire to include an assessment of Amotivation. J Sport Exerc Psychol. 2004;26(2):191–6. https://doi.org/10.1123/jsep.26.2.191.
Hart SR, Stewart K, Jimerson SR. The Student Engagement in Schools Questionnaire (SESQ) and the Teacher Engagement Report Form-New (TERF-N): Examining the Preliminary Evidence. Contemp Sch Psychol Formerly Calif Sch Psychol. 2011;15(1):67–79. https://doi.org/10.1007/BF03340964.
Belmont M, Skinner E, Wellborn J, Connell J. Teacher as social context: A measure of student perceptions of teacher provision of involvement, structure, and autonomy support. Rochester: Univeristy of Rochester; 1988.
Jang H, Reeve J, Ryan RM, Kim A. Can self-determination theory explain what underlies the productive, satisfying learning experiences of collectivistically oriented Korean students? J Educ Psychol. 2009;101(3):644–61. http://dx.doi.org/10.1037/a0014241.
Ravens-Sieberer U, Erhart M, Rajmil L, Herdman M, Auquier P, Bruil J, et al. Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents' well-being and health-related quality of life. Qual Life Res Int J Qual Life Asp Treat Care Rehab. 2010;19(10):1487–500. https://doi.org/10.1007/s11136-010-9706-5.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76. https://doi.org/10.1007/s10488-010-0319-7.
Perski O, Blandford A, West R, Michie S. Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis. Transl Behav Med. 2017;7(2):254–67. https://doi.org/10.1007/s13142-016-0453-1.
Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):108. https://doi.org/10.1186/s13012-017-0635-3.
Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013;8(1):65. https://doi.org/10.1186/1748-5908-8-65.
Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, Augustovski F, Briggs AH, Mauskopf J, Loder E. Consolidated Health Economic Evaluation Reporting Standards (CHEERS)—Explanation and Elaboration: A Report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health. 2013;16(2):231–50. https://doi.org/10.1016/j.jval.2013.02.002.
Wolfenden L, Reilly K, Kingsland M, Grady A, Williams CM, Nathan N, et al. Identifying opportunities to develop the science of implementation for community-based non-communicable disease prevention: a review of implementation trials. Prev Med. 2019;118:279–85. https://doi.org/10.1016/j.ypmed.2018.11.014.
Rabin BA, Glasgow RE, Kerner JF, Klump MP, Brownson RC. Dissemination and implementation research on community-based cancer prevention: a systematic review. Am J Prev Med. 2010;38(4):443–56. https://doi.org/10.1016/j.amepre.2009.12.035.
The authors wish to acknowledge the NSW Department of Education School Sport Unit for their advice with the study.
This project is funded by the NSW Ministry of Health, Translational Research Grant Scheme. The NSW Ministry of Health has not had any role in the design of the study as outlined in this protocol and will not have a role in data collection, analysis of data, interpretation of data and dissemination of findings. RS and NN are supported by a NHMRC TRIP Fellowship (APP1150661 and APP1132450). NN is also supported by a Hunter New England Clinical Research Fellowship; LW is supported by a NHMRC Career Development Fellowship (APP1128348), Heart Foundation Future Leader Fellowship (101175) and a Hunter New England Clinical Research Fellowship; DRL is supported by an Australian Research Council Future Fellowship.
Availability of data and materials
All study materials are available from the research team upon request to lead investigators. All data will be stored securely as per ethical requirements. All participants will be issues a unique identification number following consent for confidentiality. The final trial dataset will be stored securely and accessed only by the study statistician. The results of this trial will be disseminated via publication in peer reviewed journal, conference presentations and reports to schools and relevant health and education departments.
Authors and Affiliations
Hunter New England Population Health, Locked Bag 10, Wallsend, NSW, 2287, Australia
Rachel Sutherland, Elizabeth Campbell, Nicole Nathan, Luke Wolfenden, Karen Gillham, Matthew McLaughlin & John Wiggers
School of Medicine and Public Health, University of Newcastle, Newcastle, 2308, Australia
Rachel Sutherland, Elizabeth Campbell, Nicole Nathan, Luke Wolfenden, Penny Reeves, Matthew McLaughlin & John Wiggers
Hunter Medical Research Institute, Newcastle, NSW, 2300, Australia
Rachel Sutherland, Elizabeth Campbell, Nicole Nathan, Luke Wolfenden, Karen Gillham, Chris Oldmeadow, Andrew Searles, Penny Reeves, Matthew McLaughlin & John Wiggers
Priority Research Centre in Physical Activity and Nutrition, School of Education, University of Newcastle, Newcastle, NSW, Australia
David R. Lubans & Philip J. Morgan
South Western Sydney Local Health District, Locked Mail Bag 7279, Liverpool BC, NSW, 1871, Australia
Central Coast Local Health District, 4-6 Watt Street, Gosford, NSW, 2250, Australia
Mid North Coast Local Health District, P.O. Box 126, Port Macquarie, NSW, Australia
New South Waled Department of Education, Schools Sports Unit, Level 3, 1 Oxford Street, Darlinghurst, NSW, 2010, Australia
RS and EC led the development of this manuscript. RS, EC and JW conceived the intervention concept. JW, RS, EC, NN, LW, PJM, DRL, KG, CO, AS, MW, NE, AB, secured funding for the study. RS, EC, NN, PJM, DRL, LW, KG, CO guided the design and piloting of the intervention. RS, EC, NN, PJM, DRL, LW, KG, CO guided the evaluation design and data collection. PR and AS contributed to the development of data collection methods specific to the cost and cost-effectiveness measures. CO developed the analysis plan. RS, EC, NN, PJM, DRL, LW, KG, CO, AS, PR, MW, NE, AB, RM, MM, JW are all members of the Advisory Group that oversee the program and monitor data. All authors contributed to developing the protocols and reviewing, editing, and approving the final version of the paper.
The study has been approved by the Hunter New England Human Research Ethics Committee (Ref No. 11/03/16/4.05), University of Newcastle (Ref No. H-2011-0210), NSW Department of Education (SERAP 2011111), Maitland Newcastle Catholic School Diocese, Broken Bay Catholic School Diocese, Lismore Catholic School Diocese, Armidale Catholic School Diocese, and the Aboriginal Health and Medical Research Council. To gain consent, a letter inviting schools will be emailed to all Principals, requesting the information be shared with the Head PE teacher. The Principal and/ or Head PE teacher will be contacted by telephone by a dedicated recruitment project officer with PE teacher training. A face-to-face or telephone meeting will be offered to outline the requirements of the study and confirm eligibility. Following school consent, all PE staff will be provided with a study information letter that outlines the purpose of the study and level of involvement expected. To gain consent from parents and students, a letter outlining the study and a student consent form will be sent home. The form will allow consent to be provided separately for participation in accelerometry, anthropometric measures, and student surveys. Parents will be provided with a telephone number to leave a message if they do not want to be prompted about consent or do not want their child to participate in study measurements. Parents who have not returned a consent form or left a message within two weeks will be telephoned by staff employed through the education sector who will explain the study and seek verbal consent using a standardised script.
Consent for publication
Authors RS, EC, NN, LW, KG, MW, NE, AB and JW receive salary support from their respective Local Health Districts. Hunter New England Local Health District contributes funding to the project outlined in this protocol. None of these agencies were involved in the peer review of this grant. RS and NN are Associate Editors for BMC Public Health. All other authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Table S1. Description of identified barriers to implementing the evidence based intervention mapped to the Theoretical Domains Framework and Behaviour Change Wheel’s COM-B and the behaviour change techniques and description of the implementation support intervention. (DOCX 23 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Sutherland, R., Campbell, E., Nathan, N. et al. A cluster randomised trial of an intervention to increase the implementation of physical activity practices in secondary schools: study protocol for scaling up the Physical Activity 4 Everyone (PA4E1) program.
BMC Public Health19, 883 (2019). https://doi.org/10.1186/s12889-019-6965-0