Skip to main content
Download PDF

School and classroom effects on Daily Physical Activity (DPA) policy implementation fidelity in Ontario classrooms: a multi-level analysis

BMC Public Health volume 18, Article number: 802 (2018) Cite this article

Abstract

Background

This paper examines school and classroom effects on Daily Physical Activity (DPA) policy implementation in classrooms in Ontario, Canada. In 2005 the Ontario Ministry of Education mandated a policy requiring school boards to “ensure that all elementary students, including students with special needs, have a minimum of twenty minutes of sustained MVPA each school day during instructional time”. Based on an adaptation of Chaudoir’s conceptual framework, this paper contributes to understanding the extent to which school factors (as reported by administrators) and classroom factors (as reported by teachers) are associated with policy implementation fidelity at the classroom level.

Methods

Cross-sectional online surveys were conducted in 2014 with elementary school administrators and teachers, based on representative random samples of schools and classrooms. A measure assessing implementation fidelity was developed from the six required components of the policy and for this paper fidelity at the classroom level is treated as the outcome variable. Several school- and classroom-level measures were also included in the surveys and a number of these were selected for inclusion here. Data from the two surveys were merged and selected variables were included in the multi-level analysis. Two-level logistic regression models were conducted to account for nesting of classrooms within schools and a series of models were conducted to identify factors associated with implementation fidelity.

Results

The analytic sample for this study included 170 school administrators and 307 classroom teachers from corresponding schools. Findings from the multi-level logistic regression analyses indicated that only classroom/teacher-level factors were significantly associated with implementation fidelity at the classroom level. None of the school/administrator predictors were significantly related to fidelity. The most parsimonious model included five significant classroom/teacher predictors: teachers’ perception of DPA as realistic and achievable; confidence (self-efficacy); scheduling DPA in timetables; lack of space; and lack of time.

Conclusions

Findings from the study indicate the theoretical and practical importance of addressing classroom and teacher factors since they are most proximal to implementation fidelity to the policy. Several of these factors also reflect complex structural and organizational contexts, indicating that a systems approach to understanding and supporting DPA implementation fidelity is warranted.

Peer Review reports

Background

Regular physical activity (PA) participation has been shown to be beneficial for the physical and mental health of children and youth [1,2,3,4] and additionally is associated with academic achievement and increased concentration in school [5,6,7]. These benefits indicate the importance of participating in sufficient PA to meet international guidelines for children and youth specifying 60 min of moderate to vigorous PA (MVPA) per day [8, 9]. Yet engaging in PA on a regular basis is challenging for many children and youth and there are documented declines in PA with increasing age and among females [10, 11].

Since children and youth spend a considerable amount of time in school over several years, this is an important setting in which to provide structured opportunities for PA [4, 12, 13]. By specifying the type and amount of PA offered, school-based policies, curricula and related programs can potentially serve to level the playing field for student PA opportunities. Thus, to the degree that these initiatives are adopted and implemented, schools can provide students with an important contribution to meeting the 60 min of MVPA specified in the guidelines [14].

In order to provide school-based opportunities for children and youth to engage in PA, a number of Canadian provinces have adopted Daily Physical Activity (DPA) policies [15]. These initiatives are normally intended to augment physical and health education classes which are not, for the most part, offered each school day. In 2005 the Ontario Ministry of Education (EDU) released Policy/Program Memorandum (PPM) No. 138: Daily Physical Activity (DPA). This policy requires publicly-funded school boards to “ensure that all elementary students (grades 1-8), including students with special needs, have a minimum of twenty minutes of sustained MVPA each school day during instructional time” [16]. Unique to Ontario is the requirement that DPA be provided during instructional time – not during recess, lunch hour or after school. This provision can be seen as strengthening the initiative since it is incorporated into the curriculum as well as being a provincial policy [17].

A 2012 joint report by Cancer Care Ontario and Public Health Ontario recommended that Ontario’s DPA policy be evaluated since, although the policy was originally released in 2005, no Ontario-wide evaluation had previously been conducted and also to enhance provincial government accountability for this ongoing initiative [18]. In response to this recommendation, a research team conducted a number of sequential studies evaluating the development and implementation of DPA in Ontario [17, 19]. Evaluation of policy implementation is considered to be highly important, since implementation is conceptualized in the broader literature as a central determinant of subsequent intervention impacts and outcomes [20,21,22]. Implementation fidelity is described as “the degree to which an intervention was implemented as it was prescribed in the original protocol or as intended by the program developers” [23]. In the context of the current paper, fidelity refers to the degree to which DPA was implemented as specified in the policy requirements.

Consistent with Social Ecological Theory, [24] a number of factors have been previously described as being associated with implementation of school-based PA policy and curriculum initiatives. For example, intrapersonal factors, particularly at the teacher level, include relevant education and experience with PA, beliefs about the initiative’s importance, and self-efficacy/confidence [25,26,27,28,29]. Interpersonal factors associated with implementation include the degree to which the initiative is supported and prioritized within schools and by other organizations and individuals, such as parents [12, 25, 30, 31]. Organizational-level factors influencing implementation include training, provision of resources, access to a physical education specialist, available time, space and equipment, and lack of accountability such as monitoring [25,26,27, 30, 32,33,34,35,36]. Also, a systematic review of randomized controlled trials examining factors influencing implementation of PA interventions found time, availability of resources, school support, training, self-efficacy, teacher characteristics, and scheduling to be prominent barriers and/or facilitating factors [37].

Findings from a recent study, based on representative random sample surveys of Ontario elementary schools and classrooms, indicated that 61% of schools were implementing DPA in fidelity with the required policy, while 50% of classrooms were implementing DPA in fidelity with the requirements [17]. Additionally, survey findings (analyzed separately for schools and classrooms) indicated that several factors were significantly associated with implementation fidelity at both the school and classroom levels: awareness of policy requirements; scheduling; monitoring; use of resources and supports; perceptions that the policy is realistic and achievable; and a number of specific barriers to implementation [17]. Other factors were significantly associated with implementation fidelity at the classroom level but not the school level, such as self-efficacy for planning and implementing DPA (significant for teachers but not administrators) [17].

Descriptive findings from these surveys provided important policy-relevant information on several salient factors associated with school-level and classroom-level implementation fidelity. However, the findings from analyses of the separate surveys did not address the question of the extent to which school-level (as reported by administrators) and classroom-level (as reported by teachers) are associated with classroom-level DPA policy implementation fidelity. That is, what school-level factors and classroom-level factors are associated with classroom-level fidelity when controlling for their simultaneous effects? Related to this is the question of what is the most parsimonious model predicting classroom-level fidelity? These questions are highly important on both theoretical and applied levels. Conceptual models examining the various factors influencing implementation fidelity implicitly pose questions of the extent to which structural, organizational and individual factors influence implementation outcomes such as fidelity [21].

The current paper addresses these questions using multi-level analysis (MLA) of merged data from the school and classroom surveys. In relation to previous school-based studies of PA and physical education implementation, MLA has been used almost entirely in examining school and classroom influences on student self-reported PA behaviour as an outcome [31, 38]. The closest study to the current one, in both content and methods, is a report of the factors influencing classroom implementation of 15 min of PA each day in elementary schools in British Columbia (Canada) as part of the Action Schools!BC comprehensive school health initiative [25]. In that study, MLA of characteristics of schools and teachers, based on data derived from online surveys of school principals and classroom teachers, indicated that four factors were associated with implementation: level of institutionalization; receiving training; teacher self-efficacy; and attributes of the innovations [25]. Beyond this example, however, there is a gap in understanding the multi-level effects of school and classroom influences on classroom-level PA (including DPA) policy implementation. Our study contributes to a further understanding of these important questions.

In addition to their theoretical importance, these issues are also highly relevant to government and other organizations responsible for providing evidence-informed policy and program interventions/initiatives. For example, should government approaches focus more on initiatives to support and improve implementation fidelity at the school level or the classroom level? By extension, should these approaches be directed to school administrators or classroom teachers? The study reported here addresses these issues by examining both school and classroom influences on classroom-level DPA policy implementation fidelity.

Methods

Study design & sample

As mentioned earlier, a cross-sectional study of Ontario’s elementary schools was conducted between February and June 2014. Participants included school administrators (principals and vice principals) and grade 3, 5, and 7 teachers. These specific grades were selected in order to represent primary, junior and intermediate grade classrooms and to decrease the schools’ administrative burden of including more grades. The study used proportionate stratified random sampling to obtain a representative sample of Ontario’s publicly-funded elementary schools, based on four attributes: school board language (French versus English); school board type (public versus Catholic); location (urban versus rural), and enrolment size (≤200, 201–400, and ≥ 401).

Participant recruitment occurred in multiple stages. First, 40 school boards were approached to conduct the study in randomly sampled schools within their board and, of those, 30 agreed to participate (75% approval rate). Second, 43% of the randomly sampled schools within the respective school boards agreed to participate in the study (228 of 532 schools). An online survey was sent to one administrator from each of the 228 schools and, of those, 209 responded to the survey, resulting in a response rate of 39% (209 of 532) at the administrator level. Afterward, a random sample of 508 teachers from grade 3, 5, and 7 classrooms in schools where a school administrator responded to the survey were invited to participate in an online survey. This resulted in a 60% response rate at the teacher level (307 of 508). Additional details regarding the study methods are provided in a previous paper [17]. Ethical approval for the study was obtained from Public Health Ontario’s Ethics Review Board (ID: 2013–039.01).

Measures

Survey measures for administrators and teachers were developed based on our adapted Chaudoir framework, [17, 21] as well as findings from interviews with key informants who were involved in the initial development and implementation of the DPA policy, [19] existing survey instruments, [39] and DPA materials published by the EDU [16, 40,41,42,43]. The survey measures and process were pre-tested and revised accordingly. The pre-test, which assessed question comprehension, skip patterns, flow and completion time, was completed by the members of the study team and the study Advisory Committee, which included representation from government, education, and public health.

The content of both administrator and teacher surveys were similar but adapted to each respective type of position. Both survey instruments were comprised of seven sections: (1) awareness of DPA policy requirements; (2) perception of DPA policy; (3) scheduling and monitoring of DPA within schools and classrooms; (4) use of DPA resources and supports; (5) perceptions of barriers; (6) self-efficacy; and (7) personal characteristics. Additional questions regarding DPA planning at the school level were also asked of school administrators. School administrators responded on behalf of their school and teachers responded on behalf of their classroom.

Outcome variable: Fidelity to DPA policy

The outcome variable for the current analysis was a dichotomous measure of fidelity to the DPA policy at the classroom level based on the required components of the policy [16]. To assess fidelity to the DPA policy at the classroom level, teachers were first asked whether DPA had been implemented in their classroom at least once during the 2013–2014 school year. Respondents indicating “yes” were asked an additional six questions pertaining to the requirements of the DPA policy: 1) duration; 2) frequency; 3) scheduling during instructional time; 4) intensity; 5) continuity; and 6) inclusivity of children with special needs. Responses to the frequency question were measured in number of days (1–5 days) and the other five questions were measured using a five-point Likert scale (never-always). The responses for all six questions were later assigned a value of 1–5: 1 = never/1 day; 2 = rarely/2 days; 3 = sometimes/3 days; 4 = often/4 days; and 5 = always/5 days. The internal consistency reliability of the 6-item initial scale was high (Cronbach’s coefficient alpha = 0.98) [17]. Afterward, an overall score of fidelity was calculated by taking the sum of the participants’ fidelity scores across the six items. The resulting composite score ranged from 0 to 30. A value of zero was assigned when teachers responded that they had not implemented DPA in their classroom at least once during the 2013–2014 school year. The overall fidelity score was later reclassified into “met DPA policy requirements” (scores 24–30) and “did not meet DPA policy requirements” (scores 0 or 6–23.99). Further details regarding this measure can be found in our previous overview paper [17].

Independent variables

Independent variables at the school and classroom levels were chosen on the basis of theory, existing literature, and findings from our previous studies [17, 19]. At the school level, five variables were selected from the school administrator survey, while at the classroom-level, eight variables were chosen from the teacher survey. These variables are described, along with their respective coding categories in Table 1.

Table 1 Description of independent variables
Full size table

Data analysis

As a preliminary step, descriptive analyses were conducted to explore the distribution of responses by school administrators and teachers. Two-level logistic regression models, with random effect on schools, were then carried out to account for the nesting of classrooms within schools. The analysis examined the relative contribution of classroom/teacher characteristics (level 1) and school/administrator characteristics (level 2) on implementation fidelity to DPA policy at the classroom level. Multicollinearity was examined separately for school and classroom predictors using Variance Inflation Factor (VIF) and none of the predictors showed signs of strong multicollinearity (VIF < 10). At first, an unconditional model (i.e., model without any predictors) was fit to calculate the intraclass correlation coefficient (ICC), which shows the amount of variation in the outcome that is attributable to the group level [44]. ICC was calculated using the formula ICC=Va/(Va + 3.29)*100, where Va is the area level variance and 3.29 is the estimated individual level variance [44]. The ICC was then used to calculate the design effect. The design effect is the ratio of actual variance for a given design to the variance computed under simple random sampling [45] and it is approximately equal to 1 + (average cluster size - 1) x ICC [46].

Series of models were conducted before arriving at a parsimonious model for implementation fidelity to DPA policy. Initially, a saturated model (Model 1) was fit using all of the school-level and classroom-level predictors. Then independent models were fit with solely school-level predictors (Model 2) and classroom-level (Model 3) predictors. Several other models were carried out by removing predictors that were conceptually less relevant and showed lower effect size compared to other predictors before arriving at the final model (Model 4). The contribution of each model was assessed by comparing the difference in deviance (− 2*log-likelihood) [47] and other model fit statistics. Since deviance tests can only be conducted with nested models, all models presented in this study were compared to the saturated model. Akaike Information Criterion (AIC) and Bayesian Information Criterion (BIC) were used to assess the goodness-of-fit of all four models, including non-nested models. AIC and BIC are both based on the maximum likelihood estimates and control for over-fitting in complex models by penalizing free parameters. Smaller values for both information criteria indicate a better fit model. Statistical significance for all models was determined using alpha level of 0.05. All analyses were carried out in SAS 9.3.

Results

A total of 209 school administrators and 307 classroom teachers were included in the original study. The current analyses excluded 39 of the school administrators due to lack of participation at the teacher level in corresponding schools. Thus, the analytic sample for the analyses here included 170 school administrators and 307 classroom teachers from the corresponding schools. The number of participating teachers per school ranged from 1 to 3 (mean = 1.8; SD = 0.7).

The distribution of characteristics for the school boards and schools were similar to that of publicly funded elementary schools in Ontario. The majority of school boards for schools included in the study were English (94%) and publicly funded (68%) (Table 2). Approximately three-fourths of the schools were located in urban areas and about half of the schools had 296 students or more enrolled.

Table 2 School and administrator characteristics (n = 170)
Full size table

The majority of administrators were females (69%), principals (91%), and had 6–15 years of experience (57%). Many administrators (59%) viewed PA as a high priority in their daily life, though 77% had little or no health and physical education training. Eighty-three percent of administrators reported awareness of more than half of the DPA policy components. Only a small percentage of administrators reported the presence of a DPA monitoring procedure in their schools (28%) and frequent use of DPA supports (9%). The majority of administrators (77%) perceived competing curriculum priorities as a barrier for DPA implementation.

The demographics and experience levels of teachers were also similar to that of the administrators. The majority of teachers were females (72%) and had 6–15 years of experience (50%). Details of the teachers’ personal characteristics have been published in our previous paper [17]. Table 3 shows teacher-level predictors, including awareness, perceptions, and use of resources related to DPA, by fidelity to DPA policy. As expected, teachers who reported greater confidence level (self-efficacy) in implementation, increased awareness of DPA policy requirements, and frequent use of DPA resources showed higher percentages for meeting DPA policy requirements compared to their counterparts. Three-fourths of the teachers who perceived DPA policy as realistic and achievable met DPA policy requirements in their classrooms. Time and space were amongst the top implementation barriers reported by teachers (data not shown) [17]. Teachers who strongly agreed/agreed that lack of time and lack of space are implementation barriers reported lower percentage of fidelity to DPA policy compared to those who strongly disagreed/disagreed.

Table 3 Teacher-level predictors, by fidelity to DPA policy requirements (n = 307)
Full size table

Multi-level models showed significant effect by teacher-level predictors on implementation fidelity compared to administrator-level predictors. The ICC value calculated from the unconditional model showed that administrator-level predictors accounted for 5.4% of the variance in implementation of DPA in classrooms. The design effect was 1.04 (1 + (1.8–1)*0.054). MLA is generally not warranted when the design effect is less than two [46]. However, MLA was still carried out in this study due to small cluster sizes and our interest in examining the effects of level-2 variables on fidelity to DPA policy [48].

Findings from the multi-level logistic regression models are shown in Table 4. The saturated model (model 1), with all identified variables, showed teachers’ perception of DPA as realistic and achievable (AOR = 7.40; 95% CI: 2.52–21.76) and teachers’ high confidence in implementing DPA (AOR = 3.08; 95% CI = 1.22–7.76) as the only significant predictors for implementation fidelity to DPA policy. The model with administrator-level predictors alone (model 2) showed no significant findings while the model with only teacher-level predictors (model 3) showed the same significant predictors as the saturated model. In the final model (model 4), three additional variables emerged as significant predictors for implementation fidelity to DPA policy. Teachers’ perception of DPA as realistic and achievable showed the highest odds for implementation. Teachers who strongly agreed/agreed that DPA is realistic and achievable reported 4.63 (95% CI: 1.88–11.44) higher odds for implementing DPA in their classrooms compared to those who strongly disagreed/disagreed. Teachers who reported high confidence level (self-efficacy) in implementing DPA showed 3.39 (95%: 1.47–7.85) higher odds for implementing DPA compared to teachers with low-to-moderate confidence level. Teachers who scheduled DPA in their timetables also reported higher odds (AOR = 2.51; 95% CI: 1.03–6.12) for DPA implementation compared to their counterparts. Those who strongly agreed/agreed that lack of space is a barrier for DPA implementation were 65% less likely to implement DPA policy requirements compared to those who strongly disagreed/disagreed. Teachers who reported a neutral response to lack of time as a barrier were 86% less likely to implement DPA compared to those who disagreed/strongly disagreed.

Table 4 Multi-level model for school-level and classroom-level predictors of implementation fidelity to DPA policy
Full size table

Deviance tests showed model 4 as a better fitting model compared to the saturated model (p-value< 0.01). When comparing the fit of all four models, there was disagreement between AIC and BIC. AIC value was lowest for model 1 and BIC value was lowest for model 4. Given that BIC penalizes complex models more than AIC, [49] model 4 was chosen as the more parsimonious model.

Discussion

The underlying study was the first provincial-level assessment of the status of DPA policy implementation in Canada [17]. The study benefited from access to representative samples of schools and classrooms in Ontario, outcome measures designed to assess fidelity on the six components of the DPA policy, and (for the current analyses) merged data from the two surveys.

A central purpose of the MLA used here was to examine the influences of both school (as reported by administrators) and classroom (as reported by teachers) factors predicting policy fidelity at the classroom level. This is an important consideration since it could be argued that offering DPA (or not) depends largely on decisions of classroom teachers who are the individuals most directly involved in planning and implementing this activity. Yet it is also theoretically and empirically plausible that higher-level (school and administrator) factors could predict classroom fidelity. While a larger number of factors were identified in our earlier examination of predictors of DPA policy implementation in Ontario schools and classrooms, [17] results from MLA suggest that a more limited number of factors predicted implementation in classrooms. Moreover, these are all classroom/teacher-level factors: perception that DPA is realistic and achievable; confidence (self-efficacy) in implementing DPA; scheduling DPA in timetables; lack of space (inversely related) and; lack of time (neutral). None of the school/administrator-level factors that were shown to be significant predictors of school-level policy fidelity in earlier bi-variate analyses proved to be significant predictors of classroom-level policy implementation fidelity when taking both levels of factors into account.

Given these findings, it is tempting to conclude that the significant classroom/teacher- level predictors of classroom policy fidelity are simply reflecting their proximal relationship to the decision to plan and implement DPA in classrooms. To some extent, this may be true. Yet, whether or not the policy is considered to be realistic and achievable may also reflect important (though unmeasured) issues around the structure of schools and schooling: the multiple curricular demands on teachers; emphasis on academic success; and other school-based health and social priorities such as mental health, bullying and safety – all of which may compete to some extent with expectations to offer DPA. Similarly, scheduling DPA on a daily basis indicates attempts to formalize expectations for this activity among a challenging array of externally mandated curriculum expectations and other demands (field trips, assemblies, special events). Lack of space is also clearly situated in objective circumstances and constraints on the extent to which DPA can be accomplished in classrooms containing many desks, chairs and various ages (sizes) of students.

This issue is important on a theoretical level since the results may otherwise appear to indicate that teacher factors alone are the key determinant of policy implementation fidelity. The act of implementing DPA (or not) may be rooted in organizational or structural factors, as suggested by our adapted theoretical framework [17, 21].

Several of the specific factors emerging as significant predictors of DPA in the current study have been identified in other studies of DPA implementation or related initiatives, such as physical education. For example, teacher self-efficacy has been shown to be predictive of implementation of a school-based PA initiative in a British Columbia (Canada) MLA study [25]. As mentioned earlier in the current paper, self-efficacy has also been shown to be associated with PA implementation in a number of descriptive studies and reviews [27, 37, 50]. Studies indicating that availability of time in the curriculum is related to implementation attest to the importance of scheduling DPA and similar initiatives [27, 29, 32, 37]. Also a number of earlier studies found space/facilities to be related to implementation of school PA initiatives [26, 27, 33, 34, 37].

Limitations

Data from the study were based on self-reports of school administrators and classroom teachers, those most directly responsible for offering DPA in these settings. Their assessments of DPA implementation fidelity were based on responses to questions on each of the component requirements of the policy, thus providing a degree of content validity. However, the data were not validated through direct observation or other means.

Since DPA policies are largely unique to provincial settings in Canada, generalization of the findings to other jurisdictions and initiatives beyond Canada is limited. However, the use of activity breaks in some schools in the US and other countries provides some basis of comparison, and some of the challenges of these are similar to those of DPA. Application of the findings to physical education class is more difficult, since these are usually more highly structured components of the curriculum and more likely to be led by specialist rather than generalist teachers. Even so, there are well-documented reports of the challenges of implementing physical education on a regular basis due to such organizational factors as exemptions and other issues [51, 52].

The present study does not include measures that assess structural factors and influences representing the broader context of these issues. However, we know from our earlier assessment of the development and implementation of DPA in Ontario that there were several political, economic and logistical factors influencing how this initiative was planned and rolled out in Ontario school boards [19]. A key factor was negotiation around providing school boards and schools with sufficient flexibility as to how DPA is delivered, while also adhering to the required components of the policy. Also, while DPA is a provincial policy and curriculum requirement, it “competes” with a number of other priorities and requirements at least partly related to the nature of the education system itself. Understanding these contextual factors helps to explain the current findings – especially with respect to such predictors of fidelity as teachers’ perception about whether or not DPA is realistic and achievable, to what extent it is regularly scheduled in teachers’ timetables, and the availability of adequate space to successfully enact DPA sessions.

While the MLA analyses provide new insights as to the salient factors predicting classroom level DPA, we have not examined here the potential mediating and moderating effects of factors within the model. In order to conduct that analysis, structural equation modelling would be required. Future analysis may address these further relationships. In addition, not yet reported qualitative data from open-ended question items in the teacher survey provide additional insights from teachers as to their practical experiences and constraints in planning and implementing DPA in their classrooms.

Conclusions

This study provides important contributions to theory and research, with high relevance to application in school health policy and programs in Canada and elsewhere. Since the MLA identified a more parsimonious model of factors predictive of DPA policy fidelity, a clearer picture emerges of the implications for promoting DPA within the education system. Clearly, teacher self-efficacy is a key positive factor, theoretically grounded, and amenable to modification through training, resources and support. Teachers with higher levels of self-efficacy in implementing DPA are more likely to implement it in fidelity with the policy requirements.

Similarly, findings from the MLA indicate that teacher scheduling of DPA is a key predictor of fidelity. Additional support (and monitoring) by school administrators, school boards and the provincial EDU are likely to increase the practice of regular scheduling of DPA in weekly, monthly and annual timetables. Finally, the provision of sufficient space for DPA presents logistical challenges, indicating the need for innovative and creative approaches by administrators, teachers, and others to address this issue. Our findings suggest that these potential changes, accompanied by teacher perspectives that the policy is realistic and achievable, may be related to higher levels of implementation fidelity to the DPA policy in elementary school classrooms. Since several of these factors are imbedded in complex structural and organizational contexts, a systems approach to support these efforts is recommended.

Abbreviations

AIC:

Akaike Information Criterion

BIC:

Bayesian Information Criterion

CI:

Confidence interval

DPA:

Daily Physical Activity (policy)

EDU:

Ontario Ministry of Education

ICC:

Intraclass correlation coefficient

MLA:

Multi-level analysis

MVPA:

Moderate to vigorous physical activity

OR:

Odds ratio

PA:

Physical activity

PPM:

Policy/Program Memorandum

References

  1. Janssen I, Leblanc AG. Systematic review of the health benefits of physical activity and fitness in school-aged children and youth. Int J Behav Nutr Phys Act. 2010;7:40. https://doi.org/10.1186/1479-5868-7-40.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Centers for Disease Control and Prevention. The association between school based physical activity, including physical education, and academic performance. Atlanta: U.S. Department of Health and Human Services; 2010.

    Google Scholar 

  3. Biddle SJ, Asare M. Physical activity and mental health in children and adolescents: a review of reviews. BJSM Online. 2011;45(11):886–95. https://doi.org/10.1136/bjsports-2011-090185.

    Article  Google Scholar 

  4. Institute of Medicine. Educating the student body: taking physical activity and physical education to school. Washington, DC: The National Academies Press; 2013.

    Google Scholar 

  5. Rasberry CN, Lee SM, Robin L, Laris BA, Russell LA, Coyle KK, et al. The association between school-based physical activity, including physical education, and academic performance: a systematic review of the literature. Prev Med. 2011;52(Suppl 1):S10–20. https://doi.org/10.1016/j.ypmed.2011.01.027.

    Article  PubMed  Google Scholar 

  6. Fedewa AL, Ahn S. The effects of physical activity and physical fitness on children's achievement and cognitive outcomes: a meta-analysis. Res Q Exerc Sport. 2011;82(3):521–35.

    Article  PubMed  Google Scholar 

  7. Watson A, Timperio A, Brown H, Best K, Hesketh KD. Effect of classroom-based physical activity interventions on academic and physical activity outcomes: a systematic review and meta-analysis. Int J Behav Nutr Phys Act. 2017;14(1):114. https://doi.org/10.1186/s12966-017-0569-9.

    Article  PubMed  PubMed Central  Google Scholar 

  8. World Health Organization. Global recommendations on physical activity for health. Geneva: World Health Organization; 2010.

    Google Scholar 

  9. Canadian Society for Exercise Physiology. Canadian 24-hour movement guidelines for children and youth (ages 5-17 years): An integration of physical activity, sedentary behaviour and sleep. http://www.csepguidelines.ca/children-and-youth-5-17. Accessed 21 June 2018.

  10. Allison KR, Adlaf EM, Dwyer JJ, Lysy DC, Irving HM. The decline in physical activity among adolescent students: a cross-national comparison. Can J Public Health. 2007;98(2):97–100.

    PubMed  Google Scholar 

  11. Hobin E, Erickson T, Comte M, Zuo F, Pasha S, Murnaghan D, et al. Examining the impact of a province-wide physical education policy on secondary students’ physical activity as a natural experiment. Int J Behav Nutr Phys Act. 2017;14(1):98. https://doi.org/10.1186/s12966-017-0550-7.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Barnett TA, O'Loughlin J, Gauvin L, Paradis G, Hanley J. Opportunities for student physical activity in elementary schools: a cross-sectional survey of frequency and correlates. Health Educ Behav. 2006;33(2):215–32.

    Article  PubMed  Google Scholar 

  13. Lagarde F, LeBlanc C. Policy options to support physical activity in schools. Can J Public Health. 2010;101(Suppl 2):S9–13.

    PubMed  Google Scholar 

  14. Bassett DR, Fitzhugh EC, Heath GW, Erwin PC, Frederick GM, Wolff DL, et al. Estimated energy expenditures for school-based policies and active living. Am J Prev Med. 2013;44(2):108–13. https://doi.org/10.1016/j.amepre.2012.10.017.

    Article  PubMed  Google Scholar 

  15. Olstad DL, Campbell EJ, Raine KD, Nykiforuk CIJ. A multiple case history and systematic review of adoption, diffusion, implementation and impact of provincial daily physical activity policies in Canadian schools. BMC Public Health. 2015;15(385). https://doi.org/10.1186/s12889-015-1669-6.

  16. Ontario. Ministry of Education: Policy/program memorandum no. 138: Daily physical activity in elementary schools, grades 1–8. Toronto: Queen’s Printer for Ontario; 2005.

    Google Scholar 

  17. Allison KR, Vu-Nguyen K, Ng B, Schoueri-Mychasiw N, Dwyer JJ, Manson H, et al. Evaluation of daily physical activity (DPA) policy implementation in Ontario: surveys of elementary school administrators and teachers. BMC Public Health. 2016;16:746. https://doi.org/10.1186/s12889-016-3423-0.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Cancer Care Ontario, Ontario Agency for Health Protection and Promotion. Taking action to prevent chronic disease: recommendations for a healthier Ontario. Toronto: Queen's Printer for Ontario; 2012.

    Google Scholar 

  19. Allison KR, Schoueri-Mychasiw N, Robertson J, Hobin E, Dwyer J, Manson H. Development and implementation of the daily physical activity policy in Ontario, Canada: a retrospective analysis. PHEnex J. 2014;6(3):1–7.

    Google Scholar 

  20. Brownson RC, Colditz GA, Proctor EK. Dissemination and implementation research in health: translating science to practice. New York: Oxford University Press, Inc; 2012.

    Book  Google Scholar 

  21. Chaudoir SR, Dugan AG, Barr CHI. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8(1):1–20. https://doi.org/10.1186/1748-5908-8-22.

    Article  Google Scholar 

  22. Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3):327–50. https://doi.org/10.1007/s10464-008-9165-0.

    Article  PubMed  Google Scholar 

  23. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Hlth. 2011;38:65–76. https://doi.org/10.1007/s10488-010-0319-7.

    Article  Google Scholar 

  24. McLeroy KR, Bibeau D, Steckler A, Glanz K. An ecological perspective on health promotion programs. Health Educ Q. 1988;15(4):351–77.

    Article  PubMed  CAS  Google Scholar 

  25. Mâsse LC, McKay H, Valente M, Brant R, Naylor PJ. Physical activity implementation in schools: a 4-year follow-up. Am J Prev Med. 2012;43(4):369–77.

    Article  PubMed  Google Scholar 

  26. Brown KMES. ‘It’s not as easy as just saying 20 minutes a day’: exploring teacher and principal experiences implementing a provincial physical activity policy. Univers J Public Health. 2015;3(2):71. https://doi.org/10.13189/ujph.2015.030204.

    Article  Google Scholar 

  27. Mâsse LC, Naiman D, Naylor PJ. From policy to practice: implementation of physical activity and food policies in schools. Int J Behav Nutr Phys Act. 2013;10(1):71–82. https://doi.org/10.1186/1479-5868-10-71.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Robinson DB, Melnychuk NE. A call for PE consultants and specialists: let's get serious about implementing quality PE. PHE J. 2006;72(3):6–11.

    Google Scholar 

  29. Huberty J, Dinkel D, Coleman J, Beighle A, Apenteng B. The role of schools in children’s physical activity participation: staff perceptions. Health Educ Res. 2012;27(6):986–95.

    Article  PubMed  CAS  Google Scholar 

  30. Cardon GM, Van Acker R, Seghers J, De Martelaer K, Haerens LL, De Bourdeaudhuij IMM. Physical activity promotion in schools: which strategies do schools (not) implement and which socioecological factors are associated with implementation? Health Educ Res. 2012;27(3):470–83.

    Article  PubMed  Google Scholar 

  31. Leatherdale ST, Manske S, Faulkner G, Arbour K, Bredin C. A multi-level examination of school programs, policies and resources associated with physical activity among elementary school youth in the PLAY-ON study. Int J Behav Nutr Phys Act. 2010;7:13p. https://doi.org/10.1186/1479-5868-7-6.

    Article  Google Scholar 

  32. Holt E, Bartee T, Heelan K. Evaluation of a policy to integrate physical activity into the school day. J Phys Act Health. 2013;10(4):480–7.

    Article  PubMed  Google Scholar 

  33. Gladwin CP, Church J, Plotnikoff RC. Public policy processes and getting physical activity into Alberta's urban schools. Can J Public Health. 2008;99(4):332–8.

    PubMed  Google Scholar 

  34. Dwyer JJM, Allison KR, LeMoine KN, Faulkner GE, Adlaf EM, Goodman J, et al. A survey of opportunities for school-based physical activity in Ontario elementary schools. PHE J. 2008;73(4):36–42.

    Google Scholar 

  35. Dwyer JJM, Allison KR, Barrera M, Hansen B, Goldenberg E, Boutilier MA. Teachers’ perspective on barriers to implementing physical activity curriculum guidelines for school children in Toronto. Can J Public Health. 2003;94(6):448–52.

    PubMed  Google Scholar 

  36. Patton I. School-based physical activity in children: an evaluation of the daily physical activity program in Ontario elementary schools. London, ON: The University of Western Ontario; 2012.

    Google Scholar 

  37. Naylor PJ, Nettlefold L, Race D, Hoy C, Ashe MC, Wharf Higgins J, et al. Implementation of school based physical activity interventions: a systematic review. Prev Med. 2015;72:95–115. https://doi.org/10.1016/j.ypmed.2014.12.034.

    Article  PubMed  Google Scholar 

  38. Naiman DI, Leatherdale ST, Gotay C, Masse LC. School factors associated with the provision of physical education and levels of physical activity among elementary school students in Ontario. Can J Public Health. 2015;106(5):e290–6. https://doi.org/10.17269/cjph.106.4899 [doi].

    Article  PubMed  Google Scholar 

  39. Shah S, Allison KR, Schoueri-Mychasiw N, Pach B, Manson H, Vu-Nguyen K. A review of implementation outcome measures of school-based physical activity interventions. J Sch Health. 2017;87(6):474–86. https://doi.org/10.1111/josh.12514 [doi].

    Article  PubMed  PubMed Central  Google Scholar 

  40. Ontario. Ministry of Education. Healthy schools resource guide: daily physical activity in schools, guide for school principals. Toronto: Queen’s Printer for Ontario; 2006.

    Google Scholar 

  41. Ontario. Ministry of Education. Healthy schools resource guide: daily physical activity in schools, grades 4 to 6. Toronto: Queen’s Printer for Ontario; 2005.

    Google Scholar 

  42. Ontario. Ministry of Education. Healthy schools resource guide: daily physical activity in schools, grades 1 to 3. Toronto: Queen’s Printer for Ontario; 2005.

    Google Scholar 

  43. Ontario. Ministry of Education. Healthy schools resource guide: daily physical activity in schools, grades 7 and 8. Toronto: Queen’s Printer for Ontario; 2005.

    Google Scholar 

  44. Merlo J, Chaix B, Ohlsson H, Beckman A, Johnell K, Hjerpe P, et al. A brief conceptual tutorial of multilevel analysis in social epidemiology: using measures of clustering in multilevel logistic regression to investigate contextual phenomena. J Epidemiol Community Health. 2006;60(4):290–7.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Statistics Canada. Survey methods and practices. Statistics Canada, Ottawa, Ontario (Canada), 2010. https://www150.statcan.gc.ca/n1/pub/12-587-x/12-587-x2003001-eng.pdf. Accessed 21 June 2018.

  46. Maas CJ, Hox JJ. Sufficient sample sizes for multilevel modeling. Methodology. 2005;1(3):86–92.

    Article  Google Scholar 

  47. Ene M, Leighton EA, Blue GL, Bell BA. Multilevel models for categorical data using SAS PROC GLIMMIX: The basics. Paper 3430-2015. https://support.sas.com/resources/papers/proceedings15/3430-2015.pdf.

  48. Lai MHC, Kwok O. Examining the rule of thumb of not using multilevel modeling: the “design effect smaller than two” rule. J Exp Educ. 2015;83(3):423–38. https://doi.org/10.1080/00220973.2014.907229.

    Article  Google Scholar 

  49. Hastie T, Tibshirani R, Friedman J. Data mining, inference, and prediction. The elements of statistical learning. 2nd ed. New York: Springer-Verlag New York; 2009.

    Google Scholar 

  50. Bowins W, Beaudoin C. Experienced physical education teachers adapting to a new curriculum: perceived facilitators and inhibitors. PHEnex J. 2011;3(1):1–15.

    Google Scholar 

  51. Carlson JA, Sallis JF, Chriqui JF, Schneider L, McDermid LC, Agron P. State policies about physical activity minutes in physical education or during school. J Sch Health. 2013;83(3):150–6. https://doi.org/10.1111/josh.12010.

    Article  PubMed  Google Scholar 

  52. Taber DR, Chriqui JF, Chaloupka FJ. State laws governing school meals and disparities in fruit/vegetable intake. Am J Prev Med. 2013;44(4):365–72. https://doi.org/10.1016/j.amepre.2012.11.038.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We acknowledge useful input from the Ontario Ministry of Education, the Ontario Ministry of Health and Long-Term Care, and the Study Advisory Committee. We also thank participating school boards, school administrators and teachers, and their respective professional associations.

Funding

Funding support for the underlying study (including support for study design and data collection), as well as funding support (through dedicated staff time) for the analyses and interpretation of data and writing the Methods and Results sections of the current manuscript, was provided by Public Health Ontario (PHO), a Crown Agency of the provincial government of Ontario, Canada. No external funding was obtained for the study.

Availability of data and materials

The data sets on which the findings are based are not publicly available. The approved ethics protocol contains no provision to make the raw data or data sets publicly available. Considerable data are reported in the tables available in the current paper. Data collection materials are available from the corresponding author upon reasonable request.

Author information

Authors and Affiliations

  1. KR Allison Research Consulting, 575 Windermere Avenue, Toronto, ON, M6S 3L9, Canada

    Kenneth R. Allison

  2. Public Health Ontario, 480 University Avenue, Suite 300, Toronto, ON, M5G 1V2, Canada

    Anne N. Philipneri, Heather E. Manson, Erin Hobin & Ye Li

  3. The Regional Municipality of York, 50 High Tech Road, Richmond Hill, ON, L4B 4N7, Canada

    Karen Vu-Nguyen

  4. Department of Family Relations and Applied Nutrition, University of Guelph, Macdonald Institute Building, 50 Stone Road East, Guelph, ON, N1G 2W1, Canada

    John J. M. Dwyer

  5. Peel Public Health, 7120 Hurontario Street, Mississauga, ON, L5W 1N4, Canada

    Bessie Ng

Authors
  1. Kenneth R. Allison
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anne N. Philipneri
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Karen Vu-Nguyen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Heather E. Manson
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. John J. M. Dwyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Erin Hobin
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Bessie Ng
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Ye Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

KA served as Principal Investigator on the study, providing scientific oversight and leading the development and writing of the manuscript. AP conducted the data analyses and was responsible for writing the Methods and Results (including the tables). KV was Research Coordinator for the underlying study (including development of measures, data collection, and initial analysis) and contributed conceptually and methodologically to the development of the current manuscript. HM, JD, and EH served as Co-Investigators on the study and contributed conceptually and methodologically to its development and to this manuscript. BN served as a Research Assistant for the study on which the current manuscript is based (including contributing to development of measures, data collection, and initial analysis) and contributed to development of the tables for this manuscript. YL provided statistical expertise to the development and implementation of data analyses. All co-authors reviewed earlier drafts and approved the final manuscript.

Corresponding author

Correspondence to Kenneth R. Allison.

Ethics declarations

Authors’ information

KA, HM, and YL also hold appointments in the Dalla Lana School of Public Health, University of Toronto. KA, KV and BN were earlier at Public Health Ontario and were responsible for the development and conduct of the study on which the current paper is based.

Ethics approval and consent to participate

Ethical approval to conduct the study was received from the Ethics Review Board (ERB) of Public Health Ontario (ERB ID: 2013–039.01) in November, 2013. School administrator and teachers were required to provide informed consent in order to participate in the respective surveys. Specifically, the survey link directed respondents to an information letter and consent form outlining the details of the study and use of the data, and assuring confidentiality. Respondents had to click on the “I consent to participate” button to continue. Those who did not provide consent (by clicking on the “I do not consent to participate” button) were led to a page that confirmed the termination of their survey.

Consent for publication

Not applicable. The manuscript does not include any individual person’s data in any form. All of the reported data are in aggregate form.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Allison, K.R., Philipneri, A.N., Vu-Nguyen, K. et al. School and classroom effects on Daily Physical Activity (DPA) policy implementation fidelity in Ontario classrooms: a multi-level analysis. BMC Public Health 18, 802 (2018). https://doi.org/10.1186/s12889-018-5720-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-018-5720-2

Keywords

BMC Public Health

ISSN: 1471-2458

Contact us