This article has Open Peer Review reports available.
Moderating influences of baseline activity levels in school physical activity programming for children: the Ready for Recess project
© Saint-Maurice et al.; licensee BioMed Central Ltd. 2014
Received: 9 July 2013
Accepted: 29 January 2014
Published: 1 February 2014
A limitation of traditional outcome studies from behavioral interventions is the lack of attention given to evaluating the influence of moderating variables. This study examined possible moderation effect of baseline activity levels on physical activity change as a result of the Ready for Recess intervention.
Ready for Recess (August 2009-September 2010) was a controlled trial with twelve schools randomly assigned to one of four conditions: control group, staff supervision, equipment availability, and the combination of staff supervision and equipment availability. A total of 393 children (181 boys and 212 girls) from grades 3 through 6 (8–11 years old) were asked to wear an Actigraph monitor during school time on 4–5 days of the week. Assessments were conducted at baseline (before intervention) and post intervention (after intervention).
Initial MVPA moderated the effect of Staff supervision (β = −0.47%; p < .05), but not Equipment alone and Staff + Equipment (p > .05). Participants in the Staff condition that were 1 standard deviation (SD) below the mean for baseline MVPA (classified as “low active”) had lower MVPA levels at post-intervention when compared with their low active peers in the control condition (Mean diff = −10.8 ± 2.9%; p = .005). High active individuals (+1SD above the mean) in the Equipment treatment also had lower MVPA values at post-intervention when compared with their highly active peers in the control group (Mean diff = −9.5 ± 2.9%; p = .009).
These results indicate that changes in MVPA levels at post-intervention were reduced in highly active participants when recess staff supervision was provided. In this study, initial MVPA moderated the effect of Staff supervision on children’s MVPA after 6 months of intervention. Staff training should include how to work with inactive youth but also how to assure that active children remain active.
There is considerable public health interest in developing and testing strategies to help youth be more physically active . School-based interventions are a common target due to the opportunity to reach large numbers of youth and the availability of staff and resources , but unfortunately, the success of school-based programming is limited [1, 3].
A limitation of traditional analyses of school-based interventions is that the focus is on evaluating only the overall group-level effects. This provides a limited perspective of the outcomes since it is possible for interventions to have differential effects within the sample population. An intervention, for example, might have benefits for inactive youth but not for others. It is therefore important to conduct follow-up evaluations of the data collected to examine possible moderating influences.
Members of our team recently reported on the outcomes from a recess-based intervention, the Ready-for-Recess (R4R) project, a controlled trial evaluating environmental modifications to promote physical activity during recess . Recess plays a critical role in children’s development and well being [5, 6] and recess time has also been shown to make important contributions to children’s school and total daily activity [7–10]. Ridgers et al., 2012, recently conducted a systematic review to examine activity levels during recess. The review emphasized the need to explore different activity promotion strategies and how these can impact the behaviors of important subgroups (e.g. boys vs. girls) . Other recess-based studies have examined the benefits of adult supervision , and equipment availability during recess , but a unique aspect of R4R was that it evaluated the independent and combined effects of adult supervision and equipment on physical activity during recess. Schools in the R4R study (n = 12) were randomly assigned to one of four conditions: control group, staff supervision, provision of equipment, and the combination of staff supervision and equipment. The combination of staff supervision and equipment availability led to a significant increase of moderate-to-vigorous physical activity (MVPA) in boys (+14.1%) . These findings suggest that recess interventions can be successful when promoting active behaviors among groups of children.
As with most clinical trials , the success of R4R was examined using group-level comparisons with the rate of change across time being defined as a fixed effect. This approach assumes that the amount of change across individuals is the same. While this fixed effects approach is appropriate for the overall evaluation, further work is required so that the assumption of homogeneity across individuals can be examined and to avoid what is defined as the “ecological fallacy” [15, 16].
The inter-individual variability in the context of a PA intervention can be examined by allowing the impact of the interventions to be defined as random in the regression model. A test of homogeneity is used to determine if the rate of change across time is consistent across individuals. If there is variability between individuals one can try to explain this variability and thereby better understand individual determinants of PA. This approach can be undertaken using latent growth curve analysis, which is similar to the classic fixed effects model but with the advantage that researchers can specify predictors in the model as random factors . This approach makes it possible to systematically evaluate factors influencing the consistency of change across individuals.
The purpose of this study was to examine if baseline levels of moderate-to-vigorous physical activity (MVPA) moderated the effects from the various R4R treatments.
The R4R (August 2009-September 2010) project evaluated the independent and combined effects of staff training and equipment on children’s participation in MVPA during daily recess. Twelve schools were randomly assigned to one of four conditions: Staff Training (ST), Equipment (EQ), Staff Training + Equipment (STEQ) or a control condition. We have published a main outcome paper that provides additional details about the R4R intervention .
Elementary children (3rd-6th grades, 8–11 years of age) from 12 participating schools were recruited to participate in the evaluation of the R4R intervention. Demographic information obtained from the school included: age, gender, birth date, race, and free and reduced lunch status. The Ready for Recess intervention study was approved by the Institutional Review Board at University of Nebraska at Omaha. Children that returned signed consent forms were enrolled in the study.
Height and weight data on participants were obtained by the research team using standard field based techniques. However, we had to minimize the disruption of the school schedule at some of the schools and therefore were not able collect this information on the entire sample involved in the study.
Physical activity - accelerometer measure
Physical Activity was assessed with the GT1M Actigraph Accelerometers (Actigraph, Pensacola, FL). Students were asked to wear the activity monitors during the school day (approximately 8:00 AM – 3:00 PM), for 4–5 consecutive days. Members of the research team put the monitors on the children each morning and took them off at the end of the school day to ensure compliance. Teachers provided logs of student attendance and a daily schedule to record time periods for recess, lunch, and physical education.
The data from the Actigraphs were recorded in 5 second epochs and processed using Freedson et al. (2005) age-specific cutpoints (METs = 2.757 + (0.0015 · counts · min-1) – (0.08957 · age [yr]) – (0.000038 · counts · min-1 · age [yr]) . Each epoch during recess was classified as light (1.5 - 3.9 METs), moderate (MPA; 4.0 - 6.0 METs) or vigorous (VPA; > 6.0 METs) and the data were then aggregated to determine time spent in LPA, MPA, VPA and MVPA (MPA + VPA). Participants were included in the final analyses if they were at school (and had data) on at least 3 of the 5 days. Since the activity monitors were only used during school time it was assumed that students wore the monitors during all time unless indicated otherwise by school teachers. Activity outcomes were computed as an average of the valid data extracted from recess periods. The major computed outcome measure was the percent time allocated to MVPA in order to standardize for different lengths of recess.
Latent Growth Curve (LGC) models were used to account for the longitudinal nature of the data (repeated-measures) and potential individual differences (nested within schools) when exposed to the different treatments. The variable Trial (coded as 0 = trial 1, 1 = trial 2) was defined as a level-1 predictor (growth factor), characteristics of the children as level-2 predictors, and schools as level-3 predictors. Post-intervention average percent time in MVPA during recess (activity obtained from valid recess segments) was defined as the main outcome of interest (dependent variable). Level-2 covariates included grade (coded with 0 = 3rd grade, 1 = 4th grade, 2 = 5th grade, and 3 = 6th grade), gender (coded 0 = male and 1 = female), average recess duration (in minutes), and baseline (trial 1) percent time in MVPA during recess. The three treatments were used as level-3 predictors and coded using dummy coding (variable Staff coded 0 = No Staff, 1 = Staff; variable Equipment coded 0 = No equipment, 1 = Equipment; and variable Staff + Equipment coded 0 = No Staff + Equipment, and 1 = Staff + Equipment). Other demographic characteristics of the children such as BMI, race, or social economic status were not included since this information was not available for the entire sample. Only individuals with complete activity data at each assessment (Trial) were included in the analysis.
To examine the direction, magnitude and consistency of the moderation of baseline MVPA on each intervention, least-square means comparing each treatment to the control group were computed (using the final LGC model) at three fixed values based on baseline MVPA scores: Mean - 1 standard deviation, Mean, and Mean + 1 standard deviation (see magnitude and direction of moderation effect). These three categories were operationalized as Low Active, Moderate Active, and High Active, respectively. These comparisons were performed to examine the overall trend over time (across treatments and control group) and also separately for each activity group. A total of 12 least-square means tests with their respective mean difference (Mean diff), standard errors and p-values are reported.
Results from the nested models (test of model fit for level-1 and level-2 predictors) and moderation effects were computed with 95% confidence intervals (p < .05). To account for the increased type I error associated with multiple statistical tests when comparing subgroups of activity, statistical analysis associated with least-square means were performed with a 99% confidence interval and therefore defined as significant if p-value < .01. In addition, mean differences for these analyses were considered borderline significant if p-value was between .01 and .05. Statistical procedures as described above were performed using SAS v9.2 (Cary, North Carolina).
Distribution (N) of gender and grade per intervention group
Inter-individual variability and test of covariates
The latent growth curve model
Regression coefficients for the final latent growth curve model
Trial X ST
Trial X EQ
Trial X STEQ
Trail X baseline MVPA
ST X baseline MVPA
EQ X baseline MVPA
(STEQ) X baseline MVPA
Trial X ST X baseline MVPA
Trial X EQ X baseline MVPA
Trial X (STEQ) X baseline MVPA
Magnitude and direction of the moderation effect
The overall mean score (across treatments and control group) for percent of time spent in MVPA at baseline was 27.5%. Predicted values were estimated by fixing baseline activity values in the final model as 27.5%, 12.5% (−1SD), and 42.4% (+1SD). These predicted activity scores represented Moderate, Low, and High Active groups, respectively. There were significant changes over time for the three groups but the patterns were very different. The Low Active group had a significant increase in MVPA from trial 1 to trial 2 (Mean diff = 6.3 ± 0.9%; t (11) = 6.7; p < .001), while the Moderate (Mean diff = −4.5 ± 0.7%; t (11) = −6.8; p < .001) and High active group (Mean diff = −15.3 ± 0.9%; t (11) = −16.2; p < .001) decreased their MVPA levels (p < .001).
The present study provides new insights about the outcomes from the R4R project. The main outcome paper from the study  reported an overall positive effect of STEQ on boy’s MVPA (+14.1%). Interestingly, there was a decrease on MVPA associated with the ST (boys: -13.5% and girls: -11.4%) and similar results were found for the EQ condition. These results were somewhat surprising since positive effects were expected for both of these independent conditions.
In the present study, we utilized a Latent Growth Curve model to more directly examine the consistency of both individual and subgroup change as a result of the different conditions. In this model, time is defined as a level-1 predictor and the mean (pooled) effects essentially replicate the group patterns evident in the original outcome paper (See Figure 3). Initial analyses demonstrated that there was significant variability around the mean trajectories over time so the nested models focused on predicting individual variation around each of the treatment effects. Baseline levels of MVPA proved to be an important source of variability. These findings were supported as initial MVPA was a significant predictor of MVPA at trial 2 (after 6 months of baseline assessment).
A unique aspect of the present analyses is that we used a similar approach to explore the consistency of this effect for the three primary treatment conditions. The direction of this moderation effect across the three different treatment conditions was specifically examined via higher-order interaction terms (i.e., trial by treatment condition by baseline MVPA). Interestingly, the effect of baseline MVPA on subsequent levels of physical activity was not consistent across the three treatments. The results indicated that initial MVPA moderated the effect of ST, but not EQ and STEQ. In our previous study, we found that ST and EQ were both associated with a pooled negative effect. Participants belonging to schools in these conditions decreased their activity levels after 6 months of intervention .
The examination of high-order interactions indicated that change in MVPA levels for children in the ST condition were significantly affected by their baseline MVPA levels. Per each unit increase in baseline MVPA scores, there was a 0.47% attenuation on the differential effect of Staff on MVPA score changes from trial 1 to trial 2. The attenuation means that less active participants were more negatively affected by the presence of trained staff than their more active peers. Surprisingly, the trend was reversed for participants in the EQ condition. The effect was negative but the magnitude of the effect was greater in High Active participants. Nevertheless, the moderation effect of baseline MVPA in this condition was non-significant (p > .05). Less active participants in the STEQ condition reacted more positively to this intervention however, the moderation effect for STEQ was also not significant (possibly due to lack of statistical power).
While the moderation effect was not significant for all treatments, it is noteworthy that the less active children (i.e., those who spent approximately 12% of their recess time in MVPA) were shown to be more responsive to the ST and STEQ conditions. Low active children had declines in time spent in MVPA (~11%) when exposed to staff supervision but increases in MVPA (~6%) when staff utilized recreational equipment and implemented games. Interestingly, similarly to the ST findings, the effect of equipment was also negative but reversed, meaning, those who were more active had greater declines in MVPA. In conclusion, staff training reduced physical activity levels, in low and medium active children.
The examination of these relationships has great value to public health researchers, particularly those interested in promotion strategies for physical activity in elementary children. Many school based interventions have been conducted to promote physical activity behavior in youth. Studies have examined interventions during PE class, in class time, during recess and after school. The common form of analyses conducted in these trials has focused on mean responses of groups of children. The results of the present study provide important insights because it suggests that interventions may have varying effects on different segments of the population. A previous analysis  revealed some important differences by gender with regard to physical activity during recess. A recent meta-analysis also suggested that age, and both duration and type of intervention can moderate the effect of PA promotion initiatives during recess . As illustrated by this review, there is a lack of research on the moderation effect of typical activity levels. The present analyses reveal moderation of intervention effects by baseline levels of MVPA. Individuals conducting school-based projects should consider the possible differential effects of programming on different segments of the population. Ideally, interventions should be set up to enhance physical activity opportunities for low active youth  without detracting from physical activity opportunities in already active youth.
The results of this study suggest that low active youth are more responsive to changes in the environment of school recess programming, but the effects depend on the nature of the intervention. Staff training sites had staff trained to increase physical activity during recess time. This strategy affected the expected trend in activity from trial 1 to trial 2 (illustrated by the control group) and led to a decrease in activity levels in low active groups. This may be because the structure allowed more active and skilled youth to dominate games. Interestingly, low active individuals’ activity was not negatively affected by the presence of equipment alone. This may be because the equipment gets claimed by more active (and perhaps more dominant) youth in a recess environment. In contrast, activity patterns of low active youth were significantly increased when staff training and equipment were provided (STEQ).
Activity levels of highly active individuals seem to be unaltered when exposed to staff supervision or a combination of both staff and equipment. However, the presence of equipment tended to cause decreases in levels of MVPA. This may be because the equipment became more interesting than the active games that children play when equipment is not provided.
Some limitations of this study should be considered when interpreting the results. As described in the main outcome paper , there was no fidelity testing, so it is not possible to quantify the degree of staff involvement and or the compliance with the training provided. This could influence the results and conclusions regarding this condition. Another possible concern is a possible ‘regression to the mean’ effect  that can be present when baseline measures of the outcome variable are used to predict change over time . Our results indicated that the magnitude of individual MVPA changes over time differed between two conditions (Staff and Equipment) even though group slopes were similar (see Figure 3). Moreover, these changes did not follow similar regression to the mean trends evidenced by the control group. The individual effects were statistically significant for less active individuals in the ST condition but not in the EQ condition. The opposite was found for more active individuals. More active individuals in the EQ condition were significantly affected but similarly active individuals in the ST condition were not significantly affected. Thus, these findings support the idea that differential changes over time in subgroups of individuals could be explained by the R4R intervention and not regression to the mean. Finally, the inclusion of BMI and additional individual-level predictors such as race and/or socio-economical status, in our models could have explained additional variability in the effects of the ready for recess. However these predictors are known to be related with PA and therefore their inclusion might have resulted in over adjustment of our model.
The findings from this study provide an important contribution to the field of physical activity and public health. Understanding the differential reactivity effect when children are exposed to different PA promotion strategies can help researchers and policy makers choose appropriate intervention designs based on population needs. For example, less active individuals will benefit more from interventions involving supervised staff combined with equipment availability. Children with higher activity levels seem to benefit to a lesser extent. The results from this study could not confirm the broader benefit from this strategy.
This study complements findings from a previous Ready for Recess study . The potential of different strategies to increase active behaviors should be further examined taking into consideration typical activity levels. The detailed and comprehensive examination of the MVPA outcome did not allow a parallel comparison with sedentary behavior. However, this outcome also has important implications for children’s health and therefore should be examined separately.
The authors would like to acknowledge the graduate assistants Erin Johnson, Sara Wolfe, and Alison Jergenson for their hard work during data collection and entry.
Source of funding
The following authors PSM, GW, DR, JH also disclose any commercial associations, current and over the past 5 years, that might pose a conflict of interest. These include but are not limited to consultancies, including those for investment companies; stock or other equity ownership; stock options; patent licensing arrangements; and payments for conducting or publicizing the study.
- Metcalf B, Henley W, Wilkin T: Effectiveness of intervention on physical activity of children: systematic review and meta-analysis of controlled trials with objectively measured outcomes (EarlyBird 54). BMJ. 2012, 345: e5888-10.1136/bmj.e5888.View ArticlePubMedGoogle Scholar
- Centers for Disease Control and Prevention: School health guidelines to promote healthy eating and physical activity. MMRW, Volume 60 (RR- 5). 2011, 1-76.Google Scholar
- Kriemler S, Meyer U, Martin E, van Sluijs EM, Andersen LB, Martin BW: Effect of school-based interventions on physical activity and fitness in children and adolescents: a review of reviews and systematic update. Br J Sports Med. 2011, 45: 923-930. 10.1136/bjsports-2011-090186.View ArticlePubMedGoogle Scholar
- Huberty JL, Beets MW, Beighle A, Saint-Maurice PF, Welk G: Effects of ready for recess, an environmental intervention, on physical activity in 3rd - 6th grade children. J Phys Act Health. 2013, in pressGoogle Scholar
- Ramstetter CL, Murray R, Garner AS: The crucial role of recess in schools. J Sch Health. 2010, 80: 517-526. 10.1111/j.1746-1561.2010.00537.x.View ArticlePubMedGoogle Scholar
- Pellegrini A, Smith P: School recess: implications for education and development. Review of Educational Research. 1993, 63: 51-67. 10.3102/00346543063001051.View ArticleGoogle Scholar
- Erwin H, Abel M, Beighle A, Noland MP, Worley B, Riggs R: The contribution of recess to children's school-day physical activity. J Phys Act Health. 2012, 9: 442-448.PubMedGoogle Scholar
- Ridgers ND, Saint-Maurice PF, Welk GJ, Siahpush M, Huberty J: Differences in physical activity during school recess. J Sch Health. 2011, 81: 545-551. 10.1111/j.1746-1561.2011.00625.x.View ArticlePubMedGoogle Scholar
- Ridgers ND, Timperio A, Crawford D, Salmon J: Five-year changes in school recess and lunchtime and the contribution to children's daily physical activity. Br J Sports Med. 2012, 46: 741-746. 10.1136/bjsm.2011.084921.View ArticlePubMedGoogle Scholar
- Saint-Maurice PF, Welk GJ, Silva P, Siahpush M, Huberty J: Assessing children's physical activity behaviors at recess: a multi-method approach. Pediatr Exerc Sci. 2011, 23: 585-599.PubMedGoogle Scholar
- Ridgers ND, Salmon J, Parrish AM, Stanley RM, Okely AD: Physical activity during school recess: a systematic review. Am J Prev Med. 2012, 43: 320-328. 10.1016/j.amepre.2012.05.019.View ArticlePubMedGoogle Scholar
- Connolly P, TL M: Effects of a game intervention on the physical activity levels of children at recess. Res Q Exerc Sport. 1995, 66: A66-Google Scholar
- Verstraete SJ, Cardon GM, De Clercq DL, De Bourdeaudhuij IM: Increasing children's physical activity levels during recess periods in elementary schools: the effects of providing game equipment. Eur J Public Health. 2006, 16: 415-419. 10.1093/eurpub/ckl008.View ArticlePubMedGoogle Scholar
- Parrish AM, Okely AD, Stanley RM, Ridgers ND: The effect of school recess interventions on physical activity: a systematic review. Sports Med. 2013, 43: 287-299. 10.1007/s40279-013-0024-2.View ArticlePubMedGoogle Scholar
- Bryk SA, Raudenbush SW: Hierarchical Linear Models - Applications and Data Analysis Methods. 1992, Thousand Oaks, CA: Sage Publications, 2Google Scholar
- Preacher KJ, Wichman AL, MacCallum RC, Briggs NE: Latent Growth Curve Modeling. 2008, Thousands Oaks, CA: Sage PublicationsView ArticleGoogle Scholar
- Freedson P, Pober D, Janz KF: Calibration of accelerometer output for children. Med Sci Sports Exerc. 2005, 37: S523-S530. 10.1249/01.mss.0000185658.28284.ba.View ArticlePubMedGoogle Scholar
- Erwin HE, Ickes M, Ahn S, Fedewa A: Impact of recess interventions on children's physical activity-a meta-analysis. Am J Health Promot. 2014, 28: 159-167. 10.4278/ajhp.120926-LIT-470.View ArticlePubMedGoogle Scholar
- Fairclough SJ, Beighle A, Erwin H, Ridgers ND: School day segmented physical activity patterns of high and low active children. BMC Public Health. 2012, 12: 406-10.1186/1471-2458-12-406.View ArticlePubMedPubMed CentralGoogle Scholar
- Bland JM, Altman DG: Regression towards the mean. BMJ. 1994, 308: 1499-10.1136/bmj.308.6942.1499.View ArticlePubMedPubMed CentralGoogle Scholar
- Vickers AJ, Altman DG: Statistics notes: analysing controlled trials with baseline and follow up measurements. BMJ. 2001, 323: 1123-1124. 10.1136/bmj.323.7321.1123.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/14/103/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.