- Study protocol
- Open Access
The Healthy Primary School of the Future: study protocol of a quasi-experimental study
BMC Public Health volume 16, Article number: 639 (2016)
Unhealthy lifestyles in early childhood are a major global health challenge. These lifestyles often persist from generation to generation and contribute to a vicious cycle of health-related and social problems. This design article presents a study evaluating the effects of two novel healthy school interventions. The main outcome measure will be changes in children’s body mass index (BMI). In addition, lifestyle behaviours, academic achievement, child well-being, socio-economic differences, and societal costs will be examined.
In close collaboration with various stakeholders, a quasi-experimental study was developed, for which children of four intervention schools (n = 1200) in the southern part of the Netherlands are compared with children of four control schools (n = 1200) in the same region. The interventions started in November 2015. In two of the four intervention schools, a whole-school approach named ‘The Healthy Primary School of the Future’, is implemented with the aim of improving physical activity and dietary behaviour. For this intervention, pupils are offered an extended curriculum, including a healthy lunch, more physical exercises, and social and educational activities, next to the regular school curriculum. In the two other intervention schools, a physical-activity school approach called ‘The Physical Activity School’, is implemented, which is essentially similar to the other intervention, except that no lunch is provided. The interventions proceed during a period of 4 years. Apart from the effectiveness of both interventions, the process, the cost-effectiveness, and the expected legal implications are studied. Data collection is conducted within the school system. The baseline measurements started in September 2015 and yearly follow-up measurements are taking place until 2019.
A whole-school approach is a new concept in the Netherlands. Due to its innovative, multifaceted nature and sound scientific foundation, these integrated programmes have the potential to form a template for primary schools worldwide. The effects of this approach may extend further than the outcomes associated with well-being and academic achievement, potentially impacting legal and cultural aspects in our society.
The study protocol was registered in the database ClinicalTrials.gov on 14-06-2016 with the reference number NCT02800616.
Unhealthy lifestyles, bred by low levels of physical activity and unhealthy dietary behaviours, are a persistent problem in Western societies . Such lifestyles are usually adopted at a young age, and often persevere into adulthood . Even in early childhood, unhealthy behaviours contribute to major issues such as a reduced health-related quality of life (HR-QoL), psychosocial problems, and chronic diseases including obesity [3–5]. In the long run, this often results in higher health care costs, reduced academic achievement, reduced labour participation, and a lower socio-economic status (SES) [5, 6]. A vicious circle is likely to emerge, transferring problems from one generation to the next. It is clearly a major challenge for public health professionals to break this tenacious pattern.
In efforts to reverse the public health epidemic, the school setting is an ideal environment for promoting healthy lifestyles. A school setting enables multiple aspects of health promotion (education, social environment, physical environment, school health policy, parenting) to be modified, thereby facilitating successful implementation . For instance, the school setting offers the advantages of facilitating compliance with an intervention and also enables preventive measures to reach children from a variety of socio-economic and ethnic backgrounds [8, 9]. The Dutch primary school system in particular, leaves much room for improvement with respect to nutrition, and physical activity during the school day . In addition, there is some preliminary evidence that lifestyle interventions improve academic achievements, thereby helping schools to achieve their primary academic goals [11–13].
Worldwide, many school-based health interventions have been evaluated . Over 80 % of these interventions reported at least one positive effect on risk factors for non-communicable diseases (e.g. obesity, physical inactivity, smoking, inadequate or poor nutrition) . Despite the relatively high costs of school-based interventions, existing programmes have been found to be cost-effective in terms of body mass index (BMI) improvements and HR-QoL gains [16, 17]. Normalized BMI distributions, gathered across the entire school population, provide an informative outcome measure for the evaluation of such interventions. Newly learned healthy lifestyle habits are likely to lead to favourable weight changes among overweight and obese children, as well as underweight children, but are also likely to stimulate children with a healthy weight to maintain their weight. Admittedly, the potential of school-based interventions to normalize BMI is found to be modest [14, 15, 18]. The most frequently reported reasons for this modest effectiveness are low parental involvement, a short duration of the intervention, and a lack of a whole-school approach [14, 15, 18–21]. It is often considered difficult to acquire the necessary support and deal with the high costs and efforts that need to be made to implement multicomponent interventions. As a result, schools often choose less intense single-component interventions. Physical education seems to be one of the most viable components to effectively decrease obesity rates in schools [20, 22]. Despite the implementation benefits of single-component interventions, however, a whole-school approach should always be preferred, as newly acquired lifestyle habits are more likely to last if embedded within an integrated approach.
We present a study protocol that examines the effectiveness of two novel, integrated healthy school interventions. One is a full intervention called ‘The Healthy Primary School of the Future’, the other is a partial intervention called ‘The Physical Activity School’. These intervention approaches will be compared with the regular school approach that is currently common practice in the Netherlands. We hypothesize that these healthy school interventions will result in normalized BMI distributions that are more in line with national and international standards (smaller standard deviations) among primary school children, with a more pronounced effect in the full intervention schools (due to the expected synergy between exercise and diet) than in the partial intervention schools. Also, our multi-disciplinary research group will study a wide range of outcome measures, including lifestyle behaviours, academic achievement, child well-being, socio-economic differences, and societal costs. Moreover, an evaluation will be performed of the legal consequences of a healthy school approach in the Netherlands, as well as the conflicting interests of the stakeholders.
Our primary research question is: What is the effect of the full intervention (‘The Healthy Primary School of the Future’) on the BMI of primary school children compared to no intervention (control schools)? Our secondary research question is: What is the effect of the full intervention on the BMI of primary school children compared to the partial intervention (‘The Physical Activity School’)?
Our tertiary research questions are: (1) What is the effect of the full intervention in comparison with the partial intervention and the regular school approach (control schools) on: (a) children’s levels of physical activity and sedentary behaviour, nutritional knowledge, healthy food preferences and behaviour, cognitive and non-cognitive performance, HR-QoL, socio-emotional development, and sick leave? (b) parenting and teacher practices regarding physical activity and nutrition? (c) parental HR-QoL, well-being, labour participation and sick leave? (d) benefits across different socio-economic backgrounds? (e) long and short term cost-effectiveness? (f) satisfaction among the involved stakeholders (children, parents, teachers, and child care partners)? (2) Which determinants influence the quality of the implementation of the intervention? (3) What is the scope of children’s human rights to health, what is the legal role of primary schools in realizing these rights (e.g., obligations and responsibilities of state and non-state actors, conflicts of interests and legal solutions to these conflicts), and is the intervention feasible within Dutch educational law?
Setting and study design
The current study has a quasi-experimental design with four intervention schools and four control schools. All participating schools are primary schools situated in the Parkstad region in the Province of Limburg, in the southern part of the Netherlands. This is a relatively poor region with a low SES in which unhealthy lifestyles are highly prevalent [23, 24]. Overweight and obesity rates are substantially higher than the national average in the Netherlands . The intervention schools and control schools are both members of the MOVARE educational board. In the Dutch primary school structure, pupils successively follow eight ‘groups’, starting in group 1 at the age of 4 and typically proceed to secondary school at the age of 11 or 12. Internationally, the first two groups are comparable to pre-school and the last six groups are comparable to grades 1–6.
Two schools take part in the full intervention named ‘The Healthy Primary School of the Future’. Two other schools implement the partial intervention named ‘The Physical Activity School’ (Fig. 1). No randomization was applied, because full voluntary cooperation and participation of the intervention schools is required for the implementation of the interventions. The population consists of a dynamic cohort comprising children in groups 1–8 (Table 1). Baseline measurements were conducted in September-October 2015, and yearly follow-up measurements will take place until 2019. The intervention started in November 2015.
Almost all schools in the southern part of the Netherlands participate in the health monitoring programme of the regional Public Health Services (GGD) and the OnderwijsMonitor Limburg, a collaboration between Maastricht University, schools and school boards to collect data from children at school in Limburg [26, 27]. This allows us to put the measures of this intervention into the perspective of the total school population of the wider Limburg region.
Recruitment of schools and subjects
Recruitment of intervention schools
In March 2013, 12 out of 53 schools governed by the MOVARE educational board were informed about the study. These schools were selected because of their supportive geographical environment (e.g., sufficient sports facilities in the area and supportive local politicians). Out of these 12, we aimed to recruit four large intervention schools with a minimum of 140 children per school in groups 2, 3, 4 and 5. Four schools gave their initial consent and started to raise support from all stakeholders (e.g., parents, children, partners of the school) and to develop the intervention together with partners. Eventually, two of the four schools gave their approval for the full intervention. A third school received enough support from stakeholders to implement the partial intervention and a fourth school dropped out because of a lack of support among school staff and parents. After the withdrawal of this school, another school from the same educational board was recruited to implement the partial intervention. The recruitment of all intervention schools was completed in July 2015.
Recruitment of control schools
From all schools of the MOVARE educational board, four control schools were recruited with a minimum of 140 children per school in groups 2, 3, 4 and 5. All schools that voluntarily agreed to participate could join the study, and no inclusion or exclusion criteria were set. The recruitment of the control schools was completed in January 2015. The control schools are characterized by a school environment that is representative of schools in the Netherlands in terms of lifestyle education, school hours and number of physical education (PE) classes.
The intervention and control schools are comparable in terms of socioeconomic status and there are no statistically significant differences in academic performance, as measured at baseline by the so-called CITO scores (see the section on Children's academic achievements).
Recruitment of subjects
The recruitment of the children for the baseline measurement was completed in October 2015. Until 2019, all new children entering the intervention and control schools will be invited to participate in the study (Table 1). For the baseline measurement, children were recruited by means of information brochures sent by mail, and reminders by the school staff. In addition, the research team visited all classrooms to inform children about the study and to encourage them to participate. All children of the intervention and control schools are eligible to participate in this study (Table 1). Children who switch schools during the four-year study period will not be followed up with the extensive measurement programme, but we do have the outcome variables collected by the OnderwijsMonitor Limburg and GGD for these children.
The interventions are based on the socio-ecological approach to school health promotion, focusing on the wider picture of interrelationships between individuals with their personal characteristics (e.g., children and their parents), and their environment (e.g., the school and its neighbourhood) . The interventions focus on multiple aspects (education, social environment, physical environment, school health policy, parental practices) and aim to influence multiple settings (school, home environment, school neighbourhood).
Both school interventions, ‘The Healthy Primary School of the Future’ and ‘The Physical Activity School’, involve making changes to school hours and physical activity. School hours are extended to facilitate implementation of the interventions. Children attend school from 08:30 to approximately 15:30/16:00 instead of 8:30 to 12:30 and 13:30 to 15:00. These school hours allow educational activities to be more in line with children’s bio-rhythm . Where possible, schools use the 10:00–12:00 and 14:00–15:30/16:00 time-slots for cognitive tasks, as previous studies suggest that children can concentrate better during these timeframes than during those used in regular school environments . With regard to physical activity, the schools offer a structured programme including sports, play and creativity for at least 1 hour a day for 4 days a week, guided by the pedagogical staff (Table 2).
The full intervention schools provide a healthy morning snack and healthy lunch every day. Lunch is provided in the classroom or in a central location in the school. A variety of food products from all food groups are available, from which children can choose. The products are carefully selected to meet the guidelines of the Netherlands Nutrition Centre Foundation. Pedagogical staff will supervise the lunch sessions to make sure that the children choose products from all recommended food groups and that they choose the recommended portion sizes. The lunch cycle changes every 10 weeks.
In addition to these compulsory implementations, both the full and the partial intervention schools can choose to offer additional activities (Table 2). To support and encourage the schools, we searched for relevant and evidence-based additional activities, using a systematic health promotion approach, based on the PRECEDE-PROCEED model [7, 29] and the Intervention Mapping protocol . A diagnosis of the health problems (step 1) and associated behavioural and environmental factors (step 2) resulted in behaviour goals, e.g. children using active transport to school and children eating two pieces of fruit a day. We also searched the literature for determinants that influence these behaviour goals (step 3). Next, the resulting overview of determinants was used to search for evidence-based activities or best practices available nationally or internationally (step 4) . Schools are free to choose the activities which best fit their possibilities and goals. Employees of the regional Public Health Services (GGD) and community sports coaches support stimulate the school in this decision-making process.
Additional activities focus on school health policy. Creating policy on health topics, for example on healthy birthday treats, should clarify what social norms are important to the school, making the communication with parents easier and more consistent. Additional activities also focus on health education. A healthy lifestyle education programme is expected to promote healthy nutrition (fruit, vegetables, fibre-rich products, lower fat and lower sugar products and normalized portion sizes), physical activity (reduction of sedentary behaviour, increase in moderate- to high-intensity physical activities, compliance with the Dutch standards for healthy behaviour), and socio-emotional well-being (increased self-esteem, executive control function, decreased bullying). The educational activities incorporate interactive lessons, and games to increase knowledge of, and familiarity with, healthy food products and physical activities. Schools intend to set aside at least 1 hour per week in the school curriculum for health education.
Additional activities are implemented with the aim of creating an optimal social and physical environment to make healthy choices easier. For instance, schools can choose to increase PE classes and/or increase the intensity of the existing PE classes. The schoolyard can be equipped with low-cost facilities to encourage physical activity, such as play equipment and balls. Sports clubs can be introduced to the schools to give introductory lessons to the children. Short physical activity breaks can be incorporated during lessons in order to reduce sedentary time. These breaks can occur in the classroom (e.g. games involving physical movements, interactive dances), or outside in the schoolyard. Regarding nutrition, the schools are stimulated to choose additional activities such as food tasting, gardening (i.e., growing vegetables), and the distribution of water bottles.
Finally, several additional activities are aimed at parents to stimulate parental involvement and encourage the successful transfer of a healthy lifestyle from school to home.
An overview of all outcome measures and the corresponding informants (e.g., child, parent, teacher, or other) is presented in Table 3. All measurements will be completed yearly unless stated otherwise. Measurements involving the children will be obtained in groups, during regular classes, except for the anthropometric measurements. All questions will be tailored to the different age categories and include numerous graphical illustrations. No open-ended questions will be used. All questionnaires have been pretested several times in comparable populations and settings. In the youngest groups (groups 2–4), the questions will be read out by the teacher or a research assistant, and answered in writing by the children. The oldest children (groups 5–8) will read and fill in the questionnaires themselves. During the completion of the questionnaires, a teacher and at least one researcher will be present to monitor the process and to answer questions. The majority of the child-related measurements will be scheduled during one regular school week to avoid overburdening the children and school staff. Children in group 1 will be excluded from most measurements, as their young age (4 years in September) complicates most of the measurements. Also, not all group 1 children will attend school yet during the measurement periods (September-October), as children in the Netherlands gradually enter group 1 during the school year, depending on their birthday. Parents of children in groups 1–8 will receive an online questionnaire and teachers of all classes will receive a short questionnaire on paper. Privacy-sensitive questions, such as parental BMI, SES and disease status will not be mandatory to complete.
Children’s general health
Weight is measured to the nearest 0.1 kg (Weighing Scale 803, Seca, Hamburg, Germany) and height is measured to the nearest 0.1 cm (Stadiometer 213, Seca, Birmingham, United Kingdom). Children are measured with light clothing and no shoes. BMI Z-scores are calculated using Dutch reference values . The primary outcome measure is the absolute change in BMI Z-score, as we aim for BMI scores closer to the national and international standards with smaller standard deviations, which will be reflected in a decrease of BMI in overweight and obese children and an increase of BMI in underweight children. Hip and waist circumferences are measured with a measuring tape to the nearest 0.1 cm, following the World Health Organization’s assessment protocol (model 201, Seca, Hamburg, Germany) . Handgrip strength is measured with a calibrated Jamar hydraulic hand dynamometer (model 5030 J1, Jamar, Huthwaite, United Kingdom) to the nearest 0.5 kg . All anthropometric measurements are performed twice, and a third measurement is conducted if the difference between the first two measurements exceeds a pre-set limit (weight ≥ 0.2 kg, height ≥ 0.5 cm, hip and waist circumference ≥ 1.0 cm, handgrip strength ≥ 1 kg).
Disease status since birth, hospital admissions (number and duration), healthcare visits (number), and medication use in the previous 12 months are measured by the online parental questionnaire. The wording of all disease status items are based on a questionnaire used in a previous study, tailored to the school-age population . Blood pressure measured between the ages of 4 to 6, birth weight and additional information on disease status are obtained from the regular GGD measurements.
Children’s health-related quality of life and psychosocial functioning
The validated EuroQol 5-Dimensions Youth version questionnaire (EQ-5D-Y) and the proxy version for parents are used to measure children’s HR-QoL . Child-specific HR-QoL is measured by the validated Paediatric Quality of Life Inventory (PedsQL) and parents complete the proxy version of this questionnaire [37, 38]. Psychological attributes (emotional symptoms, conduct problems, hyperactivity/inattention, peer relationship problems and prosocial behaviour) are measured by means of the Strength and Difficulties Questionnaire, a well-validated index of psychosocial functioning in children [39, 40].
Social, emotional, and academic self-efficacy is assessed in younger children using three questions from the Self-Efficacy Questionnaire for Children (SEQ-C), which is rated using a Manikin scale [41, 42]. Children in groups 7–8 complete the full 24-item version of the SEQ-C . Self-confidence, social skills, self-efficacy, school well-being, future expectations, and social support are measured by the OnderwijsMonitor Limburg programme.
Children’s physical activity behaviour
Physical activity levels are assessed objectively using the Actigraph accelerometer (Actigraph, GT3X+, Actigraph, Pensacola, United States). The monitor is attached to the right hip with an elastic band. All children are instructed to wear the device for seven consecutive days. The device should be worn all day except during sleeping hours and activities involving water (e.g., swimming, bathing, or showering). In the same week, parents fill in a short activity diary on their child’s physical activity and swimming behaviour and exceptional circumstances (e.g., illness of the child). In each participating school, ten randomly selected children in group 5 are equipped with a second activity monitor for 1 week, the ActivPal accelerometer (VTaP, ActivPal, Glasgow, Scotland). This accelerometer is attached to the right upper leg using tape. The ActivPal accelerometer measures postural allocation more accurately than the Actigraph, enabling us to detect sedentary behaviour patterns in more detail .
During PE lessons, children perform a 20-m shuttle run test, better known as the Progressive Aerobic Cardiovascular Endurance Run (PACER) as a measure of their cardiorespiratory fitness . Children are encouraged to continue the test until exhaustion. Children do not perform the shuttle run test while wearing the accelerometer, as the aim is to measure usual activity patterns during a regular school week. Self-reported sports club membership, active forms of transport to school, and leisure time physical activities (e.g., children’s activities in weekends: watching TV, music or theatre, playing outdoors, practicing sports etc.) are assessed in both children and parents.
Children’s dietary behaviour
Food intake is measured by a combination of a food frequency questionnaire and a dietary recall tool to be completed by both children and parents. The food intake questionnaire was designed for this target group based on two questionnaires developed by Van Assema et al. [45, 46]. Items of this questionnaire include fruit and vegetables, soft drinks, sports and energy drinks, and snacks. Dietary recall is used to assess the composition of breakfast and lunch. The questions about lunch intake are asked in the classroom immediately after the lunch break. Children are not pre-informed that they are going to be asked about dietary consumption, to avoid a potential effect of the questionnaires on children’s dietary patterns.
In addition, food preferences and familiarity with healthy food products are assessed. The questions mainly consist of pictures of food items, for which children can indicate whether they have ever eaten these items and whether they like them or not. These questions were developed based on an existing instrument previously used in the INPACT study .
Parental BMI is assessed by self-reported height and weight of both parents/caregivers. Parental practices regarding nutrition are determined by a shortened version (nine items) of the Comprehensive Snack Parenting Questionnaire (CSPQ) . Parental practices regarding physical activity are assessed by a questionnaire developed in the same style as the CSPQ. Parental well-being and HR-QOL are measured by the Satisfaction With Life Survey (SWLS) questionnaire and the EuroQol – 5-Dimensions Questionnaire (EQ-5D), respectively [49, 50].
Labour participation of parents is assessed by current employment status. Current employment status is combined with parental education level and household income to determine SES. All questions about SES have been derived from previous, large-scale Dutch studies, including those specifically addressing socio-economic inequalities in health [51–53]. In addition, parents are asked about their ethnicity and level of (material) deprivation . Parental sick leave and absence from work or education because of illness of their child is also included in the online questionnaire. Labour participation is combined with parental sick leave rates to determine productivity losses from work.
Teacher’s self-reported weight and height and transport forms to work are assessed by means of a written questionnaire. School practices regarding nutrition and physical activity (e.g., modelling eating healthy food products and encouraging children’s physical activity) are determined by an adapted version of the Parental Practices Instrument.
Children’s academic achievements
Academic performance is monitored using the Centrale Eindtoets Basisonderwijs (CITO), and various other tests used by the schools [http://www.cito.com/about_cito/history_of_cito]. In the Netherlands there is a long tradition of testing at the end of primary school to support the decision in which track children will continue their secondary education. Since 2015, participation in these tests is obligatory by law. All schools participating in the study are currently using the standard version, although schools can opt for a few alternative tests. The test measures language, maths and world orientation. In addition to this end of primary school test, many schools use a wide range of tests throughout the children’s school careers. This also includes tests on mathematics (taken twice a year) and various aspects of language such as decoding skills, spelling, vocabulary, and reading comprehension. With the exception of the two partial intervention schools, the schools in this study are using a wide range of such tests, which are – using the data from OnderwijsMonitor Limburg – also comparable to those used in other schools in the region.
The secondary school advice provided by the primary school, the actual level of secondary school opted for (Dutch secondary education is hierarchically ordered), the school absenteeism and repeating years are assessed for all participating children via the schools.
General parental satisfaction with their children’s school (including safety, communication, quality of education, challenges to children, and professionalism of teachers) are assessed using a school satisfaction questionnaire, which is regularly used in the Dutch school system. Implementation of the intervention is evaluated by qualitative outcome measures such as interviews with parents and children, and classroom observations.
In the Netherlands, parents are free to choose which school their child attends. The introduction of the intervention might therefore influence their choice of school and thus change the composition of the sample. Distance is an important determinant of school choice . A simulation using the model of Borghans et al. shows that the effect on the enrolment is expected to be rather small . The data provided by the OnderwijsMonitor Limburg allows us to investigate the actual choice patterns and outcomes for the schools in the region. In addition, head teachers are asked if the presence of the intervention influenced the new school entries.
Evaluation of legal aspects
The research questions on legal aspects will be addressed by a thorough scientific literature study and examination of policy and legislation instruments and case-law on the scope of children’s right to health. The literature study will focus on the right to health, evaluation of the scope of this right, and the right to health of children in particular. In addition, literature and case-law research will be conducted to explore the existing conflicting interests of parties involved in the realization of children’s right to health, particularly in healthy school settings. Interviews will be held to determine the interests of the different parties involved in the healthy school setting. In addition, a comparison will be made with the legal situation in Scotland, in view of the embedding of the healthy school concept in the Scottish legal (educational) system. Conflicts of interest regarding the realization of children’s rights to health and education in the healthy school setting will be explored and resolved using a legal theoretical framework. In addition, the Scottish model will be used to identify and resolve the conflicts of interest.
Sample size calculation for primary research question
The primary sample size calculation is based on the primary outcome, i.e. detecting a difference in mean absolute BMI Z-scores between participants in the two full-intervention schools and participants in the four control schools, after 4 years of intervention. All assumptions are shown in Table 4.
With these assumptions we should be able to detect a difference in mean absolute BMI Z-score of 0.24 between the full-intervention and control groups, which correspondents to a medium standardized effect size (Cohen’s d of 0.41). Detecting this difference is feasible in this population, as a school-based longitudinal study with comparable intervention components found a mean difference between the intervention and control groups of −0.26 (CI 95 %: −0.32, −0.21) BMI Z-score .
Sample size calculation for secondary research question
To detect differences between the two full-intervention schools and the two partial-intervention schools, a second sample size calculation was performed. The assumptions used are shown in Table 4. With these assumptions we should be able to detect a difference in mean absolute BMI Z-score of 0.28 between full intervention and partial intervention, corresponding to a medium standardized effect size (Cohen’s d = 0.47). Based on the meta-analysis by Waters et al., it is likely that changes between full intervention and partial intervention of up to 0.28 can be found .
Data analysis for primary and secondary research questions
Linear mixed model analysis techniques will be used to assess the longitudinal effect of the intervention on the primary outcome measure of absolute BMI Z-scores. This technique corrects for correlations within individuals within groups, which occurs in this type of repeated-measures research design. Another advantage of this technique is that it naturally handles missing values in the outcome (likelihood-based method), as long as data are missing at random. Since measurements are repeated within participants, who are nested within schools, we will use a three-level model with schools as the third level, participants as the second level and measurements as the first level. The fixed part of the model consists of group (intervention versus control), time (time points at which the measurements are taken) and the interaction term group*time. Baseline variables that are related to missing data or outcomes will also be included to obtain unbiased results and/or to gain precision. As for the random part of the model, a random school and participant effect will be included in addition to the repeated measurements. For the repeated measurements, the covariance structure will be chosen based on Akaike’s Information Criterion. All participants with at least one outcome measurement will be included in the analysis.
Data analysis for tertiary research questions
The tertiary research questions will be answered using different statistical techniques. The longitudinal effects on numerical quantitative outcome variables will be assessed using the same linear mixed models used for the primary outcome. Categorical outcome variables will be assessed using a logistic mixed-model analysis technique, where the model is similar to that described for the primary study parameter.
Both short-term (2 years) and lifetime cost-effectiveness analyses will be conducted. School-aged children and their caregivers form the target population of the analyses. Cost-effectiveness ratios will be estimated indicating the incremental costs (investments) per unit of incremental benefit. Costs and effects will be assessed from a societal perspective, including healthcare, patient and family costs. Cost-effectiveness ratios will include the incremental costs per quality-adjusted life year gained. The number of quality-adjusted life years of primary school children and their caregivers will be calculated using self-reported HR-QoL (EQ5D) and valuations obtained from the general public . The short-term cost-effectiveness analysis will use the effects from baseline to follow-up at year two. Lifetime cost-effectiveness will be studied by means of a two-step approach. First, childhood outcomes will be extrapolated to young adulthood based on existing tracking studies and epidemiologic models. Subsequently, decision-analytical modelling will be used to simulate the associated consequences in terms of duration and quality of life and societal costs over the remaining lifetime.
Qualitative data such as interviews and focus groups will be recorded, transcribed and coded using Nvivo software. Coding will be performed by two independent researchers. Peer consultation between researchers will take place frequently. Major themes and discrepancies will be discussed with a third senior researcher. All researchers involved in data collection and analyses will keep a self-reflective diary to evaluate their own subjective views on the interpretation of the data.
This quasi-experimental study is expected to show whether an innovative school-based health intervention effectively contributes to a wide range of outcome parameters. The main outcome measures on which effects are expected are the children’s BMI distributions (primary outcome measure), lifestyle behaviours, academic achievement, child well-being, socio-economic differences, legal implications, and societal costs.
A strength of the study design is that it focuses on outcome parameters from a wide range of scientific disciplines (i.e., medical, behavioural, psychological, educational, legal, and economic). All elements necessary for political decision-making, such as effectiveness, feasibility, cost-effectiveness and legitimacy, are included in this study design. This enables us to extrapolate our research findings to a multidisciplinary level, which can contribute not only to new scientific insights, but also to the societal and political debate about the current educational system.
The quasi-experimental design of this study has several benefits. We were able to enrol schools in the interventions on the basis of motivation, which reflects the real-life situation of public health interventions. This will facilitate implementation and continuation of the interventions in the long term . A quasi-experimental design also has its limitations, however. The lack of randomization can result in selection bias at both the school and individual levels. For example, it is known that participants with a low SES are usually underrepresented in scientific studies . To assess the degree of self-selection at both school and individual level, we will compare features of our study population with information from several (public) Dutch databases. Features will include academic achievement, obesity rates, health behaviours, and SES. Potential sources of selection will be included as confounders in our analyses if necessary, to reduce selection bias in the estimates. The process evaluation will also be used to assess potential forms of bias.
The duration of this study (4 years) enables us to measure long-term effects. However, a known disadvantage of such a longitudinal study over an extended period of time is the risk of a high dropout rate. We will try to motivate children and parents each year with small incentives to promote a high response rate. Still, a dropout rate of 20 % has been taken into account in the power calculation.
A difficulty of the current study design is the young age of the study population (4 to 12 years). In this age category, emotional and social parameters are difficult to measure, and validated questionnaires are often lacking. Another measurement concern is the use of self-reported outcome measures, such as dietary recall. We will minimize these potential forms of measurement error by comparing differences over time using multilevel analysis techniques. Finally, it would have been interesting to measure biomarkers of lifestyle-related changes such as triglycerides and blood glucose. Yet, we purposely chose to exclude invasive outcome measures to maximize the response rate.
The multidisciplinary character of this scientific evaluation should facilitate adoption and implementation of the intervention in other Dutch schools. Hence, this unique study can be of great societal and scientific importance. It can affect cultural and legal aspects of our society such as values and legal responsibilities regarding parenting, educational laws, the exemplary function of the school, and labour input by parents or caregivers.
BMI, body mass index; CITO, Centrale Eindtoets Basisonderwijs (Test developed by Dutch Central Institute for Test Development); CSPQ, comprehensive snack parenting questionnaire; EQ-5D, EuroQol 5 dimensions; EQ-5D-Y, EuroQol 5 Dimensions Youth version; HR-QoL, health-related quality of life; GGD: Geneeskundige Gezondheidsdienst (regional Public Health Services); MEC, medical ethics committee; PE, physical education; PedsQL, paediatric quality of life inventory; SDQ, Strength and Difficulties Questionnaire; SEQ-C, self-efficacy questionnaire for Children; SES, socio-economic status; SWLS: satisfaction with life survey
Mendis S. Global status report on noncommunicable diseases 2014. Geneva: WHO Press; 2014.
Craigie AM, Lake AA, Kelly SA, Adamson AJ, Mathers JC. Tracking of obesity-related behaviours from childhood to adulthood: A systematic review. Maturitas. 2011;70(3):266–84.
Puder JJ, Munsch S. Psychological correlates of childhood obesity. Int J Obes. 2010;34 Suppl 2:S37–43.
Kelsey MM, Zaepfel A, Bjornstad P, Nadeau KJ. Age-related consequences of childhood obesity. Gerontology. 2014;60(3):222–8.
Stein D, Weinberger-Litman SL, Latzer Y. Psychosocial perspectives and the issue of prevention in childhood obesity. Frontiers Public Health. 2014;2:104.
Han E, Norton EC, Powell LM. Direct and indirect effects of body weight on adult wages. Econ Hum Biol. 2011;9(4):381–92.
Green LW, Kreuter MW. Health promotion planning: an educational and ecological approach. 3rd ed. Mountain View: Mayfield Publishing Company; 1999.
Katz DL. School-based interventions for health promotion and weight control: not just waiting on the world to change. Annu Rev Public Health. 2009;30:253–72.
Pate RR, Davis MG, Robinson TN, Stone EJ, McKenzie TL, Young JC. Promoting physical activity in children and youth a leadership role for schools: A scientific statement from the American Heart Association Council on Nutrition, Physical Activity, and Metabolism (Physical Activity Committee) in collaboration with the councils on Cardiovascular Disease in the Young and Cardiovascular Nursing. Circulation. 2006;114(11):1214–24.
van Stralen MM, Yildirim M, Wulp A, te Velde SJ, Verloigne M, Doessegger A, Androutsos O, Kovacs E, Brug J, Chinapaw MJ. Measured sedentary time and physical activity during the school day of European 10- to 12-year-old children: the ENERGY project. J Sci Med Sport/Sports Med Aust. 2014;17(2):201–6.
Hollar D, Lombardo M, Lopez-Mitnik G, Hollar TL, Almon M, Agatston AS, Messiah SE. Effective multi-level, multi-sector, school-based obesity prevention programming improves weight, blood pressure, and academic performance, especially among low-income, minority children. J Health Care Poor Underserved. 2010;21(2 Suppl):93–108.
Nansel TR, Huang TT, Rovner AJ, Sanders-Butler Y. Association of school performance indicators with implementation of the healthy kids, smart kids programme: case study. Public Health Nutr. 2010;13(1):116–22.
Carson V, Hunter S, Kuzik N, Wiebe SA, Spence JC, Friedman A, Tremblay MS, Slater L, Hinkley T. Systematic review of physical activity and cognitive development in early childhood. J Sci Med Sport. 2015;19(7):573–8.
Khambalia A, Dickinson S, Hardy L, Gill T, Baur L. A synthesis of existing systematic reviews and meta‐analyses of school‐based behavioural interventions for controlling and preventing obesity. Obes Rev. 2012;13(3):214–33.
Saraf DS, Nongkynrih B, Pandav CS, Gupta SK, Shah B, Kapoor SK, Krishnan A. A systematic review of school-based interventions to prevent risk factors associated with noncommunicable diseases. Asia Pac J Public Health. 2012;24(5):733–52.
Meng L, Xu H, Liu A, van Raaij J, Bemelmans W, Hu X, Zhang Q, Du S, Fang H, Ma J. The costs and cost-effectiveness of a school-based comprehensive intervention study on childhood obesity in China. PLoS One. 2013;8(10):e77971.
Rush E, Obolonkin V, McLennan S, Graham D, Harris JD, Mernagh P, Weston AR. Lifetime cost effectiveness of a through-school nutrition and physical programme: Project Energize. Obesity Res Clin Practice. 2014;8(2):e115–22.
Sobol-Goldberg S, Rabinowitz J, Gross R. School-based obesity prevention programs: a meta-analysis of randomized controlled trials. Obesity (Silver Spring). 2013;21(12):2422–8.
Waters E, de Silva-Sanigorski A, Hall BJ, Brown T, Campbell KJ, Gao Y, Armstrong R, Prosser L, Summerbell CD. Interventions for preventing obesity in children. Cochrane Database Syst Rev. 2011;12:00.
Lavelle HV, Mackay DF, Pell JP. Systematic review and meta-analysis of school-based interventions to reduce body mass index. J Public Health (Oxford, England). 2012;34(3):360–9.
Leurs M. A collaborative approach to tailored whole-school health promotion; the schoolBeat study. Maastricht: Maastricht University; 2008.
McCreary LL, Park CG, Gomez L, Peterson S, Pino D, McElmurry BJ. A mixed-methods evaluation of school-based active living programs. Am J Prev Med. 2012;43(5 Suppl 4):S395–8.
Steenbakkers M, Vermeer AJM, Janssen-Goffin MJH, Hajema KJ. Een nieuwe kijk op gezondheid in Zuid-Limburg [A new vision on health in South-Limburg]. In: GGD Zuid-Limburg: Regionaal rapport Volksgezondheid Toekomst Verkenning 2014. Geleen: GGD Zuid Limburg; 2014. p.103.
Jansen M, Kuppens E. Op zoek naar de Limburg-factor [seeking the Limburg-factor]. Geleen: GGD Zuid Limburg; 2015.
Vermeer AJM, Boot NMWM, Hesdahl MH, Janssen-Goffin MJH, Linssen ECAJ, Rutten N, Hajema KJ. Lokale rapporten Volksgezondheid Toekomst Verkenning: Een nieuwe kijk op gezondheid in Heerlen, Kerkrade, Landgraaf en Brunssum; [Local reports on Public Health Development: A new perspective on health in Heerlen, Kerkrade, Landgraaf and Brunssum]. Geleen: GGD Zuid Limburg; 2014.
Borghans L, Golsteyn B, Zölitz U. Parental Preferences for Primary School Characteristics. J Econ Anal Policy. 2015;15(1):85–117.
Golsteyn B, Schils T. Gender Gaps in Primary School Achievement – A Decomposition into Endowments and Returns to IQ and Non-Cognitive Factors. Econ Educ Rev. 2014;41:176–87.
Driessen G, Claassen A, Smit F. Variatie in schooltijden; Een internationale literatuurstudie naar de effecten van verschillende invullingen van de schooldag, de schoolweek en het schooljaar, [Variation in schooltimes; An international literature review on the effects of different rhytms of the day, the schoolweek and the schoolyear]. Nijmegen: Radboud Universiteit Nijmegen; 2010. p. 108.
Kremers S, Schaalma H, Meertens R, Van Mechelen W, Kok G. Systematic promotion of physical activity. In: Paediatric Exercise Science and Medicine. New York: Oxford University Press; 2008. p. 409–17.
Bartholomew LK, Parcel GS, Kok G, Gottlieb NH, Fernandez ME. Planning health promotion programs: an intervention mapping approach, 3rd edition. San Francisco: Jossey-Bass; 2011.
[https://www.loketgezondleven.nl/leefstijlinterventies/interventiedatabase-gezond-en-actief-leven] (last checked April 1th 2016)
Schonbeck Y, Talma H, van Dommelen P, Bakker B, Buitendijk SE, Hirasing RA, van Buuren S. Increase in prevalence of overweight in Dutch children and adolescents: a comparison of nationwide growth studies in 1980, 1997 and 2009. PLoS One. 2011;6(11):e27608.
WHO. Waist Circumference and Waist-Hip Ratio: Report of a WHO Expert Consultation. Geneva: World Health Organisation Press; 2008. p.47.
Molenaar HM, Zuidam JM, Selles RW, Stam HJ, Hovius SE. Age-specific reliability of two grip-strength dynamometers when used by children. J Bone Joint Surg Am. 2008;90(5):1053–9.
Theunissen MJ, Griensven Van I, Verdonk P, Feron F, Bosma H. The early identification of risk factors on the pathway to school dropout in the SIODO study: a sequential mixed-methods study. BMC Public Health. 2012;12:1033.
Ravens-Sieberer U, Wille N, Badia X, Bonsel G, Burstrom K, Cavrini G, Devlin N, Egmar AC, Gusi N, Herdman M. Feasibility, reliability, and validity of the EQ-5D-Y: results from a multinational study. Qual Life Res Int J Qual Life Asp Treat Care Rehab. 2010;19(6):887–97.
Varni JW, Seid M, Kurtin PS. PedsQL 4.0: reliability and validity of the Pediatric Quality of Life Inventory version 4.0 generic core scales in healthy and patient populations. Med Care. 2001;39(8):800–12.
Engelen V, Haentjens MM, Detmar SB, Koopman HM, Grootenhuis MA. Health related quality of life of Dutch children: psychometric properties of the PedsQL in the Netherlands. BMC Pediatr. 2009;9:68.
Muris P, Meesters C, van den Berg F. The Strengths and Difficulties Questionnaire (SDQ)--further evidence for its reliability and validity in a community sample of Dutch children and adolescents. Eur Child Adolesce Psychiatry. 2003;12(1):1–8.
Silva TB, Osorio FL, Loureiro SR. SDQ: discriminative validity and diagnostic potential. Front Psychol. 2015;6:811.
Bradley MM, Lang PJ. Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. J Behav Ther Exp Psychiatry. 1994;25(1):49–59.
Muris P. A brief questionnaire for measuring self-efficacy in youths. J Psychopathol Behav Assess. 2001;23(3):145–9.
van Nassau F, Chau JY, Lakerveld J, Bauman AE, van der Ploeg HP. Validity and responsiveness of four measures of occupational sitting and standing. Int J Behav Nutr Physical Activity. 2015;12:144.
Mahar MT, Guerieri AM, Hanna MS, Kemble CD. Estimation of aerobic fitness from 20-m multistage shuttle run test performance. Am J Prev Med. 2011;41(4 Suppl 2):S117–23.
van Assema P, Brug J, Ronda G, Steenhuis I. The relative validity of a short Dutch questionnaire as a means to categorize adults and adolescents to total and saturated fat intake. J Hum Nutr Diet. 2001;14(5):377–90.
Van Assema P, Brug J, Ronda G, Steenhuis I, Oenema A. A short dutch questionnaire to measure fruit and vegetable intake: relative validity among adults and adolescents. Nutr Health. 2002;16(2):85–106.
Rodenburg G, Oenema A, Pasma M, Kremers SP, van de Mheen D. Clustering of food and activity preferences in primary school children. Appetite. 2013;60(1):123–32.
Gevers DW, Kremers SP, de Vries NK, van Assema P. Clarifying concepts of food parenting practices. A Delphi study with an application to snacking behavior. Appetite. 2014;79:51–7.
Pavot W, Diener E, Colvin CR, Sandvik E. Further validation of the Satisfaction with Life Scale: evidence for the cross-method convergence of well-being measures. J Pers Assess. 1991;57(1):149–61.
Rabin R, de Charro F. EQ-5D: a measure of health status from the EuroQol Group. Ann Med. 2001;33(5):337–43.
Mackenbach JP, van de Mheen H, Stronks K. A prospective cohort study investigating the explanation of socio-economic inequalities in health in The Netherlands. Soc Sci Med. 1994;38(2):299–308.
Schram MT, Sep SJ, van der Kallen CJ, Dagnelie PC, Koster A, Schaper N, Henry RM, Stehouwer CD. The Maastricht Study: an extensive phenotyping study on determinants of type 2 diabetes, its complications and its comorbidities. Eur J Epidemiol. 2014;29(6):439–51.
van den Akker M, Spigt MG, De Raeve L, van Steenkiste B, Metsemakers JF, van Voorst EJ, de Vries H. The SMILE study: a study of medical information and lifestyles in Eindhoven, the rationale and contents of a large prospective dynamic cohort study. BMC Public Health. 2008;8:19.
Hoff S. Replicatie van het meetinstrument voor sociale uitsluiting [Replication of the measurement instrument for social seclusion]. Den Haag: Sociaal en Cultureel Planbureau; 2014. p.65
Taylor RW, McAuley KA, Barbezat W, Strong A, Williams SM, Mann JI. APPLE Project: 2-y findings of a community-based obesity prevention program in primary school age children. Am J Clin Nutr. 2007;86(3):735–42.
Waters E, de Silva-Sanigorski A, Hall BJ, Brown T, Campbell KJ, Gao Y, Armstrong R, Prosser L, Summerbell CD. Interventions for preventing obesity in children. Cochrane Database Syst Rev. 2011;12:CD001871.
Lamers LM, Stalmeier PFM, McDonnell J, Krabbe PFM, Van Busschbach JJ. Kwaliteit van leven meten in economische evaluaties: het Nederlands EQ-5D-tarief. [Measuring quality of life in economic evaluations: The Dutch EQ-5D rate.]. Ned Tijdschr Geneeskd. 2005;149:1574–8.
Green LW, Glasgow RE. Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. Eval Health Professions. 2006;29(1):126–53.
Vermaire JH, van Loveren C, Poorterman JH, Hoogstraten J. Non-participation in a randomized controlled trial: the effect on clinical and non-clinical variables. Caries Res. 2011;45(3):269–74.
Jansen W, Borsboom G, Meima A, Zwanenburg EJ, Mackenbach JP, Raat H, Brug J. Effectiveness of a primary school-based intervention to reduce overweight. Int J Pediatr Obes. 2011;6(2-2):e70–77.
Slingerland M. Bij modern bewegingsonderwijs wordt…… bewogen!: een praktijkartikel over het intensiveren van de les LO [In modern physical education lessons pupils……move!: a practice-based article about intensivating the physical education lessons]. Lichamelijke opvoeding. 2011; 5:28–30.
Battjes-Fries MCE, van Dongen EJI, Haveman-Nies A. Evaluatie van smaaklessen: heeft smaaklessen effect op determinanten van gezond en bewust eetgedrag? [Evaluation of taste lessons: do taste lessons influence determinants of healthy and conscious eating behaviour?]. Wageningen University, Wageningen; 2013.
van Lier PA, Muthen BO, van der Sar RM, Crijnen AA. Preventing disruptive behavior in elementary schoolchildren: impact of a universal classroom-based intervention. J Consult Clin Psychol. 2004;72(3):467–478.
Amorim LD, Bangdiwala SI, McMurray RG, Creighton D, Harrell J. Intraclass correlations among physiologic measures in children and adolescents. Nurs Res. 2007;56(5):355–360.
van Breukelen GJ, Candel MJ, Berger MP. Relative efficiency of unequal cluster sizes for variance component estimation in cluster randomized and multicentre trials. Stat Methods Med Res. 2008;17(4):439–458.
We are grateful to all schools, children and other collaborating partners participating in the project. Our special thanks go to our scientific advisory board and support group for their support and critical feedback.
This study was funded by the Limburg provincial authorities, Project Number 200130003, by Friesland Campina, Project Number LLMV00, and by Maastricht University. None of the funding bodies had a role in the design of the study or the writing of this manuscript. Nor will the funding bodies have a role in the future data collection, analysis, interpretation of data, and the writing of publications. The study protocol was peer-reviewed by the Limburg provincial authorities and Maastricht University.
Availability of data and materials
Data are not yet available.
MW, SvdH, NB, and MJ drafted the manuscript. CvS, MJ, AS, MC, and MW designed the study, initiated ‘The Healthy Primary School of the Future’ project and received the project grants. SvdH, AS, BW, RdG, NB, SK, PvA, HS, EdN, LB, TS, KC, RD, RH, FC, SK, MC, MO, MJ, IF, PM, HB, HT, and CvS helped design the study. All authors critically reviewed and revised the final version of the manuscript. All authors have read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent to publish
Ethics approval and consent to participate
The need for ethical approval has been waived by the Medical Ethics Committee Zuyderland in Heerlen (MEC 14-N-142). All participants are required to complete an informed consent form, signed by both parents/caregivers, and by the children in case they are 12 years or older.
An erratum to this article is available at http://dx.doi.org/10.1186/s12889-017-4230-y.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Willeboordse, M., Jansen, M.W., van den Heijkant, S.N. et al. The Healthy Primary School of the Future: study protocol of a quasi-experimental study. BMC Public Health 16, 639 (2016). https://doi.org/10.1186/s12889-016-3301-9
- Academic Achievement
- Primary school Intervention
- Physical activity
- School health