A school-based program to prevent depressive symptoms and strengthen well-being among pre-vocational students (Happy Lessons): protocol for a cluster randomized controlled trial and implementation study
BMC Public Health volume 22, Article number: 139 (2022)
Depression is one of the leading causes of illness and disability among young people. In the Netherlands, one in twelve Dutch adolescents has experienced depression in the last 12 months. Pre-vocational students are at higher risk for elevated depressive symptoms. Effective interventions, especially for this risk group, are therefore needed to prevent the onset of depression or mitigate the adverse long-term effects of depression. The aim of this study is to examine the effectiveness and implementation of a school-based program Happy Lessons (HL), that aims to prevent depression and promote well-being among pre-vocational students.
A cluster randomized controlled trial (RCT) with students randomized to HL or to care as usual will be conducted. Pre-vocational students in their first or second year (aged 12 to 14) will participate in the study. Subjects in both conditions will complete assessments at baseline and at 3- and 6-months follow-up. The primary outcome will be depressive symptoms using the Center for Epidemiologic Studies Depression Scale (CES-D) at 6-months follow-up. Secondary outcomes are well-being using the Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) and life satisfaction (Cantril Ladder) measured at 6-months follow-up. Alongside the trial, an implementation study will be conducted to evaluate the implementation of HL, using both quantitative and qualitative methods (interviews, survey, and classroom observations).
The results from both the RCT and implementation study will contribute to the limited evidence base on effective school-based interventions for the prevention of depression and promotion of well-being among pre-vocational adolescents. In addition, insights from the implementation study will aid identifying factors relevant for optimizing the future implementation and scale-up of HL to other schools and contexts.
This study was registered on 20 September 2021 in the Dutch Trial Register (NL9732).
Worldwide, depression is one of the leading causes of illness and disability among young people . In the Netherlands, one in twelve adolescents reported experiencing depression in the last 12 months . Adolescent depression contributes to behavioral and educational difficulties such as school absenteeism, poor educational attainment, social problems, substance misuse, and suicidality [3,4,5,6,7]. Depression also has a considerable economic impact in terms of healthcare consumption [8, 9]. In 2017, the costs in the Netherlands that were associated with depression were 1.13 billion euros .
Studies show that approximately 50% of adults with a depressive disorder experienced their first depressive episode during childhood or adolescence . The average age among Dutch adolescents for the first episode of depression is 14 years . Mental illness among adolescents tend to persist into adulthood . Accessible, evidence-based interventions aimed at the early detection of symptoms of depression and early intervention are thus crucial to help prevent depression and mitigate the negative long-term effects of depression .
In addition to early detection and intervention, improving adolescent well-being is important in mental health promotion . Prior research showed that low levels of well-being are a risk factor for developing depression . Thus, focusing on improving adolescent well-being in general may help reduce the risk of developing depression. Moreover, well-being was found to be associated with a healthier and longer life [16, 17], prosocial behavior, and good relationships with family and friends .
Yet, adolescents are typically not inclined to seek help for their mental problems. They have difficulties recognizing problem symptoms, want to solve problems themselves and fear being stigmatized [18, 19]. Providing interventions in social contexts, such as schools, can facilitate getting in touch with hard-to-reach groups, like adolescents. To date, effective school-based programs in the Netherlands that focus both on the prevention of depression and promotion of well-being are scarce and this is especially so for programs targeting the risk group of students in pre-vocational training, who go on to pursue more applied studies in post-secondary vocational education . This is an omission as pre-vocational students are at higher risk for elevated depressive symptoms compared to adolescents in pre-university education . Interventions aimed to improve mental health or well-being of high risk groups are not only scare in the Netherlands, but also internationally .
Therefore, effective well-being and depression prevention interventions that are tailored to the needs of these students are needed. This study tries to fill these gaps by examining the effectiveness and implementation of Happy Lessons (HL): a school-based program that focuses on both the prevention of depressive symptoms and the promotion of well-being among pre-vocational adolescents. HL offers an integral and stepped-care approach that combines universal and indicated prevention elements and is delivered by trained mental health professionals within the school context. HL is designed to promote well-being and to identify and detect students that are at risk of developing depression or experiencing depression and facilitate referral to appropriate local mental health and social care services.
The goal of this paper is to describe the protocol for a study that will test the effectiveness of the HL-program in a Dutch adolescent sample of pre-vocational students through a cluster randomized controlled trial (RCT). In addition, an implementation study will be carried out to evaluate the implementation of HL and identify factors that may have influenced implementation.
The main objective of the RCT is to investigate the effectiveness of HL in terms of a reduction of depressive symptoms in pre-vocational students aged 12 to 14 after 6 months compared to care as usual. We hypothesize that adolescents who participate in the HL-program will have lower levels of depressive symptoms at 6-months follow-up than adolescents who do not participate. Secondary outcomes that will be investigated are well-being and life satisfaction. We hypothesize that students who receive HL report higher levels of well-being and life satisfaction than students who do not receive HL.
In addition, we want to identify potential mediator factors that increase or decrease the intervention’s effectiveness. We will investigate school and class climate indicators. We hypothesize that students who receive HL will report higher levels of classmate support, teacher support, and school connectedness, and lower levels of bullying, which will lead to a reduction of depressive symptoms among students.
A secondary aim of this study is to evaluate the implementation process of the HL-program, from the perspectives of intervention recipients, implementers, and the broader stakeholders at the school level (e.g. teachers). The aim of this evaluation will be to understand how the intervention was implemented and what factors might be important when sustaining or expanding the HL-program over time or in new schools.
In the Netherlands, pre-vocational education is a four-year program offering theoretical and practical courses (in Dutch: VMBO). This study will be conducted among first- and second-grade pre-vocational Dutch students. Students in these classes are between 12 and 14 years of age.
HL is a school-based program designed to prevent depressive symptoms and promote well-being among young people. It is specifically developed for (pre-)vocational students. Prior school-based depression prevention programs have been associated with reduction in depressive symptoms, although effects are typically small [24, 25].
HL contains a unique combination of key elements that can increase program-effects. First, prior research showed that interventions that work well in schools are programs that are shorter in duration, targeted towards high-risk students, and delivered by professionals interventionists instead of classroom teachers [24, 25]. HL is a compact program, focuses on detection elevated depression levels among youth, and is delivered by trained mental health professionals instead of teachers.
Second, mental health prevention programs that combine universal and indicated elements show larger effect sizes [25, 26]. HL meets this criterion as well: it is an integrated approach that combines universal and indicated elements. HL consists of four classical lessons (including two e-learnings), an online screener (called the HL-questionnaire) and an individual advice session for all students in which the at-risk group will be referred to local indicated prevention or treatment.
Third, research shows that ‘positive framing and goal setting’ are important to reduce fear of stigma and encourage active problem solving  and that programs with a positive mental health focus are more effective . HL is based on positive psychology and cognitive behavioral therapy, both effective methods in the treatment of depressive symptoms [28,29,30].
Fourth, for successful implementation, it is important that a program is embedded in the workflow of the stakeholders. Effective implementation is associated with larger effect sizes . The HL-pilots show the program fits in the workflow of the mental health professionals who provide HL. The lessons and advice sessions can be delivered in ‘mentor hours’ at the school, and the HL advice session may be combined with the periodic health screens or ‘adolescent contact moments’ that are conducted by the youth health authorities in the Netherlands. And because of its compactness, HL may be integrated in a bigger lifestyle programs in schools with other lifestyle themes.
Finally, HL is also relevant for the mentally healthy students in the classroom who do not need to improve on depression and well-being outcomes. Should they experience mental health problems in the future, they will have received the message with HL that mental health problems are a normal part of life, that they don't have to feel ashamed, that there are effective skills that can be practiced and that good help is available .
The program consists of various parts (see Fig. 1): (a) four classroom lessons of which two lessons also contain an e-learning module, (b) an online HL-questionnaire that includes two well-being scales and a depression scale that is administered at the start of the second lesson, (c) an individual consultation session with the mental health professional who delivers HL for each student, and (d) potential aftercare for high-risk students. The program is delivered within approximately 5-8 weeks. The lessons and advice sessions are provided by trained mental health professionals (e.g., prevention workers, called HL-trainers). Teachers are present to support the HL-trainers in providing HL. Before the start of the program, HL-trainers create a personal HL-account for each student in an online database. Students will use the HL-account to gain access to the online HL-questionnaire and e-learning module (lesson 2 and 3).
The classroom lessons
The first lesson focuses on the introduction of HL and on the subject happiness. The goal of this first lesson is to encourage a discussion about feeling happy or unhappy, familiarize students with different aspects of happiness, discuss the difference between happiness and being lucky, and to break the taboo about feeling unhappy or down. In this context, engaging group assignments and discussions take place.
In the second lesson, students will learn more about the things that might make them happy and the relationship between feelings, thoughts, and actions. In addition to a class-based exercise, students are asked to complete the online HL-questionnaire. This is a questionnaire on demographics (i.e., gender, age), their own health, family situation (i.e., their family’s’ financial situation, and their family members’ (mental) health status), a depression scale, life satisfaction scale, and a well-being scale. After students complete the HL-questionnaire, they will start the e-learning module which contains videos, animations, and fun and engaging exercises. The e-learning module helps students to improve their mood and to practice the skills with their own feelings, thoughts, and actions.
The third lesson starts with an exercise where the HL-trainer describes different situations (e.g., when students receive the results from a test or students have to give a presentation). Students are asked to describe their feelings for each situation (i.e., being angry, sad, scared, or happy). The lesson also contains an e-learning module with the same elements as the second lesson but is focused on: (1) problem solving, (2) communication tips that help students maintain positive relationships with friends, parents, teachers, (3) the importance of helping others, and (4) thinking about their future dreams and how they can achieve these.
The fourth and final lesson includes a recap of what students have learned so far. In addition, it focusses on the relationship between thoughts and feelings and how students can challenge negative thoughts and change them into more helpful thoughts. Students are also asked to fill in a short evaluation questionnaire about the program. The duration of each lesson is approximately 45 minutes.
The individual consultation session and potential aftercare
After the final lesson, individual consultation sessions are scheduled with all students. In the online database, the HL-trainer can see the answers of the HL-questionnaire. Based on the answers on the HL-questionnaire, the HL-trainer talks with the student to see if the student needs additional support. Students who report high scores on the HL-questionnaire or report other problems at home/school are offered help by the HL-trainer (i.e., some additional individual sessions) or are referred to appropriate local mental health and/or social care services. This will be done in consultation with the student and their parent(s).
Design of the RCT
The effectiveness of HL will be tested within a cluster RCT with two conditions: an intervention condition (receiving HL during the study) and a control condition (care as usual, HL will be delivered after the final follow-up assessment). Participating classes will be randomly assigned to either the intervention or the control condition and will be equally distributed across the two conditions within each schoolyear. This design is chosen to avoid a skewed distribution of participants over the two conditions due to school effects. The randomization will be conducted by an independent statistician. Three assessments will be performed in the study: T0 (pre-test, before the start of HL in intervention group); T1 (3-months follow up); T2 (6-months follow-up).
Data will be collected in two cohorts: the first cohort is planned in the 2021-2022 school year and the second cohort is planned in 2022-2023 school year.
Eligibility criteria and recruitment of schools
To provide HL at a school, three different parties need to be involved: schools, mental health organizations that provide the professionals that deliver HL, and – in most cases – the municipality that pays for HL. Schools, mental health organizations, and municipalities were recruited via the website and newsletter of the Trimbos Institute and the HL website. Schools are included in the study if they offer pre-vocational education in at least two first-year or two second-year classes (age 12-14 years). This may also include “combination classes” that contain students from both pre-vocational and higher educational levels.
Eligibility criteria of participants
Students are eligible to participate in the study when they meet the following inclusion criteria: enrolment of first- or second-grade students of classes that provide pre-vocational education (including combination classes), informed consent from student and parent(s) and a sufficient knowledge of the Dutch language.
Recruitment of participants and informed consent
Two weeks before the start of the study, schools provide information letters and consent forms to parents from both groups (intervention and control condition). In order to give permission for their child’s participation, parents are asked to sign the consent form on paper and send it back to the research team by mail or e-mail within a week. Approximately one week before the start of HL in the intervention condition, a research assistant will visit the participating classes to explain the study and provide an information letter to all students. Students can ask questions and are asked to sign an informed consent form on paper in this recruitment session. Students will be enrolled in HL when they and their parents have both provided consent. In consultation with the school, participating students will receive an incentive (e.g., a voucher).
The sample size is based on the main outcome: depressive symptoms in pre-vocational students in first and second year classes. Based on a meta-analysis by Stice et al. , we assume an effect size of d = 0.20. Thus, we want to test the hypothesis that we will find an effect of d = 0.20 (or larger) at 6 months follow-up. This will be tested at a two-sided significance level of 5% and a power of 80%. Accounting for the clustering in the data with 22 students on average per class, an intraclass correlation of 0.02, a cluster size variation of 0.17 and a baseline correlation of 0.30, we need n = 315 students in each condition. Furthermore, we expect that approximately 40% of parents and/or students will not provide informed consent. In order to secure the needed sample size, the aim is to sample 525 students per trial. Assuming an average of 4 classes of 22 students per school (divided across intervention and control condition), this will require 48 classes from about 12 schools.
The sample size calculation was performed in Stata version 14.2 statistical software package using the clustersampsi-procedure. The intraclass correlation coefficient (ICC) of 0.02 was based on two studies: the Dutch Health Behaviour in School-aged Children Survey (HBSC) , where the ICC on the emotional scale within the Strengths and Difficulties Questionnaire (SDQ) was 0.008 (95% CI: 0.003-0.02) and a large European study where the ICC’s for depressive mood varied across countries from 0.01 to 0.07 .
Data will be collected through an online questionnaire and students’ self-reports. Students will use their personal HL-accounts (created by the HL-trainer) to gain access to the questionnaires. Data for each assessment and in both conditions will be collected during a regular classroom lesson. At the end of the recruitment session, the research assistant will ask all students to fill in the HL-questionnaire as part of the HL-program. For those participating in the study this data will serve as the baseline measurement (T0) for the RCT. For research purposes, the HL-questionnaire is administered before the start of the HL instead of the second lesson. For the second (T1) and third assessment (T2), teachers are approached to collect and administer the questionnaires in their classes. The duration of each questionnaire will be approximately 15 minutes.
Data collected for research purposes will be stored in a database. For each individual student, a unique respondent number will be used. Students’ names and email addresses will be stored in a separate database, which is only accessible for the data manager of the project.
Demographic characteristics include gender, birth month and -year and immigration background. Immigration background is assessed by asking the students to indicate their own and both of their parents’ country of birth. Students are considered to have an immigration background if they or at least one of the parents was born in another country then the Netherlands. Students’ educational level is collected via the school.
Depressive symptoms will be measured with the Dutch version of the Center for Epidemiologic Studies Depression Scale (CES-D) [34, 35]. The CES-D measures the frequency of 20 depressive symptoms over the past week on a four-point Likert scale. Examples of items are: “I enjoyed life” and “I felt that everything I did was an effort”. Answer categories are: (0) “rarely or none of the time (less than once a week)”, (1) “some or a little of the time (1-2 days a week)”, (2) “occasionally or a moderate amount of time (3-4 days a week)”, or (3) “most or all of the time (5-7 days a week)”. The total score may range from 0 to 60, with higher scores indicating higher levels of depression. The Dutch version has been validated among adolescents and has excellent psychometric properties [31, 36]. Based on previous Dutch findings, we will use a CES-D cut-off score of 16 or higher to identify students with subclinical levels  and a cut-off score of 22 or higher to identify students with clinical levels of depression .
Well-being will be measured with the Dutch translation of the Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) [37, 38]. The WEMWBS assesses 14 items on a five-point scale. Scores range from 14 to 70, with higher values reflecting greater perceived well-being. Questions concern feelings experienced in the previous two weeks, such as “I felt good about myself” and “I felt optimistic about the future”. Studies from the United Kingdom found that it is appropriate to use the 14-item WEMWBS to measure well-being among adolescents aged 13 to 16 . In two earlier pilot studies of HL involving pre-vocational students aged 13 to 17, the WEMWBS showed high reliability with Cronbach’s Alpha of 0.84 and higher . The WEMWBS can detect meaningful change at both the group and individual level. At the individual level, minimum detectable change has been set at a change of 3 points .
Life satisfaction will be assessed with the Cantril Ladder . Students rate how satisfied they are with their life on a visual analogous scale ranging from (0) “the worst possible life” to  “the best possible life”. The Cantril Ladder is easily understood and has shown good reliability and convergent validity among young people (e.g., ).
Classmate support will be assessed by three items indicating the extent to which classmates were experienced as supportive, e.g., “Most of the students in my class are kind and helpful” (Response categories ranging from (1) “completely agree” to (5) “completely disagree”). This is a cross-nationally valid and reliable scale for young people .
Teacher support will be assessed by three items indicating the extent to which teachers were experienced as supportive, e.g., “I feel that teachers accept me as I am” (Response categories ranging from (1) “completely agree” to (5) “completely disagree”). Cross-national studies showed the scale to be valid and reliable for young people (e.g., ).
Bullying involvement. Students are asked how many times they were involved in bullying at school in the past four weeks. The response categories available are: (1) “zero times”, (2) “ones or twice”, (3) “about once a week”, (4) “several times a week”. This is a validated measure on bullying involvement that shows good psychometric properties .
Bullying victimization. Students are asked how many times they have been bullied at school in the past four weeks. Response categories include: (1) “zero times”, (2) “ones or twice”, (3) “about once a week”, (4) “several times a week”. This is one of the most validated measures on bullying victimization  with sound construct validity .
School connectedness. The Psychological Sense of School Membership Scale (PSSM)  assesses students’ connectedness with their school. It has 18 items, and a Dutch translation is available. A shortened, 2-item version has been administered in one Dutch study, showing a satisfactory internal consistency of .76 . This short version contains the items: “I feel like a real part of my school” and “I feel proud of belonging to my school”. In this study, this short version will be used.
All statistical analyses will be conducted in R  by an independent researcher. Reporting of the results will be conducted in accordance with the (extended) CONSORT statement . Analyses will be conducted based on the intention-to-treat (ITT) principle. The primary ITT analyses will be performed using linear mixed models, which adequately deal with missing at random data and can be used to account for the nested structure of the data; students nested within classes and repeated assessments nested within students . Time, condition, and time by condition interactions will be specified as fixed effects to examine the effectiveness of the intervention on continuous primary and secondary outcomes. Baseline scores of the corresponding outcome will simultaneously be entered as fixed factors in the model to account for baseline imbalances. In accordance with the CONSORT statement , it will not be explicitly tested whether conditions statistically differ in their baseline characteristics. Hence, the decision whether models will be adjusted for additional covariates will not be based on whether statistical differences in these covariates exist at baseline. Instead, models will primarily be reported that are not adjusted for additional covariates. In an additional sensitivity analysis, it will be examined whether adjusting these models for the following baseline variables substantially changes conclusions drawn from the analyses: gender, age, immigration background, depressive symptoms, well-being, and life satisfaction. Post-hoc tests will be conducted to examine between-group differences at each timepoint using analyses of covariance (ANCOVA), including baseline scores as covariate. Based on estimated marginal means and corresponding standard errors from linear mixed models, between-group effect sizes at each timepoint will additionally be expressed as Cohen’s d with 95% confidence intervals.
Mediation analyses will be performed to examine potential working mechanisms of the effect of the intervention. Research has shown that there is an association between school climate and mental health of students . Positive relationships between students and their teachers or peers increased psychosocial well-being . Moreover, teacher support reduced depressive symptoms . In addition, higher school connectedness (attachment and belonging to school) was positively associated with students’ psychosocial well-being  and acted as a buffer against depressive symptoms and anxiety [51, 52]. Finally, causal associations were found between bullying and depression . Therefore, the following variables will be tested as potential mediators: classmate support, teacher support, school connectedness, and bullying. The categorical variable condition will be included as independent variable in all mediation models (0 = control, 1 = intervention), and the observed scores of primary or secondary outcomes at follow-up as dependent variable. Total, direct, and (total) indirect effects with 95% bootstrapped confidence intervals will be calculated for all mediation models [54, 55].
Furthermore, exploratory moderator analyses will be conducted to examine whether the effect of the intervention on primary and secondary outcomes depends on a priori defined variables. Various sociodemographic factors have an influence on interventions focused on depressive symptoms or well-being. Research has shown that girls might experience more benefits from depression prevention programs than boys . Moreover, older participants might benefit more from cognitive-behavioral therapy [24, 57]. In addition, research has shown that depression prevention programs are likely to be more effective for adolescents with ethnic minority backgrounds , since they report more problems with mental health compared to adolescents with ethnic majority backgrounds . Therefore, the following variables will be examined as potential moderators: level of baseline CES-D depressive symptoms, gender, age, and immigration background. Separate linear mixed models with condition, the putative moderator, and the interaction of these two as fixed effects will be used to examine potential moderation effects.
Design of the implementation study
The implementation study will be executed among recipients of HL (students), implementers (HL-trainers), and other school professionals (e.g., teachers, care coordinators).
As the aim is to understand the implementation process and how the intervention was implemented and received, we relate to implementation constructs from Proctor’s Implementation Outcome Framework , focusing on fidelity, acceptability, appropriateness and feasibility. The implementation process measures, and their data collection methods are shown in Table 2.
Data collection and analysis
As shown in Table 2, multiple sources of data collection will be used. Data will be collected through classroom observations (n = 20), qualitative interviews with HL-trainers (n = 10) and teachers or care coordinators (n = 10), or until saturation is reached, and an evaluation survey for students.
Classroom observations are conducted to investigate to which extent the program was delivered as planned/trained by HL-trainers. An observation checklist will be made based on components of the instruction manual for HL-trainers (e.g., if the exercises were conducted and executed within the allocated time). During the observation, additional notes will be made (for example, on HL-trainer and student interaction, classroom engagement). For each lesson, a different checklist is designed, tailored to the different exercises and goals. We will conduct observations in five classes and within each class, we will observe all four lessons. For the classroom observations, checklist items, and items with scores or response items will be analysed quantitatively through descriptive statistics and frequency tables. For the open-ended items of the observations, we will perform a qualitative analysis, looking at common themes across answers.
Semi-structured interviews will be carried out with HL-trainers and school professionals to understand their experience with receiving or delivering the program, including how feasible the content was to deliver, how satisfied students were with the content of the program, adaptations made to the program by HL-trainers, etc. Interviews will be audio-taped with participants’ permission and transcribed verbatim. Qualitative analysis will be carried out by two independent researchers according to a coding framework developed by the project team. Coding will take both a deductive and inductive approach and a thematic content analysis approach will be applied to coded data.
Students will be asked about their experience with the HL-program through an online survey. Survey items will include closed and open-ended questions with open fields for answers. Survey items will include what they have learned from the program, if they would recommend HL to peers, if they were satisfied with the program and suggestions for improvement. The closed questions will be analysed in SPSS 27.0. Descriptive statistics will be reported. For the open-ended questions, an inductive approach will be used.
This protocol paper outlines a cluster RCT and an implementation study that together aim to assess the effectiveness and implementation of a school-based program for pre-vocational adolescents in the Netherlands designed to prevent depression and promote well-being. The primary aim is to investigate levels of depressive symptoms at 6-months follow up among students who receive HL compared to students who received care as usual. Secondary aims include assessing the effects of HL on well-being and life satisfaction at 6-months follow up, identifying whether school and class climate mediate the effect of HL on depression, exploring potential effect-modifying factors (i.e., demographic factors and symptoms at baseline), and evaluating the implementation of the intervention for improvements and possible scale-up.
Strengths and limitations
A strength of this study is that we will perform the study in a real-life condition, which will increase the external validity of the results. Furthermore, we will not only focus on the effectiveness of the program but will also study potential mediators and moderators. This will give us insight into why and for whom the program is effective. Another strength is that we also look at implementation outcomes, to be able to distil key factors affecting implementation for other schools considering implementation of HL.
Despite these strengths, this study does not come without limitations. Since we randomize at the classroom level, a possible negative effect could be that control students are ‘contaminated’ from contact with and possible influence from students or school mates in the intervention arm. We expect however that these effects are minimal and will have no meaningful effect on the outcomes of this study. Another limitation is that we did not use a representative sample of schools to investigate the effectiveness of this program. We expect that schools which more interested in promoting well-being and preventing depressive symptoms among their students, are more likely to participate in this program and study. In addition, to get an impression of the representativeness of our sample, we will compare the results of this study (e.g. life satisfaction) with data from national studies [59, 60]. Furthermore, we decided to include a 6-month follow-up measurement, and not a 12-months measurement since it was preferred by schools to logistically complete the program and its evaluation within one school year. Another limitation of the study is that the students’ results are based on self-reported data, which might lead to measurement errors or under-reporting of depressive symptoms due to social desirability bias. However, we will use validated questionnaires or questionnaires used in other studies.
Implications for practice
The results from both the RCT and implementation study will contribute to the evidence base on school-based interventions for depression and promoting well-being among pre-vocational students, which is scarce. In addition, the results will be useful for optimizing future implementation of the program and elucidate insights for further scale-up to other schools and contexts. With the results of the implementation study, we will be able to understand the factors that will affect implementation, which can be used to better tailor and target an implementation plan for HL-trainers and schools in the future. This information will also be of interest for other similar school-based interventions.
Availability of data and materials
Center for Epidemiologic Studies Depression Scale
Intraclass correlation coefficient
Randomized controlled trial
Standard Protocol Items, Recommendations for Interventional Trials
Warwick-Edinburgh Mental Well-Being Scale
Gore FM, Bloem PJN, Patton GC, Ferguson J, Joseph V, Coffey C, et al. Global burden of disease in young people aged 10-24 years: A systematic analysis. Lancet. 2011;377(9783):2093–102. https://doi.org/10.1016/S0140-6736(11)60512-6.
Ormel J, Raven D, Van Oort F, Hartman CA, Reijneveld SA, Veenstra R, et al. Mental health in Dutch adolescents: A TRAILS report on prevalence, severity, age of onset, continuity and co-morbidity of DSM disorders. Psychol Med. 2015;45(2):345–60. https://doi.org/10.1017/S0033291714001469.
Fergusson DM, Woodward LJ. Mental health, educational, and social role outcomes of adolescents with depression. Arch Gen Psychiatry. 2002;59(3):225–31. https://doi.org/10.1001/archpsyc.59.3.225.
Fergusson DM, Horwood LJ, Ridder EM, Beautrais AL. Subthreshold depression in adolescence and mental health outcomes in adulthood. Psychol Med. 2005;62:66–72. https://doi.org/10.1001/archpsyc.62.1.66.
Glied S, Pine DS. Consequences and correlates of adolescent depression. Arch Pediatr Adolesc Med. 2002;156(10):1009–14. https://doi.org/10.1001/archpedi.156.10.1009.
Jaycox LH, Stein BD, Paddock S, Miles JN V, Chandra A, Meredith LS, et al. Impact of teen depression on academic, social, and physical functioning. Pediatrics. 2009;124(4):e596–605. https://doi.org/10.1542/peds.2008-3348.
Fletcher JM. Adolescent depression: diagnosis, treatment, and educational attainment. Health Econ. 2008;17(11):1215–35. https://doi.org/10.1002/hec.1319.
Nuijen J, van Bon-Martens M. Zicht op depressie: de aandoening , preventie en zorg. Themarapportage van de Staat van Volksgezondheid en Zorg. 2017.
Meijer SA, Smit F, Schoemaker CG, Cuijpers P. Gezond verstand Evidence-based preventie van psychische stoornissen; 2006.
Rijksinstituut voor Volksgezondheid en Milieu. Kosten van ziekten 2017. https://statline.rivm.nl/#/RIVM/nl/dataset/50050NED/table?ts=1601546554761) (2019). Accessed 9 Jun 2021.
Kim-Cohen J, Caspi A, Moffitt TE, Harrington H, Milne BJ, Poulton R. Prior juvenile diagnoses in adults with mental disorder. Arch Gen Psychiatry. 2003;60(7):709. https://doi.org/10.1001/archpsyc.60.7.709.
Costello EJ, Foley DL, Angold A. 10-Year research update review: the epidemiology of child and adolescent psychiatric disorders: II. Developmental epidemiology. J Am Acad Child Adolesc Psychiatry. 2006;45(1):8–25. https://doi.org/10.1097/01.chi.0000184929.41423.c0.
Kessler RC. Lifetime prevalence and age-of-onset distributions of mental disorders in the World Health Organization’s World Mental Health Survey Initiative. World Psychiatry. 2007;6(3):168–76.
Keyes CLM. Promoting and protecting mental health as flourishing: a complementary strategy for improving national mental health. Am Psychol. 2007;62(2):95–108. https://doi.org/10.1037/0003-066X.62.2.95.
Wood AM, Joseph S. The absence of positive psychological (eudemonic) well-being as a risk factor for depression: a ten year cohort study. J Affect Disord. 2010;122(3):213–7. https://doi.org/10.1016/j.jad.2009.06.032.
Howell RT, Kern ML, Lyubomirsky S. Health benefits: Meta-analytically determining the impact of well-being on objective health outcomes. Health Psychol Rev. 2007;1(1):83–136. https://doi.org/10.1080/17437190701492486.
Pressman SD, Cohen S. Does positive affect influence health? Psychol Bull. 2005;131(6):925–71. https://doi.org/10.1037/0033-2909.131.6.925.
Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010;10(1):1–9. https://doi.org/10.1186/1471-244X-10-113.
Rickwood DJ, Deane FP, Wilson CJ. When and how do young people seek professional help for mental health problems. Med J Aust. 2007;187(S7):S35–9. https://doi.org/10.5694/j.1326-5377.2007.tb01334.x.
Bastiaanssen I, Hamberg H, Ince D. Interventies rond opvoeden en opgroeien : meer lacunes dan overvloed; 2020.
Tak YR, Lichtwarck-Aschoff A, Gillham JE, Van Zundert RMP, Engels RCME. Universal School-Based Depression Prevention ‘Op Volle Kracht’: a Longitudinal Cluster Randomized Controlled Trial. J Abnorm Child Psychol. 2016;44(5):949–61. https://doi.org/10.1007/s10802-015-0080-1.
Vojt G, Skivington K, Sweeting H, Campbell M, Fenton C, Thomson H. Lack of evidence on mental health and well-being impacts of individual-level interventions for vulnerable adolescents: systematic mapping review. Public Health. 2018;161:29–32. https://doi.org/10.1016/j.puhe.2018.04.003.
Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Int J Surg. 2011;9(8):672–7. https://doi.org/10.1186/1745-6215-11-32.
Stice E, Shaw H, Bohon C, Marti CN, Rohde P. A meta-analytic review of depression prevention programs for children and adolescents: factors that predict magnitude of intervention effects. J Consult Clin Psychol. 2009;77(3):486–503. https://doi.org/10.1037/a0015168.
Werner-Seidler A, Perry Y, Calear AL, Newby JM, Christensen H. School-based depression and anxiety prevention programs for young people: A systematic review and meta-analysis. Clin Psychol Rev. 2017;51:30–47. https://doi.org/10.1016/j.cpr.2021.102079.
Weare K, Nind M. Mental health promotion and problem prevention in schools: what does the evidence say? Health Promot Int. 2011;26. https://doi.org/10.1093/heapro/dar075.
Rothman AJ, Salovey P, Bedell B, Cioffi D, Dertweiler J, Lemm K, et al. Shaping perceptions to motivate healthy behavior: the role of message framing. Psychol Bull. 1997;121(1):3–19. https://doi.org/10.1037/0033-2909.
Cuijpers P, Andersson G, Donker T, Van Straten A. Psychological treatment of depression: Results of a series of meta-analyses. Nord J Psychiatry. 2011;65(6):354–64. https://doi.org/10.3109/08039488.2011.596570.
Seligman MEP, Steen TA, Park N, Peterson C. Positive psychology progress: empirical validation of interventions. Am Psychol. 2005;60(5):410–21. https://doi.org/10.1037/0003-066X.60.5.410.
Taylor CT, Lyubomirsky S, Stein MB. Upregulating the positive affect system in anxiety and depression: outcomes of a positive activity intervention. Depress Anxiety. 2017;34(3):267–80. https://doi.org/10.1002/da.22593.
Van der Zanden R, van der Linden D. Evaluatieonderzoek Happyles Den Haag; 2013.
Stevens G, Van Dorsselaer S, Boer M, De Roos S, Duinhof E, Bogt T, et al. HBSC 2017. Gezondheid en welzijn van jongeren in Nederland. 2018.
Shackleton N, Hale D, Bonell C, Viner RM. Intraclass correlation values for adolescent health outcomes in secondary schools in 21 European countries. SSM Popul Heal. 2016;2:217–25. https://doi.org/10.1016/j.ssmph.2016.03.005.
Bouma J, Ranchor AV, Sanderman R, Van Sonderen E. Het meten van symptomen van depressie met de CES-D; 2012.
Schroevers MJ, Sanderman R, Van Sonderen E, Ranchor AV. The evaluation of the Center for Epidemiologic Studies Depression (CES-D) scale: Depressed and Positive Affect in cancer patients and healthy reference subjects. Qual Life Res. 2000;9:1015–29. https://doi.org/10.1023/A:1016673003237.
Cuijpers P, Boluijt P, Van Straten A. Screening of depression in adolescents through the Internet: sensitivity and specificity of two screening questionnaires. Eur Child Adolesc Psychiatry. 2008;17(1):32–8. https://doi.org/10.1007/s00787-007-0631-2.
Ikink JG, Lamers SM, Bolier JM. De Warwick-Edinburgh Mental Well-being Scale (WEMWBS) als meetinstrument voor mentaal welbevinden in Nederland: Universiteit Twente; 2012.
Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, et al. The Warwick-Dinburgh mental well-being scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5:1–13. https://doi.org/10.1186/1477-7525-5-63.
Clarke A, Friede T, Putz R, Ashdown J, Martin S, Blake A, et al. Warwick-Edinburgh Mental Well-being Scale (WEMWBS): validated for teenage school students in England and Scotland. A mixed methods assessment. BMC Public Health. 2011;11(1):487. https://doi.org/10.1186/1471-2458-11-487.
WARWICK. WEMWBS: 14-item vs 7-item scale. https://warwick.ac.uk/fac/sci/med/research/platform/wemwbs/about/wemwbsvsswemwbs. Accessed 20 Aug 2021.
Cantril H. Pattern of human concerns; 1965.
Levin KA, Currie C. Reliability and validity of an adapted version of the cantril ladder for use with adolescent samples. Soc Indic Res. 2014;119(2):1047–63. https://doi.org/10.1007/s11205-013-0507-4.
Torsheim T, Samdal O, Rasmussen M, Freeman J, Griebler R, Dür W. Cross-National Measurement Invariance of the Teacher and Classmate Support Scale. Soc Indic Res. 2012;105(1):145–60. https://doi.org/10.1007/s11205-010-9770-9.
Kyriakides L, Kaloyirou C, Lindsay G. An analysis of the Revised Olweus Bully/Victim Questionnaire using the Rasch measurement model. Br J Educ Psychol. 2006;76(4):781–801. https://doi.org/10.1348/000709905X53499.
Vessey J, Strout TD, Difazio RL, Walker A. Measuring the youth bullying experience: a systematic review of the psychometric properties of available instruments. J Sch Health. 2014;84(12):819–43. https://doi.org/10.1111/josh.12210.
Goodenow C. The psychological sense of school membership among adolescents: Scale development and educational correlates. Psychol Sch. 1993;30:79–90. https://doi.org/10.1002/1520-6807(199301)30:1<79::AID-PITS2310300113>3.0.CO;2-X.
Pot N, Schenk N, Van Hilvoorde I. School sports and identity formation: socialisation or selection? Eur J Sport Sci. 2014;15(5):484–91. https://doi.org/10.1080/17461391.2013.873483.
R Core Team. R: The R Project for Statistical Computing. https://www.r-project.org/. Accessed 1 Oct 2021.
Theobald E. Students are rarely independent: When, why, and how to use random effects in discipline-based education research. CBE Life Sci Educ. 2018;17(3):1–12. https://doi.org/10.1187/cbe.17-12-0280.
Aldridge JM, Mcchesney K. The relationships between school climate and adolescent mental health and wellbeing: a systematic literature review. Int J Educ Res. 2018;88:121–45. https://doi.org/10.1016/j.ijer.2018.01.012.
Joyce HD, Early TJ. The impact of school connectedness and teacher support on depressive symptoms in adolescents: a multilevel analysis. Child Youth Serv Rev. 2014 Apr;1(39):101–7. https://doi.org/10.1016/j.childyouth.2014.02.005.
Brière FN, Pascal S, Dupéré V, Janosz M. School environment and adolescent depressive symptoms: a multilevel longitudinal study. Pediatrics. 2013;131(3). https://doi.org/10.1542/peds.2012-2172.
Moore SE, Norman RE, Suetani S, Thomas HJ, Sly PD, Scott JG. Consequences of bullying victimization in childhood and adolescence: A systematic review and meta-analysis. World J Psychiatry. 2017;7(1):60. https://doi.org/10.5498/wjp.v7.i1.60.
Hayes AF. Introduction to mediation, moderation, and conditional process analysis: a regression-based approach: Guilford Publications; 2017. p. 1–79.
Hayes AF, Rockwood NJ. Regression-based statistical mediation and moderation analysis in clinical research: Observations, recommendations, and implementation. Behav Res Ther. 2017;98:39–57. https://doi.org/10.1016/j.brat.2016.11.001.
Horowitz JL, Garber J. The prevention of depressive symptoms in children and adolescents: A meta-analytic review. J Consult Clin Psychol. 2006;74(3):401–15. https://doi.org/10.1037/0022-006X.74.3.401.
Mccart M, Priester PE, Davies WH, Azen R. differential effectiveness of behavioral parent-training and cognitive-behavioral therapy for antisocial youth: a meta-analysis. Artic J Abnorm Child Psychol. 2006;34:525–41. https://doi.org/10.1007/s10802-006-9031-1.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health Ment Health Serv Res. 2010;38(2):65–76. https://doi.org/10.1007/s10488-010-0319-7.
Inchley J, Currie D, Budisavljevic S, Torsheim T, Jåstad A, Cosma A, et al. Spotlight on adolescent health and well-being. Findings from the 2017/2018 Health Behaviour in School-aged Children (HBSC) survey in Europe and Canada. International report, vol. 1. Copenhagen: Key findings. World Health Organization; 2020.
Kleinjan M, Pieper I, Stevens G, van de Klundert N, Rombouts M, Boer M, et al. Geluk onder druk? Onderzoek naar het mentaal welbevinden van jongeren in Nederland. Unicef Netherlands. 2020.
We would like to acknowledge the contribution of Dr. Bethany Hipple Walters for guidance on the implementation study.
This project is funded by ZonMw, the Netherlands Organization for Health Research and Development (project number 555 002 019).
Ethics approval and consent to participate
Ethical approval for this study was provided by the Medical Research Ethics Committee Utrecht (reference number NL77336.041.21, protocol version 3.0). The study was registered in the Dutch Trial Register (NL9732). Written informed consent from students and parents will be obtained.
Consent for publication
MR, ED, MK, LSZ and KM are employees at the Trimbos Institute, which is the institution that developed Happy Lessons. JK declares that he has no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Rombouts, M., Duinhof, E.L., Kleinjan, M. et al. A school-based program to prevent depressive symptoms and strengthen well-being among pre-vocational students (Happy Lessons): protocol for a cluster randomized controlled trial and implementation study. BMC Public Health 22, 139 (2022). https://doi.org/10.1186/s12889-021-12321-3