Skip to main content
  • Study protocol
  • Open access
  • Published:

A school-based program to prevent depressive symptoms and strengthen well-being among pre-vocational students (Happy Lessons): protocol for a cluster randomized controlled trial and implementation study

Abstract

Background

Depression is one of the leading causes of illness and disability among young people. In the Netherlands, one in twelve Dutch adolescents has experienced depression in the last 12 months. Pre-vocational students are at higher risk for elevated depressive symptoms. Effective interventions, especially for this risk group, are therefore needed to prevent the onset of depression or mitigate the adverse long-term effects of depression. The aim of this study is to examine the effectiveness and implementation of a school-based program Happy Lessons (HL), that aims to prevent depression and promote well-being among pre-vocational students.

Methods

A cluster randomized controlled trial (RCT) with students randomized to HL or to care as usual will be conducted. Pre-vocational students in their first or second year (aged 12 to 14) will participate in the study. Subjects in both conditions will complete assessments at baseline and at 3- and 6-months follow-up. The primary outcome will be depressive symptoms using the Center for Epidemiologic Studies Depression Scale (CES-D) at 6-months follow-up. Secondary outcomes are well-being using the Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) and life satisfaction (Cantril Ladder) measured at 6-months follow-up. Alongside the trial, an implementation study will be conducted to evaluate the implementation of HL, using both quantitative and qualitative methods (interviews, survey, and classroom observations).

Discussion

The results from both the RCT and implementation study will contribute to the limited evidence base on effective school-based interventions for the prevention of depression and promotion of well-being among pre-vocational adolescents. In addition, insights from the implementation study will aid identifying factors relevant for optimizing the future implementation and scale-up of HL to other schools and contexts.

Trial registration

This study was registered on 20 September 2021 in the Dutch Trial Register (NL9732).

Peer Review reports

Background

Worldwide, depression is one of the leading causes of illness and disability among young people [1]. In the Netherlands, one in twelve adolescents reported experiencing depression in the last 12 months [2]. Adolescent depression contributes to behavioral and educational difficulties such as school absenteeism, poor educational attainment, social problems, substance misuse, and suicidality [3,4,5,6,7]. Depression also has a considerable economic impact in terms of healthcare consumption [8, 9]. In 2017, the costs in the Netherlands that were associated with depression were 1.13 billion euros [10].

Studies show that approximately 50% of adults with a depressive disorder experienced their first depressive episode during childhood or adolescence [11]. The average age among Dutch adolescents for the first episode of depression is 14 years [2]. Mental illness among adolescents tend to persist into adulthood [12]. Accessible, evidence-based interventions aimed at the early detection of symptoms of depression and early intervention are thus crucial to help prevent depression and mitigate the negative long-term effects of depression [13].

In addition to early detection and intervention, improving adolescent well-being is important in mental health promotion [14]. Prior research showed that low levels of well-being are a risk factor for developing depression [15]. Thus, focusing on improving adolescent well-being in general may help reduce the risk of developing depression. Moreover, well-being was found to be associated with a healthier and longer life [16, 17], prosocial behavior, and good relationships with family and friends [16].

Yet, adolescents are typically not inclined to seek help for their mental problems. They have difficulties recognizing problem symptoms, want to solve problems themselves and fear being stigmatized [18, 19]. Providing interventions in social contexts, such as schools, can facilitate getting in touch with hard-to-reach groups, like adolescents. To date, effective school-based programs in the Netherlands that focus both on the prevention of depression and promotion of well-being are scarce and this is especially so for programs targeting the risk group of students in pre-vocational training, who go on to pursue more applied studies in post-secondary vocational education [20]. This is an omission as pre-vocational students are at higher risk for elevated depressive symptoms compared to adolescents in pre-university education [21]. Interventions aimed to improve mental health or well-being of high risk groups are not only scare in the Netherlands, but also internationally [22].

Therefore, effective well-being and depression prevention interventions that are tailored to the needs of these students are needed. This study tries to fill these gaps by examining the effectiveness and implementation of Happy Lessons (HL): a school-based program that focuses on both the prevention of depressive symptoms and the promotion of well-being among pre-vocational adolescents. HL offers an integral and stepped-care approach that combines universal and indicated prevention elements and is delivered by trained mental health professionals within the school context. HL is designed to promote well-being and to identify and detect students that are at risk of developing depression or experiencing depression and facilitate referral to appropriate local mental health and social care services.

The goal of this paper is to describe the protocol for a study that will test the effectiveness of the HL-program in a Dutch adolescent sample of pre-vocational students through a cluster randomized controlled trial (RCT). In addition, an implementation study will be carried out to evaluate the implementation of HL and identify factors that may have influenced implementation.

Methods

This protocol was developed in accordance with the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) statement [23]. See Appendix 1 for the SPIRIT checklist.

Aim

The main objective of the RCT is to investigate the effectiveness of HL in terms of a reduction of depressive symptoms in pre-vocational students aged 12 to 14 after 6 months compared to care as usual. We hypothesize that adolescents who participate in the HL-program will have lower levels of depressive symptoms at 6-months follow-up than adolescents who do not participate. Secondary outcomes that will be investigated are well-being and life satisfaction. We hypothesize that students who receive HL report higher levels of well-being and life satisfaction than students who do not receive HL.

In addition, we want to identify potential mediator factors that increase or decrease the intervention’s effectiveness. We will investigate school and class climate indicators. We hypothesize that students who receive HL will report higher levels of classmate support, teacher support, and school connectedness, and lower levels of bullying, which will lead to a reduction of depressive symptoms among students.

A secondary aim of this study is to evaluate the implementation process of the HL-program, from the perspectives of intervention recipients, implementers, and the broader stakeholders at the school level (e.g. teachers). The aim of this evaluation will be to understand how the intervention was implemented and what factors might be important when sustaining or expanding the HL-program over time or in new schools.

Study setting

In the Netherlands, pre-vocational education is a four-year program offering theoretical and practical courses (in Dutch: VMBO). This study will be conducted among first- and second-grade pre-vocational Dutch students. Students in these classes are between 12 and 14 years of age.

Happy Lessons

Theoretical basis

HL is a school-based program designed to prevent depressive symptoms and promote well-being among young people. It is specifically developed for (pre-)vocational students. Prior school-based depression prevention programs have been associated with reduction in depressive symptoms, although effects are typically small [24, 25].

HL contains a unique combination of key elements that can increase program-effects. First, prior research showed that interventions that work well in schools are programs that are shorter in duration, targeted towards high-risk students, and delivered by professionals interventionists instead of classroom teachers [24, 25]. HL is a compact program, focuses on detection elevated depression levels among youth, and is delivered by trained mental health professionals instead of teachers.

Second, mental health prevention programs that combine universal and indicated elements show larger effect sizes [25, 26]. HL meets this criterion as well: it is an integrated approach that combines universal and indicated elements. HL consists of four classical lessons (including two e-learnings), an online screener (called the HL-questionnaire) and an individual advice session for all students in which the at-risk group will be referred to local indicated prevention or treatment.

Third, research shows that ‘positive framing and goal setting’ are important to reduce fear of stigma and encourage active problem solving [27] and that programs with a positive mental health focus are more effective [26]. HL is based on positive psychology and cognitive behavioral therapy, both effective methods in the treatment of depressive symptoms [28,29,30].

Fourth, for successful implementation, it is important that a program is embedded in the workflow of the stakeholders. Effective implementation is associated with larger effect sizes [26]. The HL-pilots show the program fits in the workflow of the mental health professionals who provide HL. The lessons and advice sessions can be delivered in ‘mentor hours’ at the school, and the HL advice session may be combined with the periodic health screens or ‘adolescent contact moments’ that are conducted by the youth health authorities in the Netherlands. And because of its compactness, HL may be integrated in a bigger lifestyle programs in schools with other lifestyle themes.

Finally, HL is also relevant for the mentally healthy students in the classroom who do not need to improve on depression and well-being outcomes. Should they experience mental health problems in the future, they will have received the message with HL that mental health problems are a normal part of life, that they don't have to feel ashamed, that there are effective skills that can be practiced and that good help is available [31].

Program

The program consists of various parts (see Fig. 1): (a) four classroom lessons of which two lessons also contain an e-learning module, (b) an online HL-questionnaire that includes two well-being scales and a depression scale that is administered at the start of the second lesson, (c) an individual consultation session with the mental health professional who delivers HL for each student, and (d) potential aftercare for high-risk students. The program is delivered within approximately 5-8 weeks. The lessons and advice sessions are provided by trained mental health professionals (e.g., prevention workers, called HL-trainers). Teachers are present to support the HL-trainers in providing HL. Before the start of the program, HL-trainers create a personal HL-account for each student in an online database. Students will use the HL-account to gain access to the online HL-questionnaire and e-learning module (lesson 2 and 3).

Fig. 1
figure 1

Components of the HL-program

The classroom lessons

The first lesson focuses on the introduction of HL and on the subject happiness. The goal of this first lesson is to encourage a discussion about feeling happy or unhappy, familiarize students with different aspects of happiness, discuss the difference between happiness and being lucky, and to break the taboo about feeling unhappy or down. In this context, engaging group assignments and discussions take place.

In the second lesson, students will learn more about the things that might make them happy and the relationship between feelings, thoughts, and actions. In addition to a class-based exercise, students are asked to complete the online HL-questionnaire. This is a questionnaire on demographics (i.e., gender, age), their own health, family situation (i.e., their family’s’ financial situation, and their family members’ (mental) health status), a depression scale, life satisfaction scale, and a well-being scale. After students complete the HL-questionnaire, they will start the e-learning module which contains videos, animations, and fun and engaging exercises. The e-learning module helps students to improve their mood and to practice the skills with their own feelings, thoughts, and actions.

The third lesson starts with an exercise where the HL-trainer describes different situations (e.g., when students receive the results from a test or students have to give a presentation). Students are asked to describe their feelings for each situation (i.e., being angry, sad, scared, or happy). The lesson also contains an e-learning module with the same elements as the second lesson but is focused on: (1) problem solving, (2) communication tips that help students maintain positive relationships with friends, parents, teachers, (3) the importance of helping others, and (4) thinking about their future dreams and how they can achieve these.

The fourth and final lesson includes a recap of what students have learned so far. In addition, it focusses on the relationship between thoughts and feelings and how students can challenge negative thoughts and change them into more helpful thoughts. Students are also asked to fill in a short evaluation questionnaire about the program. The duration of each lesson is approximately 45 minutes.

The individual consultation session and potential aftercare

After the final lesson, individual consultation sessions are scheduled with all students. In the online database, the HL-trainer can see the answers of the HL-questionnaire. Based on the answers on the HL-questionnaire, the HL-trainer talks with the student to see if the student needs additional support. Students who report high scores on the HL-questionnaire or report other problems at home/school are offered help by the HL-trainer (i.e., some additional individual sessions) or are referred to appropriate local mental health and/or social care services. This will be done in consultation with the student and their parent(s).

Design of the RCT

The effectiveness of HL will be tested within a cluster RCT with two conditions: an intervention condition (receiving HL during the study) and a control condition (care as usual, HL will be delivered after the final follow-up assessment). Participating classes will be randomly assigned to either the intervention or the control condition and will be equally distributed across the two conditions within each schoolyear. This design is chosen to avoid a skewed distribution of participants over the two conditions due to school effects. The randomization will be conducted by an independent statistician. Three assessments will be performed in the study: T0 (pre-test, before the start of HL in intervention group); T1 (3-months follow up); T2 (6-months follow-up).

Data will be collected in two cohorts: the first cohort is planned in the 2021-2022 school year and the second cohort is planned in 2022-2023 school year.

See Fig. 2 for the flowchart of the study and Table 1 for an overview of the schedule of enrolment, interventions, and assessment.

Fig. 2
figure 2

Flowchart of the study design

Table 1 Schedule of enrolment, intervention, and assessments

Study population

Eligibility criteria and recruitment of schools

To provide HL at a school, three different parties need to be involved: schools, mental health organizations that provide the professionals that deliver HL, and – in most cases – the municipality that pays for HL. Schools, mental health organizations, and municipalities were recruited via the website and newsletter of the Trimbos Institute and the HL website. Schools are included in the study if they offer pre-vocational education in at least two first-year or two second-year classes (age 12-14 years). This may also include “combination classes” that contain students from both pre-vocational and higher educational levels.

Eligibility criteria of participants

Students are eligible to participate in the study when they meet the following inclusion criteria: enrolment of first- or second-grade students of classes that provide pre-vocational education (including combination classes), informed consent from student and parent(s) and a sufficient knowledge of the Dutch language.

Recruitment of participants and informed consent

Two weeks before the start of the study, schools provide information letters and consent forms to parents from both groups (intervention and control condition). In order to give permission for their child’s participation, parents are asked to sign the consent form on paper and send it back to the research team by mail or e-mail within a week. Approximately one week before the start of HL in the intervention condition, a research assistant will visit the participating classes to explain the study and provide an information letter to all students. Students can ask questions and are asked to sign an informed consent form on paper in this recruitment session. Students will be enrolled in HL when they and their parents have both provided consent. In consultation with the school, participating students will receive an incentive (e.g., a voucher).

Sample size

The sample size is based on the main outcome: depressive symptoms in pre-vocational students in first and second year classes. Based on a meta-analysis by Stice et al. [24], we assume an effect size of d = 0.20. Thus, we want to test the hypothesis that we will find an effect of d = 0.20 (or larger) at 6 months follow-up. This will be tested at a two-sided significance level of 5% and a power of 80%. Accounting for the clustering in the data with 22 students on average per class, an intraclass correlation of 0.02, a cluster size variation of 0.17 and a baseline correlation of 0.30, we need n = 315 students in each condition. Furthermore, we expect that approximately 40% of parents and/or students will not provide informed consent. In order to secure the needed sample size, the aim is to sample 525 students per trial. Assuming an average of 4 classes of 22 students per school (divided across intervention and control condition), this will require 48 classes from about 12 schools.

The sample size calculation was performed in Stata version 14.2 statistical software package using the clustersampsi-procedure. The intraclass correlation coefficient (ICC) of 0.02 was based on two studies: the Dutch Health Behaviour in School-aged Children Survey (HBSC) [32], where the ICC on the emotional scale within the Strengths and Difficulties Questionnaire (SDQ) was 0.008 (95% CI: 0.003-0.02) and a large European study where the ICC’s for depressive mood varied across countries from 0.01 to 0.07 [33].

Data collection

Data will be collected through an online questionnaire and students’ self-reports. Students will use their personal HL-accounts (created by the HL-trainer) to gain access to the questionnaires. Data for each assessment and in both conditions will be collected during a regular classroom lesson. At the end of the recruitment session, the research assistant will ask all students to fill in the HL-questionnaire as part of the HL-program. For those participating in the study this data will serve as the baseline measurement (T0) for the RCT. For research purposes, the HL-questionnaire is administered before the start of the HL instead of the second lesson. For the second (T1) and third assessment (T2), teachers are approached to collect and administer the questionnaires in their classes. The duration of each questionnaire will be approximately 15 minutes.

Data collected for research purposes will be stored in a database. For each individual student, a unique respondent number will be used. Students’ names and email addresses will be stored in a separate database, which is only accessible for the data manager of the project.

Measures

Demographic characteristics

Demographic characteristics include gender, birth month and -year and immigration background. Immigration background is assessed by asking the students to indicate their own and both of their parents’ country of birth. Students are considered to have an immigration background if they or at least one of the parents was born in another country then the Netherlands. Students’ educational level is collected via the school.

Primary outcome

Depressive symptoms will be measured with the Dutch version of the Center for Epidemiologic Studies Depression Scale (CES-D) [34, 35]. The CES-D measures the frequency of 20 depressive symptoms over the past week on a four-point Likert scale. Examples of items are: “I enjoyed life” and “I felt that everything I did was an effort”. Answer categories are: (0) “rarely or none of the time (less than once a week)”, (1) “some or a little of the time (1-2 days a week)”, (2) “occasionally or a moderate amount of time (3-4 days a week)”, or (3) “most or all of the time (5-7 days a week)”. The total score may range from 0 to 60, with higher scores indicating higher levels of depression. The Dutch version has been validated among adolescents and has excellent psychometric properties [31, 36]. Based on previous Dutch findings, we will use a CES-D cut-off score of 16 or higher to identify students with subclinical levels [34] and a cut-off score of 22 or higher to identify students with clinical levels of depression [36].

Secondary outcomes

Well-being will be measured with the Dutch translation of the Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) [37, 38]. The WEMWBS assesses 14 items on a five-point scale. Scores range from 14 to 70, with higher values reflecting greater perceived well-being. Questions concern feelings experienced in the previous two weeks, such as “I felt good about myself” and “I felt optimistic about the future”. Studies from the United Kingdom found that it is appropriate to use the 14-item WEMWBS to measure well-being among adolescents aged 13 to 16 [39]. In two earlier pilot studies of HL involving pre-vocational students aged 13 to 17, the WEMWBS showed high reliability with Cronbach’s Alpha of 0.84 and higher [31]. The WEMWBS can detect meaningful change at both the group and individual level. At the individual level, minimum detectable change has been set at a change of 3 points [40].

Life satisfaction will be assessed with the Cantril Ladder [41]. Students rate how satisfied they are with their life on a visual analogous scale ranging from (0) “the worst possible life” to [10] “the best possible life”. The Cantril Ladder is easily understood and has shown good reliability and convergent validity among young people (e.g., [42]).

Classmate support will be assessed by three items indicating the extent to which classmates were experienced as supportive, e.g., “Most of the students in my class are kind and helpful” (Response categories ranging from (1) “completely agree” to (5) “completely disagree”). This is a cross-nationally valid and reliable scale for young people [43].

Teacher support will be assessed by three items indicating the extent to which teachers were experienced as supportive, e.g., “I feel that teachers accept me as I am” (Response categories ranging from (1) “completely agree” to (5) “completely disagree”). Cross-national studies showed the scale to be valid and reliable for young people (e.g., [42]).

Bullying involvement. Students are asked how many times they were involved in bullying at school in the past four weeks. The response categories available are: (1) “zero times”, (2) “ones or twice”, (3) “about once a week”, (4) “several times a week”. This is a validated measure on bullying involvement that shows good psychometric properties [44].

Bullying victimization. Students are asked how many times they have been bullied at school in the past four weeks. Response categories include: (1) “zero times”, (2) “ones or twice”, (3) “about once a week”, (4) “several times a week”. This is one of the most validated measures on bullying victimization [45] with sound construct validity [44].

School connectedness. The Psychological Sense of School Membership Scale (PSSM) [46] assesses students’ connectedness with their school. It has 18 items, and a Dutch translation is available. A shortened, 2-item version has been administered in one Dutch study, showing a satisfactory internal consistency of .76 [47]. This short version contains the items: “I feel like a real part of my school” and “I feel proud of belonging to my school”. In this study, this short version will be used.

Statistical analyses

All statistical analyses will be conducted in R [48] by an independent researcher. Reporting of the results will be conducted in accordance with the (extended) CONSORT statement [23]. Analyses will be conducted based on the intention-to-treat (ITT) principle. The primary ITT analyses will be performed using linear mixed models, which adequately deal with missing at random data and can be used to account for the nested structure of the data; students nested within classes and repeated assessments nested within students [49]. Time, condition, and time by condition interactions will be specified as fixed effects to examine the effectiveness of the intervention on continuous primary and secondary outcomes. Baseline scores of the corresponding outcome will simultaneously be entered as fixed factors in the model to account for baseline imbalances. In accordance with the CONSORT statement [23], it will not be explicitly tested whether conditions statistically differ in their baseline characteristics. Hence, the decision whether models will be adjusted for additional covariates will not be based on whether statistical differences in these covariates exist at baseline. Instead, models will primarily be reported that are not adjusted for additional covariates. In an additional sensitivity analysis, it will be examined whether adjusting these models for the following baseline variables substantially changes conclusions drawn from the analyses: gender, age, immigration background, depressive symptoms, well-being, and life satisfaction. Post-hoc tests will be conducted to examine between-group differences at each timepoint using analyses of covariance (ANCOVA), including baseline scores as covariate. Based on estimated marginal means and corresponding standard errors from linear mixed models, between-group effect sizes at each timepoint will additionally be expressed as Cohen’s d with 95% confidence intervals.

Mediation analyses will be performed to examine potential working mechanisms of the effect of the intervention. Research has shown that there is an association between school climate and mental health of students [50]. Positive relationships between students and their teachers or peers increased psychosocial well-being [50]. Moreover, teacher support reduced depressive symptoms [51]. In addition, higher school connectedness (attachment and belonging to school) was positively associated with students’ psychosocial well-being [50] and acted as a buffer against depressive symptoms and anxiety [51, 52]. Finally, causal associations were found between bullying and depression [53]. Therefore, the following variables will be tested as potential mediators: classmate support, teacher support, school connectedness, and bullying. The categorical variable condition will be included as independent variable in all mediation models (0 = control, 1 = intervention), and the observed scores of primary or secondary outcomes at follow-up as dependent variable. Total, direct, and (total) indirect effects with 95% bootstrapped confidence intervals will be calculated for all mediation models [54, 55].

Furthermore, exploratory moderator analyses will be conducted to examine whether the effect of the intervention on primary and secondary outcomes depends on a priori defined variables. Various sociodemographic factors have an influence on interventions focused on depressive symptoms or well-being. Research has shown that girls might experience more benefits from depression prevention programs than boys [56]. Moreover, older participants might benefit more from cognitive-behavioral therapy [24, 57]. In addition, research has shown that depression prevention programs are likely to be more effective for adolescents with ethnic minority backgrounds [24], since they report more problems with mental health compared to adolescents with ethnic majority backgrounds [32]. Therefore, the following variables will be examined as potential moderators: level of baseline CES-D depressive symptoms, gender, age, and immigration background. Separate linear mixed models with condition, the putative moderator, and the interaction of these two as fixed effects will be used to examine potential moderation effects.

Design of the implementation study

Study population

The implementation study will be executed among recipients of HL (students), implementers (HL-trainers), and other school professionals (e.g., teachers, care coordinators).

Measures

As the aim is to understand the implementation process and how the intervention was implemented and received, we relate to implementation constructs from Proctor’s Implementation Outcome Framework [58], focusing on fidelity, acceptability, appropriateness and feasibility. The implementation process measures, and their data collection methods are shown in Table 2.

Table 2 Operationalized implementation measures and data sources

Data collection and analysis

As shown in Table 2, multiple sources of data collection will be used. Data will be collected through classroom observations (n = 20), qualitative interviews with HL-trainers (n = 10) and teachers or care coordinators (n = 10), or until saturation is reached, and an evaluation survey for students.

Classroom observations are conducted to investigate to which extent the program was delivered as planned/trained by HL-trainers. An observation checklist will be made based on components of the instruction manual for HL-trainers (e.g., if the exercises were conducted and executed within the allocated time). During the observation, additional notes will be made (for example, on HL-trainer and student interaction, classroom engagement). For each lesson, a different checklist is designed, tailored to the different exercises and goals. We will conduct observations in five classes and within each class, we will observe all four lessons. For the classroom observations, checklist items, and items with scores or response items will be analysed quantitatively through descriptive statistics and frequency tables. For the open-ended items of the observations, we will perform a qualitative analysis, looking at common themes across answers.

Semi-structured interviews will be carried out with HL-trainers and school professionals to understand their experience with receiving or delivering the program, including how feasible the content was to deliver, how satisfied students were with the content of the program, adaptations made to the program by HL-trainers, etc. Interviews will be audio-taped with participants’ permission and transcribed verbatim. Qualitative analysis will be carried out by two independent researchers according to a coding framework developed by the project team. Coding will take both a deductive and inductive approach and a thematic content analysis approach will be applied to coded data.

Students will be asked about their experience with the HL-program through an online survey. Survey items will include closed and open-ended questions with open fields for answers. Survey items will include what they have learned from the program, if they would recommend HL to peers, if they were satisfied with the program and suggestions for improvement. The closed questions will be analysed in SPSS 27.0. Descriptive statistics will be reported. For the open-ended questions, an inductive approach will be used.

Discussion

This protocol paper outlines a cluster RCT and an implementation study that together aim to assess the effectiveness and implementation of a school-based program for pre-vocational adolescents in the Netherlands designed to prevent depression and promote well-being. The primary aim is to investigate levels of depressive symptoms at 6-months follow up among students who receive HL compared to students who received care as usual. Secondary aims include assessing the effects of HL on well-being and life satisfaction at 6-months follow up, identifying whether school and class climate mediate the effect of HL on depression, exploring potential effect-modifying factors (i.e., demographic factors and symptoms at baseline), and evaluating the implementation of the intervention for improvements and possible scale-up.

Strengths and limitations

A strength of this study is that we will perform the study in a real-life condition, which will increase the external validity of the results. Furthermore, we will not only focus on the effectiveness of the program but will also study potential mediators and moderators. This will give us insight into why and for whom the program is effective. Another strength is that we also look at implementation outcomes, to be able to distil key factors affecting implementation for other schools considering implementation of HL.

Despite these strengths, this study does not come without limitations. Since we randomize at the classroom level, a possible negative effect could be that control students are ‘contaminated’ from contact with and possible influence from students or school mates in the intervention arm. We expect however that these effects are minimal and will have no meaningful effect on the outcomes of this study. Another limitation is that we did not use a representative sample of schools to investigate the effectiveness of this program. We expect that schools which more interested in promoting well-being and preventing depressive symptoms among their students, are more likely to participate in this program and study. In addition, to get an impression of the representativeness of our sample, we will compare the results of this study (e.g. life satisfaction) with data from national studies [59, 60]. Furthermore, we decided to include a 6-month follow-up measurement, and not a 12-months measurement since it was preferred by schools to logistically complete the program and its evaluation within one school year. Another limitation of the study is that the students’ results are based on self-reported data, which might lead to measurement errors or under-reporting of depressive symptoms due to social desirability bias. However, we will use validated questionnaires or questionnaires used in other studies.

Implications for practice

The results from both the RCT and implementation study will contribute to the evidence base on school-based interventions for depression and promoting well-being among pre-vocational students, which is scarce. In addition, the results will be useful for optimizing future implementation of the program and elucidate insights for further scale-up to other schools and contexts. With the results of the implementation study, we will be able to understand the factors that will affect implementation, which can be used to better tailor and target an implementation plan for HL-trainers and schools in the future. This information will also be of interest for other similar school-based interventions.

Availability of data and materials

Not applicable.

Abbreviations

CES-D:

Center for Epidemiologic Studies Depression Scale

HL:

Happy Lessons

ICC:

Intraclass correlation coefficient

RCT:

Randomized controlled trial

SPIRIT:

Standard Protocol Items, Recommendations for Interventional Trials

T0:

Pre-test

T1:

3-months follow-up

T2:

6-months follow-up

WEMWBS:

Warwick-Edinburgh Mental Well-Being Scale

References

  1. Gore FM, Bloem PJN, Patton GC, Ferguson J, Joseph V, Coffey C, et al. Global burden of disease in young people aged 10-24 years: A systematic analysis. Lancet. 2011;377(9783):2093–102. https://doi.org/10.1016/S0140-6736(11)60512-6.

    Article  PubMed  Google Scholar 

  2. Ormel J, Raven D, Van Oort F, Hartman CA, Reijneveld SA, Veenstra R, et al. Mental health in Dutch adolescents: A TRAILS report on prevalence, severity, age of onset, continuity and co-morbidity of DSM disorders. Psychol Med. 2015;45(2):345–60. https://doi.org/10.1017/S0033291714001469.

    Article  CAS  PubMed  Google Scholar 

  3. Fergusson DM, Woodward LJ. Mental health, educational, and social role outcomes of adolescents with depression. Arch Gen Psychiatry. 2002;59(3):225–31. https://doi.org/10.1001/archpsyc.59.3.225.

    Article  PubMed  Google Scholar 

  4. Fergusson DM, Horwood LJ, Ridder EM, Beautrais AL. Subthreshold depression in adolescence and mental health outcomes in adulthood. Psychol Med. 2005;62:66–72. https://doi.org/10.1001/archpsyc.62.1.66.

    Article  Google Scholar 

  5. Glied S, Pine DS. Consequences and correlates of adolescent depression. Arch Pediatr Adolesc Med. 2002;156(10):1009–14. https://doi.org/10.1001/archpedi.156.10.1009.

    Article  PubMed  Google Scholar 

  6. Jaycox LH, Stein BD, Paddock S, Miles JN V, Chandra A, Meredith LS, et al. Impact of teen depression on academic, social, and physical functioning. Pediatrics. 2009;124(4):e596–605. https://doi.org/10.1542/peds.2008-3348.

    Article  PubMed  Google Scholar 

  7. Fletcher JM. Adolescent depression: diagnosis, treatment, and educational attainment. Health Econ. 2008;17(11):1215–35. https://doi.org/10.1002/hec.1319.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Nuijen J, van Bon-Martens M. Zicht op depressie: de aandoening , preventie en zorg. Themarapportage van de Staat van Volksgezondheid en Zorg. 2017.

    Google Scholar 

  9. Meijer SA, Smit F, Schoemaker CG, Cuijpers P. Gezond verstand Evidence-based preventie van psychische stoornissen; 2006.

    Google Scholar 

  10. Rijksinstituut voor Volksgezondheid en Milieu. Kosten van ziekten 2017. https://statline.rivm.nl/#/RIVM/nl/dataset/50050NED/table?ts=1601546554761) (2019). Accessed 9 Jun 2021.

  11. Kim-Cohen J, Caspi A, Moffitt TE, Harrington H, Milne BJ, Poulton R. Prior juvenile diagnoses in adults with mental disorder. Arch Gen Psychiatry. 2003;60(7):709. https://doi.org/10.1001/archpsyc.60.7.709.

    Article  PubMed  Google Scholar 

  12. Costello EJ, Foley DL, Angold A. 10-Year research update review: the epidemiology of child and adolescent psychiatric disorders: II. Developmental epidemiology. J Am Acad Child Adolesc Psychiatry. 2006;45(1):8–25. https://doi.org/10.1097/01.chi.0000184929.41423.c0.

    Article  PubMed  Google Scholar 

  13. Kessler RC. Lifetime prevalence and age-of-onset distributions of mental disorders in the World Health Organization’s World Mental Health Survey Initiative. World Psychiatry. 2007;6(3):168–76.

    PubMed  PubMed Central  Google Scholar 

  14. Keyes CLM. Promoting and protecting mental health as flourishing: a complementary strategy for improving national mental health. Am Psychol. 2007;62(2):95–108. https://doi.org/10.1037/0003-066X.62.2.95.

    Article  PubMed  Google Scholar 

  15. Wood AM, Joseph S. The absence of positive psychological (eudemonic) well-being as a risk factor for depression: a ten year cohort study. J Affect Disord. 2010;122(3):213–7. https://doi.org/10.1016/j.jad.2009.06.032.

    Article  PubMed  Google Scholar 

  16. Howell RT, Kern ML, Lyubomirsky S. Health benefits: Meta-analytically determining the impact of well-being on objective health outcomes. Health Psychol Rev. 2007;1(1):83–136. https://doi.org/10.1080/17437190701492486.

    Article  Google Scholar 

  17. Pressman SD, Cohen S. Does positive affect influence health? Psychol Bull. 2005;131(6):925–71. https://doi.org/10.1037/0033-2909.131.6.925.

    Article  PubMed  Google Scholar 

  18. Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010;10(1):1–9. https://doi.org/10.1186/1471-244X-10-113.

    Article  Google Scholar 

  19. Rickwood DJ, Deane FP, Wilson CJ. When and how do young people seek professional help for mental health problems. Med J Aust. 2007;187(S7):S35–9. https://doi.org/10.5694/j.1326-5377.2007.tb01334.x.

    Article  PubMed  Google Scholar 

  20. Bastiaanssen I, Hamberg H, Ince D. Interventies rond opvoeden en opgroeien : meer lacunes dan overvloed; 2020.

    Google Scholar 

  21. Tak YR, Lichtwarck-Aschoff A, Gillham JE, Van Zundert RMP, Engels RCME. Universal School-Based Depression Prevention ‘Op Volle Kracht’: a Longitudinal Cluster Randomized Controlled Trial. J Abnorm Child Psychol. 2016;44(5):949–61. https://doi.org/10.1007/s10802-015-0080-1.

    Article  PubMed  Google Scholar 

  22. Vojt G, Skivington K, Sweeting H, Campbell M, Fenton C, Thomson H. Lack of evidence on mental health and well-being impacts of individual-level interventions for vulnerable adolescents: systematic mapping review. Public Health. 2018;161:29–32. https://doi.org/10.1016/j.puhe.2018.04.003.

    Article  CAS  PubMed  Google Scholar 

  23. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Int J Surg. 2011;9(8):672–7. https://doi.org/10.1186/1745-6215-11-32.

    Article  PubMed  Google Scholar 

  24. Stice E, Shaw H, Bohon C, Marti CN, Rohde P. A meta-analytic review of depression prevention programs for children and adolescents: factors that predict magnitude of intervention effects. J Consult Clin Psychol. 2009;77(3):486–503. https://doi.org/10.1037/a0015168.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Werner-Seidler A, Perry Y, Calear AL, Newby JM, Christensen H. School-based depression and anxiety prevention programs for young people: A systematic review and meta-analysis. Clin Psychol Rev. 2017;51:30–47. https://doi.org/10.1016/j.cpr.2021.102079.

    Article  PubMed  Google Scholar 

  26. Weare K, Nind M. Mental health promotion and problem prevention in schools: what does the evidence say? Health Promot Int. 2011;26. https://doi.org/10.1093/heapro/dar075.

  27. Rothman AJ, Salovey P, Bedell B, Cioffi D, Dertweiler J, Lemm K, et al. Shaping perceptions to motivate healthy behavior: the role of message framing. Psychol Bull. 1997;121(1):3–19. https://doi.org/10.1037/0033-2909.

    Article  CAS  PubMed  Google Scholar 

  28. Cuijpers P, Andersson G, Donker T, Van Straten A. Psychological treatment of depression: Results of a series of meta-analyses. Nord J Psychiatry. 2011;65(6):354–64. https://doi.org/10.3109/08039488.2011.596570.

    Article  PubMed  Google Scholar 

  29. Seligman MEP, Steen TA, Park N, Peterson C. Positive psychology progress: empirical validation of interventions. Am Psychol. 2005;60(5):410–21. https://doi.org/10.1037/0003-066X.60.5.410.

    Article  PubMed  Google Scholar 

  30. Taylor CT, Lyubomirsky S, Stein MB. Upregulating the positive affect system in anxiety and depression: outcomes of a positive activity intervention. Depress Anxiety. 2017;34(3):267–80. https://doi.org/10.1002/da.22593.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Van der Zanden R, van der Linden D. Evaluatieonderzoek Happyles Den Haag; 2013.

    Google Scholar 

  32. Stevens G, Van Dorsselaer S, Boer M, De Roos S, Duinhof E, Bogt T, et al. HBSC 2017. Gezondheid en welzijn van jongeren in Nederland. 2018.

    Google Scholar 

  33. Shackleton N, Hale D, Bonell C, Viner RM. Intraclass correlation values for adolescent health outcomes in secondary schools in 21 European countries. SSM Popul Heal. 2016;2:217–25. https://doi.org/10.1016/j.ssmph.2016.03.005.

    Article  CAS  Google Scholar 

  34. Bouma J, Ranchor AV, Sanderman R, Van Sonderen E. Het meten van symptomen van depressie met de CES-D; 2012.

    Google Scholar 

  35. Schroevers MJ, Sanderman R, Van Sonderen E, Ranchor AV. The evaluation of the Center for Epidemiologic Studies Depression (CES-D) scale: Depressed and Positive Affect in cancer patients and healthy reference subjects. Qual Life Res. 2000;9:1015–29. https://doi.org/10.1023/A:1016673003237.

    Article  CAS  PubMed  Google Scholar 

  36. Cuijpers P, Boluijt P, Van Straten A. Screening of depression in adolescents through the Internet: sensitivity and specificity of two screening questionnaires. Eur Child Adolesc Psychiatry. 2008;17(1):32–8. https://doi.org/10.1007/s00787-007-0631-2.

    Article  PubMed  Google Scholar 

  37. Ikink JG, Lamers SM, Bolier JM. De Warwick-Edinburgh Mental Well-being Scale (WEMWBS) als meetinstrument voor mentaal welbevinden in Nederland: Universiteit Twente; 2012.

  38. Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, et al. The Warwick-Dinburgh mental well-being scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5:1–13. https://doi.org/10.1186/1477-7525-5-63.

    Article  Google Scholar 

  39. Clarke A, Friede T, Putz R, Ashdown J, Martin S, Blake A, et al. Warwick-Edinburgh Mental Well-being Scale (WEMWBS): validated for teenage school students in England and Scotland. A mixed methods assessment. BMC Public Health. 2011;11(1):487. https://doi.org/10.1186/1471-2458-11-487.

    Article  PubMed  PubMed Central  Google Scholar 

  40. WARWICK. WEMWBS: 14-item vs 7-item scale. https://warwick.ac.uk/fac/sci/med/research/platform/wemwbs/about/wemwbsvsswemwbs. Accessed 20 Aug 2021.

  41. Cantril H. Pattern of human concerns; 1965.

    Google Scholar 

  42. Levin KA, Currie C. Reliability and validity of an adapted version of the cantril ladder for use with adolescent samples. Soc Indic Res. 2014;119(2):1047–63. https://doi.org/10.1007/s11205-013-0507-4.

    Article  Google Scholar 

  43. Torsheim T, Samdal O, Rasmussen M, Freeman J, Griebler R, Dür W. Cross-National Measurement Invariance of the Teacher and Classmate Support Scale. Soc Indic Res. 2012;105(1):145–60. https://doi.org/10.1007/s11205-010-9770-9.

    Article  PubMed  Google Scholar 

  44. Kyriakides L, Kaloyirou C, Lindsay G. An analysis of the Revised Olweus Bully/Victim Questionnaire using the Rasch measurement model. Br J Educ Psychol. 2006;76(4):781–801. https://doi.org/10.1348/000709905X53499.

    Article  PubMed  Google Scholar 

  45. Vessey J, Strout TD, Difazio RL, Walker A. Measuring the youth bullying experience: a systematic review of the psychometric properties of available instruments. J Sch Health. 2014;84(12):819–43. https://doi.org/10.1111/josh.12210.

    Article  PubMed  Google Scholar 

  46. Goodenow C. The psychological sense of school membership among adolescents: Scale development and educational correlates. Psychol Sch. 1993;30:79–90. https://doi.org/10.1002/1520-6807(199301)30:1<79::AID-PITS2310300113>3.0.CO;2-X.

    Article  Google Scholar 

  47. Pot N, Schenk N, Van Hilvoorde I. School sports and identity formation: socialisation or selection? Eur J Sport Sci. 2014;15(5):484–91. https://doi.org/10.1080/17461391.2013.873483.

    Article  Google Scholar 

  48. R Core Team. R: The R Project for Statistical Computing. https://www.r-project.org/. Accessed 1 Oct 2021.

  49. Theobald E. Students are rarely independent: When, why, and how to use random effects in discipline-based education research. CBE Life Sci Educ. 2018;17(3):1–12. https://doi.org/10.1187/cbe.17-12-0280.

    Article  Google Scholar 

  50. Aldridge JM, Mcchesney K. The relationships between school climate and adolescent mental health and wellbeing: a systematic literature review. Int J Educ Res. 2018;88:121–45. https://doi.org/10.1016/j.ijer.2018.01.012.

    Article  Google Scholar 

  51. Joyce HD, Early TJ. The impact of school connectedness and teacher support on depressive symptoms in adolescents: a multilevel analysis. Child Youth Serv Rev. 2014 Apr;1(39):101–7. https://doi.org/10.1016/j.childyouth.2014.02.005.

    Article  Google Scholar 

  52. Brière FN, Pascal S, Dupéré V, Janosz M. School environment and adolescent depressive symptoms: a multilevel longitudinal study. Pediatrics. 2013;131(3). https://doi.org/10.1542/peds.2012-2172.

  53. Moore SE, Norman RE, Suetani S, Thomas HJ, Sly PD, Scott JG. Consequences of bullying victimization in childhood and adolescence: A systematic review and meta-analysis. World J Psychiatry. 2017;7(1):60. https://doi.org/10.5498/wjp.v7.i1.60.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Hayes AF. Introduction to mediation, moderation, and conditional process analysis: a regression-based approach: Guilford Publications; 2017. p. 1–79.

  55. Hayes AF, Rockwood NJ. Regression-based statistical mediation and moderation analysis in clinical research: Observations, recommendations, and implementation. Behav Res Ther. 2017;98:39–57. https://doi.org/10.1016/j.brat.2016.11.001.

    Article  PubMed  Google Scholar 

  56. Horowitz JL, Garber J. The prevention of depressive symptoms in children and adolescents: A meta-analytic review. J Consult Clin Psychol. 2006;74(3):401–15. https://doi.org/10.1037/0022-006X.74.3.401.

    Article  PubMed  Google Scholar 

  57. Mccart M, Priester PE, Davies WH, Azen R. differential effectiveness of behavioral parent-training and cognitive-behavioral therapy for antisocial youth: a meta-analysis. Artic J Abnorm Child Psychol. 2006;34:525–41. https://doi.org/10.1007/s10802-006-9031-1.

    Article  Google Scholar 

  58. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health Ment Health Serv Res. 2010;38(2):65–76. https://doi.org/10.1007/s10488-010-0319-7.

    Article  Google Scholar 

  59. Inchley J, Currie D, Budisavljevic S, Torsheim T, Jåstad A, Cosma A, et al. Spotlight on adolescent health and well-being. Findings from the 2017/2018 Health Behaviour in School-aged Children (HBSC) survey in Europe and Canada. International report, vol. 1. Copenhagen: Key findings. World Health Organization; 2020.

    Google Scholar 

  60. Kleinjan M, Pieper I, Stevens G, van de Klundert N, Rombouts M, Boer M, et al. Geluk onder druk? Onderzoek naar het mentaal welbevinden van jongeren in Nederland. Unicef Netherlands. 2020.

    Google Scholar 

Download references

Acknowledgements

We would like to acknowledge the contribution of Dr. Bethany Hipple Walters for guidance on the implementation study.

Funding

This project is funded by ZonMw, the Netherlands Organization for Health Research and Development (project number 555 002 019).

Author information

Authors and Affiliations

Authors

Contributions

MR drafted the manuscript, developed the study protocol, and is involved in execution of the study. ED was involved in developing and executing the study protocol for both the trial and implementation study. KM and MK were involved in developing and executing the study protocol with a specific focus on the trial. LSZ was involved in developing the study protocol with a specific focus on the implementation study. JK developed the plan for statistical analysis. All authors read and corrected the draft versions of the manuscript and approved the final version.

Corresponding author

Correspondence to Marieke Rombouts.

Ethics declarations

Ethics approval and consent to participate

Ethical approval for this study was provided by the Medical Research Ethics Committee Utrecht (reference number NL77336.041.21, protocol version 3.0). The study was registered in the Dutch Trial Register (NL9732). Written informed consent from students and parents will be obtained.

Consent for publication

Not applicable.

Competing interests

MR, ED, MK, LSZ and KM are employees at the Trimbos Institute, which is the institution that developed Happy Lessons. JK declares that he has no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1. 

SPIRIT 2013 Checklist: Recommended items to address in a clinical trial protocol and related documents.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rombouts, M., Duinhof, E.L., Kleinjan, M. et al. A school-based program to prevent depressive symptoms and strengthen well-being among pre-vocational students (Happy Lessons): protocol for a cluster randomized controlled trial and implementation study. BMC Public Health 22, 139 (2022). https://doi.org/10.1186/s12889-021-12321-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-021-12321-3

Keywords