Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Effects on alcohol use of a Swedish school-based prevention program for early adolescents: a longitudinal study

  • Linda Beckman1, 2Email author,
  • Mikael Svensson3,
  • Susanna Geidne1 and
  • Charli Eriksson1
BMC Public HealthBMC series – open, inclusive and trusted201717:2

https://doi.org/10.1186/s12889-016-3947-3

Received: 21 October 2015

Accepted: 15 December 2016

Published: 3 January 2017

Abstract

Background

The aim of the study was to address the lack of evaluations of school-based substance use prevention programs and to conduct a quasi-experimental evaluation of the alcohol use part of the Triad intervention.

Methods

Eleven Swedish intervention schools (285 pupils) and three control schools (159 pupils) participated in the evaluation. Baseline measurements were conducted in 2011 before the alcohol part in the prevention program was implemented in the intervention schools (school year 6, ages 12–13). We estimated an Intention-To-Treat (ITT) Difference-in-Difference (DD) model to analyze the effectiveness of the intervention on subsequent alcohol use measured in grades 7, 8 and 9.

Results

The main results show no effect on the likelihood of drinking alcohol or drinking to intoxication.

Conclusions

The lack of positive effects highlights the need for policy-makers and public health officials need to carefully consider and evaluate prevention programs in order to ensure that they are worthwhile from school, health, and societal perspectives.

Keywords

Adolescents Evaluation Intervention

Background

Consumption of substances including tobacco, alcohol, and drugs is a significant health hazard for individuals and poses a challenge for public health program development [16]. A link between early adolescent onset of alcohol consumption and increased risk of developing dependence later in life has repeatedly been reported in retrospective cross-sectional studies [7] as well as in prospective longitudinal studies [8, 9]. Although alcohol dependence is partly explained by genetic factors, and environmental factors for alcohol initiation seem to be less of a risk factor [10], under-age alcohol consumption can interfere with school attendance, disrupt concentration, damage relationships, and potentially alter brain function or other aspects of development, health, and well-being [11, 12]. There are many factors that increase vulnerability to addiction, including developmental stage, exposure to early life adversity (ranging from abuse and neglect to and bullying), drug exposure, and genetic predisposition [13]. The impact on the developing brain is large when the child is younger; therefore, the interventions need to take developmental stage of the target group into consideration [14]. Moreover, there is evidence that knowledge acquisition, learning, and memory are vulnerable to alcohol use during adolescence [15]. In light of this, preventing adolescents from starting to use alcohol or other substances, or delaying the onset of use, is a fundamental task for public health work.

For decades, schools have been an important health-promoting setting [16, 17] and have been used as a platform for health promotion strategies and interventions [18] concerning, e.g., alcohol, drug, and tobacco consumption. However, although we seem to have good knowledge of which components work; due to the complex interactions of societal, social, and individual factors, interventions to prevent or reduce adolescents’ substance consumption are difficult to design, implement and evaluate [19, 20]. During recent decades, a range of preventive programs have been implemented internationally, as well as in Swedish schools. A Cochrane review [21] of the effectiveness of universal alcohol abuse prevention programs for children and adolescents found that less than half of the included studies (43.4%) reported significant beneficial results. In a recent systematic review by Agabio et al. [22] that included 12 randomized controlled trials not assessed in Foxcroft and Tsertsvadze’s study, 7 of these 12 additional reviewed interventions were more effective than control groups. However, a recent meta-analysis of reviews concluded that there was a small but consistent positive effect of school-based prevention programs; however, it is less clear what the “active ingredient” of such success is [23].

Most evidence-based prevention programs are evaluated in the US in small and highly controlled trials with high levels of implementation fidelity [24], and the results are therefore not easily transferred to other contexts or to broader program implementations in general. In Sweden, few alcohol prevention programs have been evaluated, so there is a general lack of evidence on the effectiveness of such programs [25, 26]. Moreover, there are important challenges in context adaptation of foreign programs into other national settings [27, 28]. Therefore, the aim of the study was to address the lack of evaluations of school-based substance use prevention programs and to conduct a quasi-experimental evaluation of the alcohol use part of the Triad.

Alcohol consumption

Internationally, mean alcohol consumption among adolescents varies substantially among countries. The ESPAD study [29] found that among 16-year-old adolescents, girls’ alcohol consumption ranged from 21 centiliters of 100% alcohol per year in Romania to 137 centiliters on the Isle of Man. For boys it ranged from 71 centiliters per year in Ukraine to 173 centiliters on the Isle of Man. Boys generally report higher annual alcohol consumption than girls in all countries except Iceland and Norway. When “heavy episodic drinkers” (five or more drinks in a row during the last 30 days) are considered, the frequency for girls varied from 1.5 times in the last 30 days in Romania to 3.7 times on the Isle of Man. The corresponding figures for boys were 2.2 (Iceland, Romania and Switzerland) and 3.7 (Estonia and Malta) times in the last 30 days. Overall, boys reported a significantly higher frequency of heavy of drinking than did girls in all countries except Sweden and Iceland.

Swedish law, as in many countries, requires a person to be 18 years old to purchase alcoholic beverages containing more than 2.25% alcohol by volume. At the state-monopoly alcohol stores, the age limit for purchasing alcoholic beverages containing over 3.5% alcohol by volume is 20 years [30]. The national trend in Sweden is toward decreasing alcohol consumption among adolescents, however this could be explained by a polarization of drinking [31, 32]. Currently, data show that 47% of 15-year-olds (43% of boys and 50% of girls) in Sweden consume alcohol [33].

Preventive interventions

Substance use prevention programs in schools were initially characterized by short term interventions and fear arousal, lecturing students about the dangers and long-term health consequences of substance consumption [34, 35]. Such interventions were rarely successful and generally lacked a theoretical foundation that considered developmental factors, social influences, and other potential contributors to adolescent substance consumption. Today, we know more about which components are successful in interventions, but few of the many extant programs include these features or evaluate their effects with well-designed research [36]. From a learning perspective it has been argued that interactive strategies, combining practice in social skills and educational knowledge transmission, increase the likelihood of success in a prevention program [24, 25, 37, 38]. Interventions that target more than one risk factor also seem to be more effective [34, 39]. Methods for strengthening social, emotional, behavioral, cognitive, and moral competencies; building self-efficacy; improving social relations with adults, peers, and younger children; providing structure and consistency in program delivery; and intervening with youth for a longer period of time are further effective components [4042]. There is no evidence that resistance skills training has an effect on reducing substance use [36]. There is also no evidence that more intensive programs are more effective than less intensive ones [36]. Reviews have also tried to elucidate the effectiveness of school, family, and multicomponent programs, with some ambiguous results. While a Cochrane review [21] reported little evidence of the effectiveness of multicomponent interventions, compared with single-component interventions, in reducing alcohol misuse among youths, e.g., Catalano et al. [40]. Another program, originally from Finland but used in many European countries, targets pupils directly in class and uses competition as motivation. This is known as the “Smoke-free class competition” (SFC). The SFC targets only tobacco use and has been evaluated positively in a meta-analysis [43]. The core of the SFC is that entire school classes compete by signing a contract in which they promise to be smoke-free for the next 6 months. If they succeed they can win prizes in a lottery. The methodological approach of using prizes as rewards relies on frameworks such as learning theory [44] and social learning theory [45], where the behavior of remaining smoke-free becomes attractive and worthwhile; also, classmates are important to adolescents and function as influential role models for smoking initiation. Incentives, such as prizes or rewards, may be effective in improving single health behaviors, as shown by J Kavanagh, A Oakley, A Harden, A Trouton and C Powell [46]. However, this has not been the case for complex health behaviors.

Although Swedish schools have adopted a range of different prevention programs, published evaluations on programs targeting the pupils directly, in class, are scarce. Programs shown to be effective internationally lack counterparts in Sweden [47, 48]. One exception is the “Unplugged” program, which aims to postpone substance use and reduce future use. The program was implemented in 14 Swedish schools and in another set of schools in seven European countries. The program employs a high degree of interactive pedagogy, e.g., by involving pupils as leaders, providing education in life skills, holding parent meetings, and training social skills and norms related to alcohol and narcotics [47, 49]. On a European level, the results showed that the program was more effective than traditional substance use education. However, in Sweden there were no significant differences between control and treatment schools. It was argued that the program’s lack of measurable effect may be due to the fact that many of the ordinary prevention strategies implemented in control schools offer a high degree of interactivity similar to that in the Unplugged program [49].

The Triad (in Swedish “Triaden”) is an ongoing intervention administered by the non-governmental organization (NGO) Team 49. An entire school can purchase the program, but implementation occurs at the classroom level. Eleven intervention schools and three control schools participated. The authors of this study did not participate in the development of the program. Our aim with this study was to address the lack of evaluations of school-based substance use prevention programs and to conduct a quasi-experimental evaluation of the alcohol use part of the Triad intervention. The reason why we only address alcohol use were that smoking, and other drugs are very uncommon in these ages hence there would be too few pupils included in the analysis.

The Triad consists partly of components that have been shown to be successful but also includes some weaknesses (described under Structure and Components of the Program). Our investigation will add to the body of evidence related to school-based intervention programs. To our knowledge, this is the first study to evaluate a Swedish program targeting this age group during school hours. This study focuses on one of the three components of the Triad program – preventing substance use (“Fighting Drugs”) – by following pupils from school year 6 (baseline) to school year 9.

Methods

Structure and components of the intervention

The intervention the Triad is administered by the non-governmental organization (NGO) Team 49. The NGO has no religious or temperance-related affiliation. The purpose of the Triad is to increase pupils’ resistance skills through understanding and awareness of the harmful consequences of drugs and delinquent behavior, which in turn is believed to influence them to refrain from drugs and crime. The entire class participates and constitutes a team in arranged competitions with prizes. The program is built on different themes for each grade: Grade 4 (10- and 11-year-olds) includes traffic education; grade 5 (11- and 12-year-olds) aims to strengthen pupils’ morality and ethics and to prevent non-normative behavior such as delinquency, bullying, and shoplifting; and grade 6 (12- and 13-year-olds) encourages pupils to refrain from using alcohol, tobacco, and other drugs. The project started in 2011 with these three grade cohorts. This particular study is based on the grade 6 cohort, which only received the substance use theme of the prevention program in grade 6, and a follow-up at the beginning of grades 7, 8 and 9.

The information and educational materials are available to the teachers on the Triad website (via a personal login). A brochure can be downloaded with information about such things as how to use the materials, news, teacher tutoring (including pedagogical tips for planning the lesson), and fact sheets. Support is available if needed, and the teacher decides how to schedule the tasks and how much time each task will take.

The teachers are provided with suggested tasks for the class that aim to increase awareness in a certain area (e.g., drugs). The tasks align with the content and timeframe of the school curriculum (4–5 tasks, estimated time 80 min/task). An example of a task connected to the subject of math is: “Calculate, based on the knowledge that alcohol cost the society 5 billons Euro, how much money each individual would get out of this sum. It lives 9 billion inhabitants in Sweden”. A further example, connected to art, is “Draw a transparent person and show where in the body different diseases can strike us if we begin to drink. Present the results in front of the class.” In addition, about four 10-min informational films/grade about the current topic shows the consequences and hazards of, e.g., using drugs. Powerpoint slideshows with discussion material are also available. The Triad program also seeks to involve parents by allowing the students do tasks at home (decided by the teacher), e.g., discussing or investigating a certain topic together with the family: “Ask a grownup in your home if they know why people drink. Ask them to tell you about a situation where some grownups they met have behaved badly while drinking. Write down their story and tell the story to the class.” Or, “Ask a grownup in your home if they know why other grownups buy alcohol for underage adolescents despite knowing about the hazards of drinking alcohol.” When a task is completed, the teacher reports this via the website, and also evaluates each task.

The incentive for participating and completing the tasks is a lottery where the whole class can win prizes at the end of the school year; all tasks must be completed in order to participate. The program includes three competitions, one for each grade, and ends with a grand finale together with the parents, where the prizes are diplomas and grants dedicated for a particular experience. The finale is arranged in cooperation with the municipality and/or local businesses.

This program includes some components that have been shown to be effective in other preventive substance use programs, and some that have not. The main components, shown in Table 1, include (1) increasing resistance skills through understanding and awareness of the harmful consequences of drugs and delinquency, (2) involving parents, and (3) a lottery contest where the whole class can win prizes, which seems to be an incentive for participants to complete the tasks.
Table 1

Components of the Triad program

• Increasing resilience skills through understanding and awareness about consequences and hazards of e.g., using drugs by showing ~ 4 10-min informational films per grade about the relevant topic, and showing and/or using power points with discussion material.

• Involving parents.

• The incentive for participating and completing the tasks is a lottery where the entire class can win prizes at the end of the school year.

Participants

Eleven intervention schools (285 intervention pupils, participation rate 93%) and three control schools (159 control pupils, participation rate 92%) participated at baseline in 2011 (school year 6). When pupils in the intervention schools left grade 6 and went to grade 7 (junior high school) they attended the same junior high school. At baseline, participation was somewhat higher in the control schools than in the intervention schools (91 and 85% respectively; Table 1). Attrition was also higher in the intervention schools. Table 2 shows demographic data for the participants. The intervention and control schools were similar with regard to gender and ethnic background, but pupils in the intervention schools had better housing conditions and greater cultural capital, and more often lived in a nuclear family.
Table 2

Participants in the intervention and control schools at baseline and at follow up

 

Autumn 2011 school year 6 (baseline)

Autumn 2012 school year 7

Autumn 2013 school year 8

Autumn 2014 school year 9

Intervention schools

Girls: n = 141

Girls: n = 119

Girls: n = 128

Girls: n = 120

Boys: n = 143

Boys: n = 112

Boys: n = 111

Boys: n = 111

Total: 284/334

Total: 231/334

Total: 239/334

Total: 231/334

(85.0%)

(69.2%)

(71.6%)

(69.2%)

Control schools

Girls: n = 72

Girls: n = 68

Girls: n = 68

Girls: n = 63

Boys: n = 73

Boys: n = 68

Boys: n = 66

Boys: n = 58

Total: 145/160

Total: 136/160

Total: 134/160

Total: 121/160

(90.6%)

(85%)

(83.8%)

(75.6%)

Procedure

Swedish municipalities, which are responsible for both funding and arranging primary and secondary education, were informed about the study and invited to participate. The municipalities decided which schools would participate, and then informed the schools about the program. Hence, schools did not self-select into the intervention; therefore, the principal and teachers could be positive, neutral or negative toward the program. This could arguably improve external validity of the design relative to that of a typical randomized controlled trial in terms of predicting the effectiveness of the program if it were to be rolled out on a larger scale. All participating schools signed a contract whereby intervention schools undertook to conduct the Triad program in its entirety for three years, and control schools promised to continue with their usual preventive work but not to implement any specific program.

The pupils’ parents received information about the study’s aim, the voluntary nature of their compliance, and their right to withdraw from the study at any time. Parents who did not want their children to participate were asked to contact the research team. Participants were asked during school hours to fill in a questionnaire about family background, tobacco, alcohol, and self-rated health. The data collection was implemented by the research team.

Ethics

The research conformed to the Helsinki Declaration and ethical approval was obtained from the Regional Ethics Review Board in Uppsala (reg. no 2011/213).

Empirical strategy

This study is part of a larger study focusing on “School as a setting for alcohol and drug prevention” in a special venture financed by the Swedish government [50, 51]. The program was designed and implemented by the NGO, and the research team was responsible for the research and evaluation activities.

Measurements

Outcome variables

Alcohol consumption was measured with two questions. The first was “Have you ever drunk alcohol?” The response alternatives were: (1) “No, I have never drunk alcohol”; (2) “I have taken a sip from someone else’s glass”; (3) “I have drunk alcohol on one occasion”; and (4) “I have drunk alcohol on more than one occasion.” The alternatives were dichotomized into “No, I have not drunk alcohol” (1 and 2) and “Yes, I have drunk alcohol” (3 and 4). The second question was “Have you ever been intoxicated by alcohol?” and had the following response alternatives: (1) “No, I have never been intoxicated”; (2) “No, I have tasted it but I have never been intoxicated”; (3) “Yes, once”; (4) “Yes, 2–3 times”; (5) “Yes, 4 times or more”; (6) “Yes, every time I used alcohol.” We dichotomized this item such that response options 1 and 2 were defined as “No, I have never been intoxicated” and options 3–6 as “Yes, I have been intoxicated.”

Control variables

Socioeconomic status included the immigrant status of the pupil, mother, and father separately (“born in Sweden,” yes/no); family structure (“nuclear family,” yes/no); living situation (“living with one parent” “shared residence,”); type of residence “if living in rental apartment (or otherwise house, owned apartment)”; number of books at home trichotomized into “many books” (if >250 books in household), “medium books” (if 50–250 books), “few books” (if <50 books). Other control variables included gender (boy/girl) and school year (6, 7, 8, 9) (see Table 2).

Regression analysis

The intervention is conducted at the school level, and the adolescents could not influence whether they participated in the intervention or control group. Thus, we estimated a standard Intention-To-Treat (ITT) Difference-in-Difference (DD) logit model (given that the outcome variables are binary) as described in equation (1), where Y it represent the different outcome variables Alcohol Consumption and Intoxication for adolescent i in grade t:
$$ \Pr \left({Y}_{it}=1\right)=\alpha +{\beta}_0 Interventio{n}_i+{\beta}_1Pos{t}_t+{\beta}_2 Interventio{n}_{it}\times Pos{t}_t+\theta {\boldsymbol{X}}_{\boldsymbol{it}}+{\varepsilon}_{it}. $$
(1)

Intervention is a dummy variable indicating whether an adolescent attends an intervention school (equal to 1 if so, and 0 otherwise), and Post is a dummy variable for post-treatment data (i.e., equal to 1 for grade 7, 8 or 9, and equal to 0 for grade 6). The interaction term Intervention × Post is the causal effect of the program on the outcome variables given our assumed identification strategy, and thus β 2 is the coefficient of main interest. Finally, X it is a vector of individual-specific control variables and ε it is the error term. Considering that we had repeated measures at the individual level (panel/longitudinal data), we clustered the standard errors at the individual level. Failure to do so would bias our standard errors and thus the statistical significance.

The main standard identifying assumption for drawing causal conclusions in our model, as in the typical DD setup, is that intervention and control schools would follow the same trend in alcohol consumption and intoxication albeit from different starting points (the common-trend assumption). One source of concern is that we know that the adolescents in the intervention and control schools differ slightly on a number of observable characteristics (Table 3). For example, there is a higher proportion of adolescents in nuclear families in the intervention schools. If such adolescents have a significantly different trend in their alcohol consumption behavior over time, this may bias our results. Note however that such differences affecting levels of alcohol intake are not a problem, given that our identification relies on differences in the trend (not levels). Still, in order to examine the possible influence of such confounders on differential trends in alcohol consumption, we introduced a number of control variables (X it ) in the regressions. As a robustness check we also used propensity score matching techniques to create a balance between treatment and control schools in observable characteristics and ran the analysis on the balanced sample. We also conducted multilevel regressions, directly taking the hierarchical nature of the data into account, which yielded the same qualitative interpretations and results. 1
Table 3

Descriptive statistics: mean of control variables

  

Intervention schools

Control schools

(n = 172)

(n = 101)

Boy

=1 if pupil is a boy

0.47

0.50

Rental

=1 if pupils lives in rental apartment, and 0 if in owned house or apartment

0.17***

0.29

Swedish

=1 if pupil was born in Sweden with at least 1 Swedish parent

0.96**

0.92

Nuclear

=1 if pupil lives with both biological parents

0.76

0.73

Shared

=1 if lives every other week with mother/father

0.13**

0.07

Single parent

=1 if only lives with one parent

0.11**

0.16

Books many

=1 if >250 books in household

0.20**

0.14

Books medium

=1 if 50–250 books in household

0.53***

0.43

Books few

=1 if <50 books in household

0.27***

0.43

Note: **p = 0.01; ***p <0.001, statistically significant difference compared to control schools (two-sided t-test)

Results

We begin by graphically depicting the trends in Alcohol Consumption and Intoxication in the intervention and control schools from grade 6 (baseline) to grades 7, 8, and 9. Figure 1 shows a similar increase in Alcohol Consumption for the intervention schools as for the control schools. For Intoxication the picture is less clear, with a less steep increase in the intervention schools from grades 6 to 7, but a steeper increase for grade 8 and grade 9. The proportion of students using alcohol increases as expected from a starting point in grade 6 at 0.05–0.12 to 0.50–0.66 in grade 9, whereas the numbers for intoxication are 0.01–0.04 in Grade 6 to 0.38–0.40 in grade 9.
Fig. 1

The trend in proportion of students using alcohol and drinking to intoxication

The results for both Alcohol Consumption and Intoxication show no statistically significant effect of the program (with or without controls). We therefore cannot reject the null hypothesis that the intervention has no effect on the likelihood of adolescents using alcohol or drinking themselves to intoxication at least once.

Table 4 also reveals that the variable Post is positive and statistically significant in all models, which simply represents the fact that alcohol consumption and intoxication increase in higher grades in both the intervention and control schools. We report marginal effects, with coefficient estimates implying that alcohol consumption is 22–23 (intoxication 13–15) percentage points more likely in grades 7–9 than in the baseline year (grade 6). The variable Intervention is negative and is significant for alcohol consumption, which should be interpreted as meaning that pupils in the intervention schools are 20–22 percentage points less likely to use alcohol (a “level” effect), but that this effect was already present at baseline (before the intervention), a result also observable in Fig. 1. As for the individual-level control variables, very few are statistically significant predictors of alcohol consumption or intoxication.
Table 4

Main results of the effect of The Triad on alcohol consumption and intoxication: results shown as marginal effects (standard errors)

 

Alcohol consumption

Intoxication

Model (1)

Model (2)

Model (3)

Model (4)

Intervention

−0.20**

−0.22**

−0.15

−0.24

(0.094)

(0.096)

(0.114)

(0.148)

Post

0.23***

0.22***

0.15***

0.13***

(0.033)

(0.033)

(0.030)

(0.030)

Intervention × Post

0.10

0.12

0.10

0.16

(0.084)

(0.086)

(0.089)

(0.107)

Boy

 

0.01

 

−0.00

 

(0.034)

 

(0.020)

Rental

 

−0.04

 

−0.03

 

(0.045)

 

(0.026)

Swedish

 

−0.05

 

0.02

 

(0.067)

 

(0.037)

Nuclear

 

−0.03

 

0.01

 

(0.055)

 

(0.034)

Shared

 

0.03

 

0.03

 

(0.076)

 

(0.054)

Books many

 

−0.04

 

−0.01

 

(0.044)

 

(0.028)

Books medium

 

−0.07*

 

−0.02

 

(0.037)

 

(0.023)

Observations

1062

1040

1062

1039

Note: *p = 0.05; **p = 0.01; ***p <0.001, statistically significant difference compared to control schools (two-sided t-test)

Table 4 used information from all years. To examine the robustness of the results, we also conducted analyses in which we compared the baseline alcohol consumption and intoxication results to those in each of the other grades. These data appear in Additional file 1: Table S5 (grade 7 comparison), Additional file 1: Table S6 (grade 8 comparison) and Additional file 1: Table S7 (grade 9 comparison) (included as Additional file).

The results from Table 4 persist in these analyses as well. Hence we cannot reject the null hypothesis of no effect in any of the estimations in Additional file 1: Tables S5-S7.

Discussion

The aim of the study was to conduct a quasi-experimental evaluation of the alcohol use part of the Triad intervention. Our main results showed no effect on the likelihood of alcohol consumption or intoxication. These results are in line with previous literature showing that many school-based interventions do not have the intended effect [21].

We know that a successful program should be based on and tested in well-designed research programs [36]. It should include interactive strategies [24, 25, 37, 38], target more than one risk factor [34, 39], strengthen social, emotional, behavioral, cognitive, and moral competencies; and provide structure and consistency in program delivery [4042]. The premise for the Triad program is not informed by research, e.g., into the ways that developmental factors and social influences contribute to adolescent substance use [34, 39]. Although the program does not rely solely on information transmission, the materials do include awareness-raising materials about the hazards of drinking, which can be seen as “fear arousal,” a component found not to be successful in interventions [34, 35]. The program does include some components that are corroborated by research, such as interactive learning strategies [24, 25, 37, 38], but is partly based on resistance training, which is not supported in the literature [36]. Encouragement is fueled by rewards through competitions and prizes, which have received some support for effectiveness in improving health behaviors [46]. Further, the Triad intervention followed the pupils for an extended period of time and focused on strengthening social and moral competencies and improving social relations with adults, which is supported by research [40, 41].

There are many possible reasons that we failed to detect positive effects of the program, besides weaknesses or ineffectiveness of program components. One is that the participants in our dataset only received the “Fighting Drugs” intervention theme in grade 6; they did not receive the interventions associated with other behavioral themes in grades 4 and 5. It may be that receiving all themes is more effective, as the complete program targets several risk behaviors [34, 39]. However, our participants did receive the intervention that was directly related to alcohol and substance use, which limits the concern that they were not exposed to the full program.

A second possible reason for the observed lack of benefit of the program is that it was poorly implemented. Although no data were available on program fidelity in the schools, the fact that implementation was conducted by an NGO, rather than left to the various school personnel, probably improved fidelity.

The fact that participating schools were not self-selected, but chosen by the municipality, may have reduced the involvement of the teachers in program implementation and effectiveness. But for evaluation and policy purposes, this is less interesting, because if the program were to be scaled up based on a decision by policy makers, and moved outside a more controlled experiment, such a real-world policy context would be more closely mimicked by our evaluation design; i.e., the emphasis is on “effectiveness rather than efficacy.”

Another potential reason for the absence of a beneficial effect, similar to discussions by A-M Lindahl and M Rosaria Galanti [49], is that control schools are likely to work with other prevention strategies that are similar to Triad. However, if schools in general are already applying some relevant prevention strategies, this reduces the need for more formal programs like Triad.

Further, it could be that norms and peer-pressure may offer stronger incentives than does the program itself [52]. The program did not have a specific component addressing the development of socio-emotional skills including role-play activities, which have been a core component in many of the programs that have proven effective when implemented as intended. In addition, the primary prevention approach that Triad offers may be less likely to impact the adolescent behavior in question. In fact, studies have shown that secondary prevention programs for at-risk or high-risk youth for whichever behavior the adolescent is at risk for, may well be more successful [53, 54].

A limitation in our empirical analysis is that, as is typical in quasi-experiments, the identification of a causal effect of the program is based on a common-trend assumption, i.e., that the intervention and control schools would have had the same trend in alcohol consumption without the intervention. The common-trend assumption is impossible to test, because we cannot observe the trend in the intervention schools without the intervention. The adolescents in the intervention and control schools differed slightly on a number of observable characteristics, and if these affected the trend in their alcohol consumption behavior over time, it could have biased our results. However, we took a number of steps to try to address the potential problems that arise in the quasi-experimental context. First, we introduced a number of control variables in the regressions (which is not necessary if there is random assignment), which can increase the efficiency of the analysis. Also, we conducted a number of robustness checks with other empirical approaches, including propensity score matching as well as multilevel regressions. Our results are very robust with regard to the different empirical strategies. Another limitation was that we only analyzed alcohol use since the numbers of pupils smoking or using other drugs are very rare in these ages.

Conclusions

We found a non-significant impact on alcohol consumption and intoxication of the “Fighting Drugs” component of the Triad intervention for early adolescents. If these results are further strengthened by similar results from evaluations of the two other themes of the program, the program should be re-developed or removed from schools’ health promotion strategies. The lack of positive effects thus indicates that the program makes poor use of resources and time. It also raises concerns regarding other prevention programs that rely to a large extent on similar components, and it calls for more systematic and formal evaluations of health interventions taking place in the school setting.

Footnotes
1

We have performed these analyses and they give the same conclusions. Results will be supplied on request.

 

Abbreviation

NGO: 

Non-government organizations

Declarations

Acknowledgements

The authors are very grateful to the project leaders of the prevention programs on which this study’s sample is based. We would also like to thank the adolescents who willingly participated in this study. The study was supported by a research grant from the Swedish Public Health Agency. We also want to thank the research team at Örebro University, including Josefine Börjeson, Johanna Hulldin and Ingela Fredriksson, for their contributed to the data collection in the longitudinal study that started 2011.

Funding

The study was supported by a research grant from the Swedish Public Health Agency. The funding body was not involved in the design of the study, the data collection, analysis, or interpretation of data or in writing the manuscript.

Availability of data and materials

The datasets during and/or analysed during the current study available via the corresponding author on reasonable request and with permission from the project investigator, and co-author, Charli Erikson.

Authors’ contributions

CE and SG secured funding for the project, collected the data and conceptualized the research topics. LB contributed to the conceptualization of research topics and drafted the initial manuscript. LB and MS contributed to the design and methods section of the study. MS conducted the statistical analyses. All authors (LB, MS, SG, and CE) were involved in data interpretation and critical revisions of the paper, and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The research conformed to the Helsinki Declaration and ethical approval was obtained from the Regional Ethic Review Board in Uppsala (reg. no 2011/213). Written information was sent home to the care givers of the pupils. A passive consent procedure (approved by the Regional Ethic Review Board in Uppsala (reg. no 2011/213)) was used, meaning that the care givers of the participating pupils were given the opportunity to send in a written denial. A verbal consent to participate was obtained from the participating pupils.

Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Authors’ Affiliations

(1)
Faculty of Medicine and Health, School of Health Sciences, Örebro University
(2)
Department of Public Health, Karlstad University
(3)
Health Metrics, The Sahlgrenska Academy, University of Gothenburg

References

  1. Asma S, Yang G, Samte J, Giovino G, Bettcher DW, Lopez AD, Yach D. Tobacco. In: Detels R, McEwen J, Beaglehole R, Tanaka H, editors. Oxford Textbook of Public Health. Oxford: Oxford University Press; 2004. p. 1481–502.Google Scholar
  2. Room R. Alcohol. In: Detels R, McEwen J, Beaglehole R, Tanaka H, editors. Oxford Textbook of Public Health. Oxford: Oxford University Press; 2004. p. 1521–31.Google Scholar
  3. Des Jarlais DC, Hubbard RL. Alcohol and drug use. In: Detels R, McEwen J, Beaglehole R, Tanaka H, editors. Oxford Textbook of Public Health. Oxford: Oxford University Press; 2004. p. 1503–19.Google Scholar
  4. Miller JW, Naimi TS, Brewer RD, Jones SE. Binge drinking and associated health risk behaviors among high school students. Pediatrics. 2007;119(1):76–85.View ArticlePubMedGoogle Scholar
  5. Rehm J, Mathers C, Popova S, Thavorncharoensap M, Teerawattananon Y, Patra J. Global burden of disease and injury and economic cost attributable to alcohol use and alcohol-use disorders. Lancet. 2009;373(9682):2223–33.View ArticlePubMedGoogle Scholar
  6. Organization WH. Global status report on alcohol and health, 2014. 2014.Google Scholar
  7. Hingson RW, Heeren T, Winter MR. Age of alcohol-dependence onset: associations with severity of dependence and seeking treatment. Pediatrics. 2006;118(3):e755–63.View ArticlePubMedGoogle Scholar
  8. Buchmann AF, Schmid B, Blomeyer D, Becker K, Treutlein J, Zimmermann US, Jennen-Steinmetz C, Schmidt MH, Esser G, Banaschewski T. Impact of age at first drink on vulnerability to alcohol-related problems: testing the marker hypothesis in a prospective study of young adults. J Psychiatr Res. 2009;43(15):1205–12.View ArticlePubMedGoogle Scholar
  9. Ohannessian C, Finan L, Schulz J, Hesselbrock V. A long-term longitudinal examination of the effect of early onset of alcohol and drug use on later alcohol abuse. Substance abuse. 2015(just-accepted):00–00.Google Scholar
  10. Ystrom E, Kendler KS, Reichborn‐Kjennerud T. Early age of alcohol initiation is not the cause of alcohol use disorders in adulthood, but is a major indicator of genetic risk. A population‐based twin study. Addiction. 2014;109(11):1824–32.View ArticlePubMedPubMed CentralGoogle Scholar
  11. Masten A, Faden V, Zucker R, Spear L. A developmental perspective on underage alcohol use. 2009.Google Scholar
  12. Windle M, Spear LP, Fuligni AJ, Angold A, Brown JD, Pine D, Smith GT, Giedd J, Dahl RE. Transitions into underage and problem drinking: Summary of developmental processes and mechanisms: ages 10–15. Alcohol Res Health. 2009;32(1):30.PubMedPubMed CentralGoogle Scholar
  13. Stanis JJ, Andersen SL. Reducing substance use during adolescence: a translational framework for prevention. Psychopharmacology (Berl). 2014;231(8):1437–53.View ArticleGoogle Scholar
  14. Castellanos‐Ryan N, O’Leary‐Barrett M, Sully L, Conrod P. Sensitivity and specificity of a brief personality screening instrument in predicting future substance use, emotional, and behavioral problems: 18‐month predictive validity of the substance use risk profile scale. Alcohol Clin Exp Res. 2013;37(s1):E281–90.View ArticlePubMedGoogle Scholar
  15. Silveri MM. Adolescent brain development and underage drinking in the United States: identifying risks of alcohol use in college populations. Harv Rev Psychiatry. 2012;20(4):189–200.View ArticlePubMedPubMed CentralGoogle Scholar
  16. Green LW, Poland BD, Rootman I. The Settings Approach to Health Promotion. In: Poland B, Green L, Rootman I, editors. Settings for Health Promotion Linking Theory and Practice. Los Angeles: Sage Publications; 2000.Google Scholar
  17. Dooris M, Wills J, Newton J. Theorizing healthy settings: a critical discussion with reference to Healthy Universities. Scand J Public Health. 2014;42(15 suppl):7–16.View ArticlePubMedGoogle Scholar
  18. WHO. Milestones in health promotion: Statements from global conferences. Geneva: World Health Organization; 2009.Google Scholar
  19. EMDC EMCfDaDA. Guidelines for the evaluation of drug prevention. A manual for programme planners and evaluators. Luxembourg: The Publications Office of the European Union, EMCDDA; 2012.Google Scholar
  20. Sidani S. Health Intervention Research: Understanding Research Design and Methods. Thousand Oaks: SAGE; 2015.Google Scholar
  21. Foxcroft DR, Tsertsvadze A. Cochrane Review: Universal school‐based prevention programs for alcohol misuse in young people. Evid Based Child Health. 2012;7(2):450–575.View ArticleGoogle Scholar
  22. Agabio R, Trincas G, Floris F, Mura G, Sancassiani F, Angermeyer MC. A systematic review of school-based alcohol and other drug prevention programs. Clin Prac Epidemiology in Mental Health. 2015;11(1):102–12.View ArticleGoogle Scholar
  23. Emmers E, Bekkering GE, Hannes K. Prevention of alcohol and drug misuse in adolescents: An overview of systematic reviews. Nordic Stud Alcohol Drugs. 2015;32(2):183–98.View ArticleGoogle Scholar
  24. Botvin GJ, Griffin KW. School-based programmes to prevent alcohol, tobacco and other drug use. Int Rev Psychiatry. 2007;19(6):607–15.View ArticlePubMedGoogle Scholar
  25. Sundell K, Forster M. En grund för att växa i Gränslös utmaning - alkoholpolitik i ny tid (A foundation to grow in Unlimited challange - alcoholic politics in a new era). In: Statens offentliga utredningar (SOU). Edited by The Government. Stockholm; 2005.Google Scholar
  26. Andersson B, Anderberg M. Undervisning om alkohol, narkotika, dopning och tobak (ANDT): en praktiknära litteraturgenomgång (Eductaion in alcohol, narcotic, anabola and tobacco). Stockholm; 2013.Google Scholar
  27. Sundell K, Ferrer-Wreder L, Fraser MW. Going Global A Model for Evaluating Empirically Supported Family-Based Interventions in New Contexts. Eval Health Prof. 2014;37(2):203–30.View ArticlePubMedGoogle Scholar
  28. Hasson H, Sundell K, Beelmann A, von Thiele Schwarz U. Novel programs, international adoptions, or contextual adaptations? Meta-analytical results from German and Swedish intervention research. BMC Health Serv Res. 2014;14(2):1.Google Scholar
  29. Danielsson AK, Wennberg P, Hibell B, Romelsjö A. Alcohol use, heavy episodic drinking and subsequent problems among adolescents in 23 European countries: does the prevention paradox apply? Addiction. 2012;107(1):71–80.View ArticlePubMedGoogle Scholar
  30. Holder H. Alcohol Monopoly and Public Health: Potential effects of privatization of the Swedish alcohol retail monopoly, vol. 27. Stockholm: Swedish National Institute of Public Health; 2008.Google Scholar
  31. Norström T, Svensson J. The declining trend in Swedish youth drinking: collectivity or polarization? Addiction. 2014;109(9):1437–46.View ArticlePubMedGoogle Scholar
  32. Hallgren M. Youth alcohol polarization effects in regional but not national data. Addiction. 2014;109(8):1384–5.View ArticlePubMedGoogle Scholar
  33. Englund A. Skolelevers drogvanor (School students' alcohol habits). In: Edited by Englund A. Stockholm: CAN - The Swedish Council for Information on Alcohol and Other Drugs; 2014.Google Scholar
  34. Griffin KW, Botvin GJ. Evidence-based interventions for preventing substance use disorders in adolescents. Child Adolesc Psychiatr Clin N Am. 2010;19(3):505–26.View ArticlePubMedPubMed CentralGoogle Scholar
  35. Faggiano F, Vigna-Taglianti FD, Versino E, Zambon A, Borraccino A, Lemma P. School-based prevention for illicit drugs use: A systematic review. Prev Med. 2008;46(5):385–96.View ArticlePubMedGoogle Scholar
  36. Cuijpers P. Effective ingredients of school-based drug prevention programs. A systematic review. Addict Behav. 2002;27:1009–23.View ArticlePubMedGoogle Scholar
  37. Tobler NS, Roona MR, Ochshorn P, Marshall DG, Streke AV, Stackpole KM. School-based adolescent drug prevention programs: 1998 meta-analysis. J Prim Prev. 2000;20(4):275–336.View ArticleGoogle Scholar
  38. Thomas RE, McLellan J, Perera R. School‐based programmes for preventing smoking. Evid Based Child Health. 2013;8(5):1616–2040.View ArticleGoogle Scholar
  39. Hale DR, Fitzgerald-Yau N, Viner RM. A systematic review of effective interventions for reducing multiple health risk behaviors in adolescence. Am J Public Health. 2014;104(5):e19–41.View ArticlePubMedPubMed CentralGoogle Scholar
  40. Catalano RF, Berglund ML, Ryan JA, Lonczak HS, Hawkins JD. Positive youth development in the United States: Research findings on evaluations of positive youth development programs. Ann Am Acad Pol Soc Sci. 2004;591(1):98–124.View ArticleGoogle Scholar
  41. Durlak JA, Weissberg RP, Dymnicki AB, Taylor RD, Schellinger KB. The impact of enhancing students’ social and emotional learning: A meta‐analysis of school‐based universal interventions. Child Dev. 2011;82(1):405–32.View ArticlePubMedGoogle Scholar
  42. Cairns G, Purves R, McKell J. Combining school and family alcohol education: a systematic review of the evidence. Health Educ. 2014;114(6):451–72.View ArticleGoogle Scholar
  43. Isensee B, Hanewinkel R. Meta-analysis on the effects of the smoke-free class competition on smoking prevention in adolescents. Eur Addict Res. 2012;18(3):110–5.View ArticlePubMedGoogle Scholar
  44. Skinner B. The evolution of verbal behavior. J Exp Anal Behav. 1986;45(1):115–22.View ArticlePubMedPubMed CentralGoogle Scholar
  45. Bandura A. Social foundations of thought and action. Englewood Cliffs: Prentice-Hall; 1986.Google Scholar
  46. Kavanagh J, Oakley A, Harden A, Trouton A, Powell C. Are incentive schemes effective in changing young people’s behaviour? A systematic review. Health Educ J. 2011;70(2):192–205.View ArticleGoogle Scholar
  47. Faggiano F, Vigna-Taglianti F, Burkhart G, Bohrn K, Cuomo L, Gregori D, Panella M, Scatigna M, Siliquini R, Varona L. The effectiveness of a school-based substance abuse prevention program: 18-month follow-up of the EU-Dap cluster randomized controlled trial. Drug Alcohol Depend. 2010;108(1):56–64.View ArticlePubMedGoogle Scholar
  48. Sundell K, Forster M. En grund för att växa. Forskning om att förebygga beteendeproblem hos barn. (A foundation to grow. Reserach of preventing conduct behaviour problem in children). Stockholm: Forsknings- och utvecklingsenheten, Socialtjänstförvaltningen; 2005.Google Scholar
  49. Lindahl AM, Rosaria Galanti M. Unplugged! Utvärdering av ett europeiskt ANT-program i Sverige. EU-DAP-projektet (Evaluation of an European drug prevention program in Sweden. The EU-DAP project). In: Edited by Pblic Health. Cf. Stockholm: The County Concil of Stockholm; 2006.Google Scholar
  50. Eriksson C, Geidne S, Larsson M, Pettersson C. A research strategy case study of alcohol and drug prevention by non-governmental organizations in Sweden 2003–2009. Subst Abuse Treat Prev Policy. 2011;6(8):1–21.Google Scholar
  51. Eriksson C, Fredriksson I, Fröding K, Geidne S, Pettersson C. Academic practice–policy partnerships for health promotion research: Experiences from three research programs. Scand J Public Health. 2014;42(15 suppl):88–95.View ArticlePubMedGoogle Scholar
  52. Brooks-Russell A, Simons-Morton B, Haynie D, Farhat T, Wang J. Longitudinal relationship between drinking with peers, descriptive norms, and adolescent alcohol use. Prev Sci. 2014;15(4):497–505.View ArticlePubMedPubMed CentralGoogle Scholar
  53. Gottfredson DC, Wilson DB. Characteristics of effective school-based substance abuse prevention. Prev Sci. 2003;4(1):27–38.View ArticlePubMedGoogle Scholar
  54. Monti PM, Colby SM, Barnett NP, Spirito A, Rohsenow DJ, Myers M, Woolard R, Lewander W. Brief intervention for harm reduction with alcohol-positive older adolescents in a hospital emergency department. J Consult Clin Psychol. 1999;67(6):989.View ArticlePubMedGoogle Scholar

Copyright

© The Author(s). 2017