The Saving and Empowering Young Lives in Europe (SEYLE) Randomized Controlled Trial (RCT): methodological issues and participant characteristics
- Vladimir Carli1, 2Email author,
- Camilla Wasserman3, 4,
- Danuta Wasserman1, 2,
- Marco Sarchiapone4,
- Alan Apter5,
- Judit Balazs6, 7,
- Julio Bobes8,
- Romuald Brunner9, 10,
- Paul Corcoran11,
- Doina Cosman12,
- Francis Guillemin13,
- Christian Haring14,
- Michael Kaess9, 10,
- Jean Pierre Kahn15,
- Helen Keeley11,
- Agnes Keresztény7, 16,
- Miriam Iosue4,
- Ursa Mars17,
- George Musa3,
- Bogdan Nemes12,
- Vita Postuvan17,
- Stella Reiter-Theil18, 19,
- Pilar Saiz8,
- Peeter Varnik20,
- Airi Varnik21 and
- Christina W Hoven3, 21
© Carli et al.; licensee BioMed Central Ltd. 2013
Received: 11 July 2012
Accepted: 11 May 2013
Published: 16 May 2013
Mental health problems and risk behaviours among young people are of great public health concern. Consequently, within the VII Framework Programme, the European Commission funded the Saving and Empowering Young Lives in Europe (SEYLE) project. This Randomized Controlled Trial (RCT) was conducted in eleven European countries, with Sweden as the coordinating centre, and was designed to identify an effective way to promote mental health and reduce suicidality and risk taking behaviours among adolescents.
To describe the methodological and field procedures in the SEYLE RCT among adolescents, as well as to present the main characteristics of the recruited sample.
Analyses were conducted to determine: 1) representativeness of study sites compared to respective national data; 2) response rate of schools and pupils, drop-out rates from baseline to 3 and 12 month follow-up, 3) comparability of samples among the four Intervention Arms; 4) properties of the standard scales employed: Beck Depression Inventory, Second Edition (BDI-II), Zung Self-Rating Anxiety Scale (Z-SAS), Strengths and Difficulties Questionnaire (SDQ), World Health Organization Well-Being Scale (WHO-5).
Participants at baseline comprised 12,395 adolescents (M/F: 5,529/6,799; mean age=14.9±0.9) from Austria, Estonia, France, Germany, Hungary, Ireland, Israel, Italy, Romania, Slovenia and Spain. At the 3 and 12 months follow up, participation rates were 87.3% and 79.4%, respectively. Demographic characteristics of participating sites were found to be reasonably representative of their respective national population. Overall response rate of schools was 67.8%. All scales utilised in the study had good to very good internal reliability, as measured by Cronbach’s alpha (BDI-II: 0.864; Z-SAS: 0.805; SDQ: 0.740; WHO-5: 0.799).
SEYLE achieved its objective of recruiting a large representative sample of adolescents within participating European countries. Analysis of SEYLE data will shed light on the effectiveness of important interventions aimed at improving adolescent mental health and well-being, reducing risk-taking and self-destructive behaviour and preventing suicidality.
KeywordsSEYLE Mental Health Promotion Suicide prevention Promotion Well-being Adolescents Schools RCT Intervention ProfScreen QPR Awareness
In the transition from childhood to adulthood adolescents make lifestyle choices and initiate patterns of behaviour that affect both their current and future well-being and health [1–6]. Many adverse health behaviours emerge in adolescence and track into adulthood, with increasing consequences for negative and sometimes long-lasting outcomes. Given the importance of this transitional period, it is essential to systematically assess the mental health and well-being of adolescents and young adults, and to implement and evaluate interventions for at-risk individuals. Several large studies have been carried out, mostly in the US, to gather information on both healthy and risk behaviours as well as psychiatric symptoms, based on robust methodologies [7–11]. Other studies analysed the effects of interventions to promote mental health and prevent suicide among adolescents [12–14].
However, to the best of our knowledge, no previous study compared the effectiveness of interventions based on different approaches with a Randomized Controlled Trial (RCT). The Saving and Empowering Young Lives in Europe (SEYLE) project was designed with this in mind.
SEYLE, supported by the European Union Seventh Framework Program (FP7), (Grant agreement number HEALTH-F2-2009-22309), is an RCT to evaluate school-based preventive interventions of risk-taking and self-destructive behaviours in eleven European countries, including: Austria, Estonia, France, Germany, Hungary, Ireland, Israel,a Italy, Romania, Slovenia and Spain, with the National Centre for Suicide Research and Prevention of Mental Ill-Health (NASP) at Karolinska Institutet (KI) in Sweden responsible for the scientific coordination of the project. The Child Psychiatric Epidemiology Group at Columbia University and New York State Psychiatric Institute served as methodological experts. SEYLE is registered in both the US National Institute of Health (NIH) clinical trial registry (NCT00906620) and the German Clinical Trials Register (DRKS00000214). The full protocol of the study has been previously published . The key objectives of the study were: (i) to collect assessment data on a cohort of European adolescents, including demographic information, psychopathology, lifestyles, values and risk-behaviours, in order to produce an epidemiological database on the general health status of European adolescents; (ii) to evaluate three types of school-based interventions in comparison to a minimal intervention control group. The three active interventions included (1) teacher training, (2) increasing adolescents’ awareness about mental health, and (3) professional screening of adolescents for mental health problems and risk behaviours. Teachers were trained through the gatekeeper program: Question, Persuade and Refer, developed in the US by the QPR Institute . Pupils were trained through a standardized awareness-increasing program [15, 17] designed to promote knowledge of mental health, healthy lifestyles and behaviours among adolescents. A professional screening program performed by psychiatrists and psychologists was specifically designed for the SEYLE study. All pupils were screened with a questionnaire and, if responses exceeded a predetermined cut-off score for depression, anxiety, phobia, alcoholism, substance abuse, non-suicidal self-injury (NSSI) or suicidality, pupils were interviewed and then referred for professional treatment if necessary. More details about the SEYLE interventions have been previously published .
The objectives of this article are to describe: 1) the study sites; 2) the main methodological issues employed; 3) the characteristics of the recruited sample including its representativeness; and 4) the internal reliability of the psychometric scales utilized for evaluation of the outcomes of the RCT: the Zung Self-Rating Anxiety Scale (Z-SAS, ), the Beck Depression Inventory, Second Edition (BDI-II, ), the World Health Organization Well-Being Scale (WHO-5 , and the Strengths and Difficulties Questionnaire (SDQ, .
Demographics of SEYLE study sites, according to Eurostat 1-2
Income (net,EURO per year) 4
Cork and Kerry
Ireland South West
Cluj and Maramures counties
Osrednjeslovenska, Podravska and Obalno-kraška region
Podravska, Osrednjeslovenska and Obalno-kraska
Oviedo, Gijon and Aviles
Principado de Asturias
School and participant selection
At each site, eligible schools were randomly selected to participate in SEYLE. A list containing all available schools was generated at each site, and the schools were categorized as large or small and randomized into one of the four study arms for possible inclusion according to a randomized order. Simple randomization was used as a method of randomization of schools through a random number generator. Schools were categorized as small if they had less than or equal to the median number of students in all schools in the study area/region; and large if they had greater than the median number of students in all schools in the study area/region. Schools were considered eligible if they were public, contained at least forty 15-year-old pupils, had more than two teachers for pupils 15 years of age and no more than 60% of the pupils were of the same gender. These inclusion criteria were selected to allow for the recruitment of a comparable sample of schools and pupils across study sites, in spite of differences in sociocultural factors and in the organization of the educational system. However, a few exceptions were made in the case of sociocultural particularities of a specific country’s education system and applying the exact same criteria would increase selection bias instead of reducing it across sites. In particular in Ireland, single gender schools were allowed to participate in pairs with a single gender school of the opposite sex and of similar size. In Germany, due to the unique design of the school system, a sample of schools in the three categories of German high schools were selected and randomized separately. National and/or regional school authorities were contacted and informed about the project in general terms in order to get approval, which was obtained in all participating countries. The representatives of SEYLE at each study site then met with the school principals in the respective areas to describe the intervention of the Arm to which their school had been randomized and to explain the general objectives and procedures of that Arm. Each school was selected to participate in one Arm only and no information was disclosed about the interventions to be performed in other Arms of the RCT. On the basis of general information about SEYLE objectives and specific information about the specific intervention Arm into which the school was randomized, the school could accept or refuse to join. When a school refused to participate, the next school randomized in the same category was approached to replace it. It is important to note that schools were replaced only with other schools that were already in the randomization list. This procedure was designed to generate a balanced number of large and small schools in each intervention Arm, to minimize bias and increase the validity of the results. Within each school, all classes with a majority of 15 year olds were approached for participant recruitment, with a minimum of two schools per Arm. This procedure was repeated until a minimum of 250 students were recruited in a each Arm. Prior to requesting consent from the parents and assent from the pupils, general information about the SEYLE study and details about the specific Arm they were invited to participate in, was provided. Not all pupils for whom parental consent and adolescent assent were obtained actually participated, as some students were absent from school on the day the questionnaire was administered. Consent rates were calculated as the percentage of approached pupils for whom parental consent and pupil’s assent were both given. Participation rates were calculated as the percentage of assented pupils with parental consent who actually took part in the baseline questionnaire. In order to evaluate the impact of the consent rates of schools and pupils on the external validity of the collected data; school size, in terms of number of attending pupils, was compared between participating and non-participating schools. Moreover, gender proportion of pupils with and without consent were compared. Drop-out rates were calculated as the number of pupils assessed at baseline who did not participate at the first (3-months) and/or second (12-months) follow-up. Sociodemographic variables obtained at baseline and average scores on the scales employed, were used to evaluate differences between Arms.
Instruments and interventions
A full description of assessment instruments and interventions was previously published .
Standardization of methodology
SEYLE study key personnel
Coordinator and Project Leader
National Centre for Suicide Research and Prevention of Mental Ill-Health (NASP) at Karolinska Institutet (KI), Stockholm, Sweden
Department of Health Sciences, University of Molise, Campobasso, Italy
Project Manager and Assistant Project Leader
National Centre for Suicide Research and Prevention of Mental Ill-Health (NASP) at Karolinska Institutet (KI), Stockholm, Sweden
Consultants for Methodology
Department of Child and Adolescent Psychiatry, Columbia University-New York State Psychiatric Institute, New York, US
Intervention arm coordinators
National Centre for Suicide Research and Prevention of Mental Ill-Health (NASP) at Karolinska Institutet (KI), Stockholm, Sweden
Romuald Brunner / Michael Kaess
Clinic of Child and Adolescent Psychiatry, Centre of Psychosocial Medicine, University of Heidelberg, Heidelberg, Germany
Department of Child and Adolescent Psychiatry, Columbia University-New York State Psychiatric Institute, New York, US
Minimal Intervention/ Control
Department of Health Sciences, University of Molise, Campobasso, Italy
P.Varnik (Data management)
R. Brunner (Intervention Coordinator)
J. Balazs (Translation procedures)
L-A. Burke (Analysis of cost-effectiveness)
D. Feldman (Quality control)
M. Iosue (Dissemination)
D. Cozman (Materials for Schools)
P. Saiz (Cultural adaptation)
D. Wasserman (Project coordination and data analysis)
National Center for Suicide Research and Prevention of Mental Ill-Health (NASP) at Karolinska Institutet (KI)
External Ethical Advisor
University Hospital Basel, Psychiatric Clinics of the University of Basel, IBMB, University of Basel, Switzerland
Cross-site collaboration was an important study objective and was facilitated prior to data collection, throughout implementation and up until study completion. For example, most sites assumed primary responsibility for one major study requirement, called a Work Package (e.g., translations, cultural adaptation, quality control, ethical requirements, data management, etc.) and collaborated with each of the other sites concerning this specific topic. Some of the major collaborative efforts are described below.
Quality control procedures
As part of the SEYLE project, a method for quality control was developed and implemented. A series of questionnaires were sent to intervention coordinators in each country in order to ensure that all preparatory procedures were correctly conducted and that the interventions implemented at each site were faithful to the initial intervention models of SEYLE.
Analysis of these data allowed for assessment of the degree of discrepancy between different sites and between implementation in each site compared with the SEYLE model, as well as the effect variations had on the projects overall results and conclusions. Three quality control assessment tools were used - I. A questionnaire administered during site visits to assess the preparedness for intervention implementation; II. A pre-intervention questionnaire focused on questionnaire coding and on specific requirements to be carried out prior to and immediately after the intervention, and; III. A post-intervention questionnaire focused on the implementation of each intervention. Analyses of these questionnaires showed very small differences between the sites in the implementation process and did not identify any major modification in the implementation of the interventions in any site.
Translation and cultural adaptation
The Hungarian site coordinated the translation processes in collaboration with the site-specific translation coordinators and the coordinating centre in Sweden (NASP). Translation coordinators oversaw site-specific translations, back translations and pilot interviews of all SEYLE materials. All materials were forward and back translated in each participating language. German was used in both Germany and Austria but was translated by the German site. All SEYLE materials (instruments & intervention Arm packages) were developed originally in English and then translated into the following languages: Gaelic (Irish), German, Estonian, French, Hebrew, Hungarian, Italian, Romanian, Slovenian and Spanish. In order to confirm the quality of the translations, staff from each site reviewed all back translations, evaluated reports on the respective pilot interviews and provided feedback to the Hungarian site. The site translation coordinators also implemented cultural adaptation: primarily concerning local linguistic phenomena and expressions. Focus groups were then conducted at each site to provide feedback on the cultural adaptation resulting from the pilot testing. In the case of ambiguity, consultation with a cultural linguistic advisor was sought. Based on these procedures, culturally adjusted language replaced the original in the final versions. A report concerning language issues, including possible ambiguity was sent to the coordinating centre for resolution, when necessary.
The scales used in the SEYLE questionnaires were included in the officially translated and validated version, when available, in the respective language, e.g., the SDQ , the WHO-5 etc. . If the scale was not available in the required language it was translated (and back-translated) for SEYLE, using the same procedure as for the other study materials. Internal reliability for all scales used in SEYLE was assessed through Cronbach’s alpha .
Data entry and data quality control
Data were collected on paper questionnaires, with the exception of the Austrian site, where data were collected electronically for direct data entry. In Germany, data collection forms were scanned for automatic data entry while in the other nine countries manual independent double data entry procedures were followed. In those countries information was entered twice using the Statistical Software Package SPSS 17.0. The Estonian site, which was responsible for the data management procedures, provided continuous oversight to other centers and promptly responded to any queries arising during the data entry process. A two-stage data cleaning and quality control procedure was performed to guarantee clean and reliable data. The first stage of quality control was performed locally, based on the two data files generated through double data entry. These files were compared and inconsistencies were resolved by checking the paper material. Based on this corrective action an accurate data file was generated. The second stage of quality control was performed centrally at the Estonian site, by double-checking each local dataset, attempting to detect other errors, such as incompleteness (missing values), inconsistencies (incorrectly followed skip-outs), irregularities (numbers inserted in text variables), and out of range data (i.e. very large number of siblings or sexual partners). The results of these control procedures generated a list of queries that was sent for resolution to the specific site. After finalizing quality control procedures, the Estonian site pooled the data into one database for all respondents for each wave (i.e., baseline, 3-month and 12-month follow-up). Pooled databases for each wave were then merged into one longitudinal pooled database.
Ethics and emergency issues
Ethical issues were discussed with an independent ethical advisor from Basel University in Switzerland. Each site obtained permission from the local ethics committee to implement the SEYLE study in their respective country. According to guidelines from the local ethics committees, after thorough examination of the SEYLE study objectives and procedures, decisions were made locally to obtain consent through an opt-in method (parents had to sign a consent form if they allowed their child to participate) or an opt-out method (parents had to sign a refusal form if they did not want their child to participate). Study subjects were then recruited into the study accordingly, after obtaining the required informed consents from parents and assent from pupils .
A specific procedure to identify and immediately assist emergency cases with acute suicidality was implemented at each site in all four Arms. A minimum set of requirements regarding the identification of emergency cases was followed by each center. However each centre had the opportunity to reinforce the ethical requirements, according to the indications of the local Ethics Committee. Emergency cases were identified through responses to two specific questions in the questionnaire: those who reported moderate or severe suicidal ideation in the previous two weeks, or those who reported attempting suicide in the previous two weeks. Subjects identified as emergency cases were followed-up by local SEYLE personnel until successful referral to the local healthcare system. However, since it was not possible to follow up individuals while in treatment due to confidentiality, it is not known if the clinical intervention had impact on the collected data. However, all emergency cases were allowed to participate in the active interventions and in the control arm. Therefore, these pupils are included in the total data set.
Subsequent to conducting SEYLE, an interdisciplinary workshopb was held in the Psychiatric Clinics of the University Basel, to analyse ethical issues, especially confidentiality towards minors involved in SEYLE Study. Additionally, relevant codes and guidelines for guidance in mental health research with minors were analysed. While unresolved questions may remain, such as whether and when confidentiality might or should be overridden in cases of emergency , within the SEYLE study, all problems of confidentiality were determined to have been handled according to the indications of the local ethical committees and the local laws and regulations of the participating countries.
Consent, participation and drop-out rates
Response rates for SEYLE are reported in terms of consent and participation rates for schools and pupils.
SEYLE study school response rates, including number randomized, approached and participated, by country
Accepted to participate
Rates of pupils’ consent have been calculated for the eight countries (Estonia, Germany, Hungary, Ireland, Israel, Italy, Romania and Spain) that used similar ethical procedures in collecting pupils consent. The overall rate of consent in these eight countries was 76% (10,665 pupils with consent out of 14,086 approached). In the other three countries (Austria, France and Slovenia), extended procedures for collection of the informed consent were imposed by the local ethics committees (i.e., multiple forms to be signed; pupil could be enrolled only if both parents signed the form, etc.). This resulted in a consent rate of 23% (3,452 pupils with consent out of 14,803 approached) in these three countries. When combining these three countries with the other eight the overall rate of consent decreased to 49% (14,117 pupils with consent out of 28,889 approached). Of the total 14,117 pupils whose parents gave consent, 12,395 participated in SEYLE, yielding a participation rate of 87.8%. Gender proportion of consented and non-consented pupils did not significantly differ in any country with the exception of France and Slovenia, where more girls were present among participating pupils. Information regarding gender proportion of non-participating pupils was not available in Ireland and Germany.
Participation in SEYLE according to Intervention Arm, including baseline, 3 and 12 month follow-up and drop out rates, by gender
Baseline number (gender %)
3 Month follow-up number (gender %)
3 Month drop-out rate^ (%)
12 Month follow-up n (gender %)
12 Month drop-out rate* (%)
Age and gender
SEYLE pupil participation by Country, according to mean age and gender
Mean age (SD)
Population density at the study sites was higher than in the respective country in Estonia, Germany, Hungary, Ireland and Spain. Population density was lower at the study site in Austria, France, Italy, Romania and Slovenia.
The difference in net income per inhabitant between each country and the respective study site was below 10%, with the exception of Estonia (+17%), Germany (+15%), Hungary (+42%) and Italy (-24%).
The proportion of immigrants in each study site population was not significantly different from the proportion of immigrants in the respective country in all countries with the exception of Italy (-5%), Slovenia (-8%), and Spain (-10%).
In no country were unemployment rates at the study site significantly different than in the respective country as a whole.
Therefore, based on these key parameters, the pupils participating in the SEYLE study can be considered reasonably representative of their respective country.
Additionally, the main socio-demographic indicators such as age, gender, belonging to a single parent household, belonging to a religious denomination and parental unemployment did not significantly differ between Arms.
Internal reliability of psychometric scales
Cronbach alpha of scales administered in the SEYLE study, by country (n=12,395)
A large landmark intervention study, using RCT design, necessitates an article dedicated to the description of methodological issues and their complexity, which requires more space than is usually allowed in the Methods section of an ordinary article in the majority of scientific journals. This paper describes the complex methodological issues in the SEYLE study, which will allow for adequate interpretation of study’s results generated over-time, as well as appropriate replication and development of the study in the future.
SEYLE is a multi-site RCT of interventions to promote mental health and prevent risk behaviours and suicide in European schools. Very few RCTs have been conducted on youth mental health and most of them have focused on a single intervention or treatment method on a small sample or at only one site or within only one country, or alternatively with a clinical population [26–35]. SEYLE was designed to evaluate three different active intervention methods that respectively empower students, teachers and professionals, compared to controls, to identify early mental health problems and risk behaviours, while facilitating appropriate referral to the healthcare system. The interventions were performed on a large sample (N=12,395) in eleven sites, located in eleven different European countries. Extensive procedures were implemented in order to guarantee a homogeneous methodology across sites, including high quality forward and back-translations of manuals, instruments, standardized interventions, as well as cultural adaptation for each participating country and expert review of all ethical issues related to the investigation.
The SEYLE project achieved the sampling size objective of enrolling at least 1,000 participating pupils at each site (except Austria; n=960), for a total sample of N=12,395 school-based adolescents. Female participants (55.2%) exceeded the number of male participants. It may be hypothesized that girls are more interested and/or collaborative in participating in a study dealing with psychological issues than males, leading to a higher participation. However, in most countries, there were no significant differences between the gender proportion in the school and the gender proportion in our sample.
Analysis of representativeness indicates that the study sites are reasonably representative of their respective countries, thus allowing for in-country and between-country comparisons. The overall response rate of schools was high (67.8%). Only Israel had a low response rate of schools (37.5%). Without Israel, response rate of schools was 72%. It can be hypothesized that the low response rate of schools in Israel was attributed to the nearly uniform attitude of school principals’ against using school time for additional non-educational activities, in view of the many such activities already taking place. Israel, along with Cork, Ireland and Oviedo, Spain, were the only sites where a majority of the participating adolescents were male. The Cork study site had the lowest pupil participation rate (64.6%), which can possibly be attributed to factors outside the scope of the study, as an environmental emergency affecting the region (flooding) at the time of the SEYLE study, thus preventing many pupils attending school when the baseline questionnaire was administered. However, overall pupil participation rates in SEYLE were high and thus assure adequate external validity of the collected data.
Drop-out rates at follow-up were low: 20.6% at 12-months, including 12.7% at three months follow-up, indicating broad acceptance of the interventions and questionnaires by both schools and pupils. Drop-out rates did not vary significantly among countries. Importantly, the study methodology required that the school randomization include all eligible schools in the area. This allowed for comparability of study Arms within and across sites. The main demographic indicators at baseline, such as mean age, family structure and parental unemployment did not differ significantly between the Active interventions and the Control Arm.
Internal reliability of each scale administered in each country also provides reassuring results. Cronbach’s alpha values were measured for both instruments translated for the purposes of SEYLE, as well as for instruments already available officially, in the respective languages. As reported in Table 6, Cronbach’s alpha values were quite homogenous across countries with very small variations and can be considered good or very good for all administered scales. The lowest internal reliability was reported for the SDQ (alpha=0.740). This result is more than acceptable and in agreement with previous studies .
The major strength of the SEYLE RCT is its application of a robust and homogenous methodology applied across eleven study sites in eleven different countries, selected to provide a broad geographical representation of Europe. Due to extensive collaboration across sites through Work Packages, that required cross-site cooperation of all participating sites throughout the study, uniform adherence to the study methodology was assured. Moreover, the standardized translation methodology and cultural adaptation allowed for the fine-tuning of interventions to be responsive to local cultural contexts, thus ensuring that the project was meaningful and useful data were collected at each site. Another major strength of the project is the inclusion of a control group and the selection of outcome measures, which are related to mental health and wellness, as well as risk behaviours, thus allowing for the study outcomes to be associated with three distinct interventions. Finally, the SEYLE interventions are able to be tested on a combined, large sample of European adolescents, generating the first such findings from a large-scale RCT of adolescent well-being in Europe, providing an important cohort that can be followed over time.
In any large-scale multi-site study using a complex methodology, securing sufficient funding is always an important challenge. In the case of SEYLE, there were two major limitations due to funding: namely, the funding duration precluded a long follow-up after the intervention ended. It would have been of greater value to identify the long-term effects of the SEYLE interventions by having a longer follow-up, as many preventive effects may only be observed after a longer time post-intervention. In fact, a five-year instead of a three-year timetable for SEYLE would probably have allowed for more knowledge to be gained regarding the study’s outcomes. In SEYLE, one site per country was chosen for study participation. Sufficient funds to allow the inclusion of more than one site per country would significantly have improved representation of the urban and rural areas and therefore understanding of different populations. Moreover, the analysis of representativeness of the recruited sample in relation to the respective country was limited by the availability of sociodemographic indicators in Eurostat at the local level (NUTS2). It was not possible to directly compare the SEYLE data and the same indicators at the country level because these were not available for the adolescent population or were collected with different methodologies, ultimately being incompatible.
Consent rates of schools and pupils varied across countries. The consent rates of pupils were very good in eight countries and lower in the three countries where extended consent procedures were imposed by the local ethics committees. However, it has been reported that response rates between 30% and 70% are, at most, only weakly associated with bias . Available indicators such as school size did not differ significantly between participating and non-participating schools with the exception of Slovenia, where more small schools participated in the study. The study was necessarily performed during school hours and consequently there was limited opportunity to collect other than questionnaire data regarding pupil’s behaviour. This school-based approach necessarily required a very limited number of outcome measures. Another limitation is that all data were collected through self-report questionnaires.
The SEYLE RCT study was successful in recruiting a reasonably representative sample of over 12,000 European school-based adolescents. The study is unique in its’ robust and uniform methodology applied across eleven sites, including a large number of socio-demographic, lifestyle and mental health outcomes, allowing for evaluation of the effects of three Intervention Arms compared to a Control Arm. Several important indicators, such as response and participation rates, differences between Arms and reliability of scales show very good validity of the collected data and ensure that the selected outcome measures are reliable and useful for carrying out school-based identification of at-risk adolescents. The SEYLE database contains up-to-date information about lifestyles and mental health problems of European adolescents and will be of great benefit for mental health professionals, policy makers and other stakeholders throughout the European Union.
aIsrael belongs to the WHO European Region and is eligible to receive funding under the European VII Framework Programme.
bWorkshop (When) Theory meets Practice – Ethical Issues in Research with Minors and other Vulnerable Groups, 14.2.2012 Research Ethics – Botnar Project.
The SEYLE project was supported through Coordination Theme 1 (Health) of the European Union Seventh Framework Program (FP7), Grant agreement number HEALTH-F2-2009-223091.
The authors were independent of the funders in all aspects of study design, data analysis, and writing of this manuscript. The Project Leader and Coordinator of the SEYLE project is Professor in Psychiatry and Suicidology Danuta Wasserman, Karolinska Institutet (KI), Head of the National Centre for Suicide Research and Prevention of Mental Ill-Health and Suicide (NASP), at KI, Stockholm, Sweden. Other members of the Executive Committee are Professor Marco Sarchiapone, Department of Health Sciences, University of Molise, Campobasso, Italy; Senior Lecturer Vladimir Carli, National Centre for Suicide Research and Prevention of Mental Ill-Health (NASP), Karolinska Institutet, Stockholm, Sweden; Professor of Child and Adolescent Psychiatry Christina Hoven and Anthropologist Camilla Wasserman, Department of Child and Adolescent Psychiatry, New York State Psychiatric Institute and Mailman School of Public Health, Columbia University, New York, USA. The SEYLE Consortium comprises centers in 12 European countries. Site leaders for each respective center and country are: Danuta Wasserman (NASP, Karolinska Institutet, Sweden, Coordinating Centre), Christian Haring (University for Medical Information Technology, Austria), Airi Varnik (Estonian-Swedish Mental Health & Suicidology Institute, Estonia), Jean-Pierre Kahn (University of Nancy, France), Romuald Brunner (University of Heidelberg, Germany), Judit Balazs (Vadaskert Child and Adolescent Psychiatric Hospital, Hungary), Paul Corcoran (National Suicide Research Foundation, Ireland), Alan Apter (Schneider Children's Medical Centre of Israel, Tel-Aviv University, Tel Aviv, Israel), Marco Sarchiapone (University of Molise, Italy), Doina Cosman (Iuliu Hatieganu University of Medicine and Pharmacy, Romania), Vita Postuvan (University of Primorska, Slovenia), Julio Bobes and Pilar Saiz (University of Oviedo, Spain). Dr. Stella Reiter-Theil (Professor in Ethics, Basel University) was the external advisor for ethical issues in the study.
- Blum RW, Bastos FI, Kabiru CW, Le LC: Adolescent health in the 21st century. Lancet. 2012, 379: 1567-1568. 10.1016/S0140-6736(12)60407-3.View ArticlePubMed
- Hale DR, Viner RM: Policy responses to multiple risk behaviours in adolescents. J Publ Health (Oxf). 2012, 34 (Suppl 1): i11-i19. 10.1093/pubmed/fdr112.View Article
- Halfon N, Hochstein M: Life course health development: an integrated framework for developing health, policy, and research. Milbank Q. 2002, 80: 433-479. 10.1111/1468-0009.00019. iiiPubMed CentralView ArticlePubMed
- Jiang N, Kolbe LJ, Seo DC, Kay NS, Brindis CD: Health of adolescents and young adults: trends in achieving the 21 Critical National Health Objectives by 2010. J Adolesc Health. 2011, 49: 124-132. 10.1016/j.jadohealth.2011.04.026.View ArticlePubMed
- Park MJ, Paul Mulye T, Adams SH, Brindis CD, Irwin CEJ: The health status of young adults in the United States. J Adolesc Health. 2006, 39: 305-317. 10.1016/j.jadohealth.2006.04.017.View ArticlePubMed
- Park MJ, Brindis CD, Chang F, Irwin CEJ: A midcourse review of the healthy people 2010: 21 critical health objectives for adolescents and young adults. J Adolesc Health. 2008, 42: 329-334. 10.1016/j.jadohealth.2008.01.008.View ArticlePubMed
- Brener ND, Kann L, Shanklin S, Kinchen S, Eaton DK, Hawkins J, Flint KH: Methodology of the youth risk behaviour surveillance system--2013. MMWR Recomm Rep. 2013, 62: 1-20.PubMed
- Bird HR, Canino GJ, Davies M, Duarte CS, Febo V, Ramirez R, Hoven C, Wicks J, Musa G, Loeber R: A study of disruptive behaviour disorders in Puerto Rican youth: I. Background, design, and survey methods. J Am Acad Child Adolesc Psychiatr. 2006, 45: 1032-1041. 10.1097/01.chi.0000227878.58027.3d.View Article
- Johnson JG, Cohen P, Gould MS, Kasen S, Brown J, Brook JS: Childhood adversities, interpersonal difficulties, and risk for suicide attempts during late adolescence and early adulthood. Arch Gen Psychiatr. 2002, 59: 741-749. 10.1001/archpsyc.59.8.741.View ArticlePubMed
- Lahey BB, Flagg EW, Bird HR, Schwab-Stone ME, Canino G, Dulcan MK, Leaf PJ, Davies M, Brogan D, Bourdon K, Horwitz SM, Rubio-Stipec M, Freeman DH, Lichtman JH, Shaffer D, Goodman SH, Narrow WE, Weissman MM, Kandel DB, Jensen PS, Richters JE, Regier DA: The NIMH Methods for the Epidemiology of Child and Adolescent Mental Disorders (MECA) Study: background and methodology. J Am Acad Child Adolesc Psychiatr. 1996, 35: 855-864. 10.1097/00004583-199607000-00011.View Article
- Merikangas K, Avenevoli S, Costello J, Koretz D, Kessler RC: National comorbidity survey replication adolescent supplement (NCS-A): I Background and measures. J Am Acad Child Adolesc Psychiatr. 2009, 48: 367-369. 10.1097/CHI.0b013e31819996f1.View Article
- Daniel SS, Goldston DB: Interventions for suicidal youth: a review of the literature and developmental considerations. Suicide Life Threat Behav. 2009, 39: 252-268. 10.1521/suli.2009.39.3.252.PubMed CentralView ArticlePubMed
- Kieling C, Baker-Henningham H, Belfer M, Conti G, Ertem I, Omigbodun O, Rohde LA, Srinath S, Ulkuer N, Rahman A: Child and adolescent mental health worldwide: evidence for action. Lancet. 2011, 378: 1515-1525. 10.1016/S0140-6736(11)60827-1.View ArticlePubMed
- Weare K, Nind M: Mental health promotion and problem prevention in schools: what does the evidence say?. Health Promot Int. 2011, 26 (Suppl 1): i29-i69. 10.1093/heapro/dar075.View ArticlePubMed
- Wasserman D, Carli V, Wasserman C, Apter A, Balazs J, Bobes J, Bracale R, Brunner R, Bursztein-Lipsicas C, Corcoran P, Cosman D, Durkee T, Feldman D, Gadoros J, Guillemin F, Haring C, Kahn JP, Kaess M, Keeley H, Marusic D, Nemes B, Postuvan V, Reiter-Theil S, Resch F, Saiz P, Sarchiapone M, Sisask M, Varnik A, Hoven CW: Saving and empowering young lives in Europe (SEYLE): a randomized controlled trial. BMC Publ Health. 2010, 10: 192-10.1186/1471-2458-10-192.View Article
- QPR Institute for Suicide Prevention. http://www.qprinstitute.com,
- Wasserman C, Hoven CW, Wasserman D, Carli V, Sarchiapone M, Al-Halabi S, Apter A, Balazs J, Bobes J, Cosman D, Farkas L, Feldman D, Fischer G, Graber N, Haring C, Herta DC, Iosue M, Kahn JP, Keeley H, Klug K, McCarthy J, Tubiana-Potiez A, Varnik A, Varnik P, Ziberna J, Postuvan V: Suicide prevention for youth–a mental health awareness program: lessons learned from the Saving and Empowering Young Lives in Europe (SEYLE) intervention study. BMC Publ Health. 2012, 12: 776-10.1186/1471-2458-12-776.View Article
- Zung WW: A rating instrument for anxiety disorders. Psychosomatics. 1971, 12: 371-379.View ArticlePubMed
- Beck AT, Steer RA, Ball R, Ranieri W: Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients. J Pers Assess. 1996, 67: 588-597. 10.1207/s15327752jpa6703_13.View ArticlePubMed
- Primack BA: The WHO-5 Wellbeing Index performed the best in screening for depression in primary care. ACP J Club. 2003, 139: 48-PubMed
- Goodman R, Meltzer H, Bailey V: The strengths and difficulties questionnaire: a pilot study on the validity of the self-report version. Eur Child Adolesc Psychiatr. 1998, 7: 125-130. 10.1007/s007870050057.View Article
- Eurostat: Statistics database. European Union; 2010. 2009, [cited 2011 January 31]; Available from: http://epp.eurostat.ec.europa.eu/portal/page/portal/eurostat/home/
- Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika. 1951, 16: 297-334. 10.1007/BF02310555.View Article
- Koch HG, Reiter-Theil S, Helmchen H: Informed Consent in Psychiatry. European Perspectives of Ethics, Law and Clinical Practice. 1996, Baden-Baden: Nomos
- Ford CA, Millstein SG, Halpern-Felsher BL, Irwin CEJ: Influence of physician confidentiality assurances on adolescents' willingness to disclose information and seek future health care: a randomized controlled trial. JAMA. 1997, 278: 1029-1034. 10.1001/jama.1997.03550120089044.View ArticlePubMed
- Connell AM, Dishion TJ, Yasui M, Kavanagh K: An adaptive approach to family intervention: linking engagement in family-centered intervention to reductions in adolescent problem behaviour. J Consult Clin Psychol. 2007, 75: 568-579.View ArticlePubMed
- Ginsburg GS, Drake KL: School-based treatment for anxious african-american adolescents: a controlled pilot study. J Am Acad Child Adolesc Psychiatr. 2002, 41: 768-775. 10.1097/00004583-200207000-00007.View Article
- Gonzales NA, Dumka LE, Millsap RE, Gottschall A, McClain DB, Wong JJ, German M, Mauricio AM, Wheeler L, Carpentier FD, Kim SY: Randomized trial of a broad preventive intervention for Mexican American adolescents. J Consult Clin Psychol. 2012, 80: 1-16.PubMed CentralView ArticlePubMed
- Horowitz JL, Garber J, Ciesla JA, Young JF, Mufson L: Prevention of depressive symptoms in adolescents: a randomized trial of cognitive-behavioural and interpersonal prevention programs. J Consult Clin Psychol. 2007, 75: 693-706.View ArticlePubMed
- Kaale A, Smith L, Sponheim E: A randomized controlled trial of preschool-based joint attention intervention for children with autism. J Child Psychol Psychiatr. 2012, 53: 97-105. 10.1111/j.1469-7610.2011.02450.x.View Article
- Kataoka SH, Stein BD, Jaycox LH, Wong M, Escudero P, Tu W, Zaragoza C, Fink A: A school-based mental health program for traumatized Latino immigrant children. J Am Acad Child Adolesc Psychiatr. 2003, 42: 311-318. 10.1097/00004583-200303000-00011.View Article
- Stein BD, Jaycox LH, Kataoka SH, Wong M, Tu W, Elliott MN, Fink A: A mental health intervention for schoolchildren exposed to violence: a randomized controlled trial. JAMA. 2003, 290: 603-611. 10.1001/jama.290.5.603.View ArticlePubMed
- Swartz KL, Kastelic EA, Hess SG, Cox TS, Gonzales LC, Mink SP, DePaulo JRJ: The effectiveness of a school-based adolescent depression education program. Health Educ Behav. 2010, 37: 11-22. 10.1177/1090198107303313.View ArticlePubMed
- Tak YR, Van Zundert RM, Kuijpers RC, Van Vlokhoven BS, Rensink HF, Engels RC: A randomized controlled trial testing the effectiveness of a universal school-based depression prevention program 'Op Volle Kracht' in the Netherlands. BMC Publ Health. 2012, 12: 21-10.1186/1471-2458-12-21.View Article
- Young JF, Mufson L, Gallop R: Preventing depression: a randomized trial of interpersonal psychotherapy-adolescent skills training. Depress Anxiety. 2010, 27: 426-433. 10.1002/da.20664.PubMed CentralView ArticlePubMed
- Goodman R: Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatr. 2001, 40: 1337-1345. 10.1097/00004583-200111000-00015.View Article
- Galea S, Tracy M: Participation rates in epidemiologic studies. Ann Epidemiol. 2007, 17: 643-653. 10.1016/j.annepidem.2007.03.013.View ArticlePubMed
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/13/479/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.