A school-based educational on-site vaccination intervention for adolescents in an urban area in Germany: feasibility and psychometric properties of instruments in a pilot study
BMC Public Health volume 22, Article number: 60 (2022)
Vaccination rates for measles, mumps, and rubella (MMR) and diphtheria, tetanus, pertussis, and polio (Tdap-IPV) are not optimal among German adolescents. Education in combination with easy access to vaccination may be a promising approach to improve vaccination rates. The present paper describes a pilot study of a planned cluster randomized controlled trial (cRCT) in which we aim to improve MMR and Tdap-IPV vaccination rates together with knowledge and self-efficacy in a school setting.
The study covered 863 students from 41 classes of four schools. The optimization and feasibility of access to schools, recruitment strategies, intervention, and assessment procedures were examined. The course and content of the educational unit were evaluated with a mixed-methods approach. A pre-post measurement design was tested for the vaccination rate in all schools. Additionally, at two schools, improvement in vaccination-related knowledge and perceived self-efficacy were measured by questionnaire pre-educational unit (n=287) and post-educational unit (n=293). The remaining two schools provided only postintervention data. Finally, we evaluated the psychometric properties (i.e., reliability, retest reliability, and change rates) of the questionnaire, applying Cronbach’s alpha, factor analyses, generalized estimating equations and linear mixed models.
The findings of the pilot study indicated good feasibility. Of the total sample, 437 students (50.9%) brought their vaccination cards to school, 68 students received Tdap-IPV vaccinations, and 11 received MMR vaccinations. Out of six knowledge questions, on average, the students had M=2.84 (95% CI [2.69, 3.10]) correct answers before and M=4.45 (95% CI [4.26, 4.64]) after the class. Ranging from 1 to 4, the self-efficacy scale changed by 0.3 points (p <.001); Cronbach’s alpha was 0.67 and 0.76 pre- and post-educational unit, respectively, and a one-factor solution was found. Content analysis of the five semistructured group interviews (n=12, 58.3% female) showed that all students found the length of the intervention to be appropriate. The teaching methods, including interactive and social media components, were perceived as very good.
A school-based educational and on-site vaccination intervention appears to be feasible in terms of procedures and the adequacy of the instruments for the adolescent target group.
ISRCTN, ISRCTN18026662. Pilot study for main trial registered 8 December 2017.
With the Global Vaccine Action Plan (GVAP), the World Health Organization (WHO) set the global goal of increasing vaccination coverage together with eradicating and eliminating infectious diseases, including measles, polio, and pertussis, by 2020 . From 2002 to 2018, the only region out of six WHO regions that could be considered consistently measles-free was the Americas . However, even in this region, more than 10 countries reported endemic measles transmissions in both 2018 and 2019 . For Germany, vaccination coverage for basic immunization and catch-up vaccination for mumps, measles, and rubella (MMR) and for tetanus, diphtheria, pertussis, and polio (Tdap-IPV) are too low and have been stagnating for years [4,5,6]. Measles outbreaks endanger the health of infected and nonvaccinated persons every year; 30% of infected persons develop one or more complications ranging from otitis media (7%) to pneumonia (6%), hospitalization (18%), encephalitis (0.1%), and even death (0.2%) . In addition to individual health risks, measles represent an immense economic burden for the health system. Even for small measles outbreaks, which are defined as constituting fewer than 300 cases, the direct and indirect costs exceed the costs of a national vaccination program many times over with a benefit-cost ratio of 2.21 to 4.97 . The cause of large pandemics is insufficient immunization rates . Progress towards the GVAP global health targets is off track, and more efforts on a global level are required to address systemic weakness and limiting factors.
Effective approaches to increase vaccination rates are needed, and school-based on-site interventions may be feasible (for a narrative review of randomized controlled trials testing educational strategies in combination with on-site vaccination, see Additional file 1: Appendix 1: samples, intervention components, vaccinations carried out, vaccination process, outcome measures, and results). Whereas there is evidence that school-based interventions increase vaccination rates for influenza [10, 11] and sexually transmitted infections/human papillomavirus (STI/HPV [12,13,14,15,16,17,18,19,20,21]), school-based vaccinations against diseases such as measles, polio, and pertussis have only rarely been addressed within randomized controlled designs [11, 21, 22]. In interventions, common theoretical concepts that are assumed to drive the intervention effects include perceived barriers and benefits (e.g., as part of protection motivation theory [PMT] , social cognitive theory [SCT] [24, 25], and the health belief model [HBM] ) as well as perceived risk (e.g., PMT, HBM), all of which may be altered by knowledge and awareness strategies. Furthermore, a key determinant in most vaccination interventions is self-efficacy – individuals’ belief in their competency in goal-directed behavior (e.g., SCT, PMT). Moreover, environmental barriers and opportunities such as ease of access to vaccination and the direct offer of vaccination may increase the likelihood of action (e.g., HBM, SCT). This concept is captured as a “cue to action” in the HBM and is indirectly included in the SCT as environmental factors. However, cues to action are assumed to work in orchestration with self-efficacy beliefs, knowledge and outcome expectancies [26, 27].
Interventions that combine educational components with on-site vaccination appear to be a promising strategy for enhancing vaccination among adolescents (see Additional file 1: Appendix 1; [10, 11, 13, 18, 20, 21, 28,29,30]). Such studies show good feasibility and acceptability among staff and students, although comparability between studies is limited in terms of legal basis (e.g., national vaccination schedule, legal terms regarding vaccination consent of minors, who is allowed to carry out the vaccination), and they often incompletely report pretrial vaccination rates [11, 13, 20, 22, 28, 30].
Although there is growing evidence on the feasibility and effectiveness of school-based on-site vaccination interventions, more rigorous research is needed, combining theory-driven education and on-site opportunities for vaccination with objective assessments of effectiveness.
The aims of the present pilot study were to test the feasibility of access strategies to schools, intervention procedures and the psychometric properties of the instruments used in a planned cluster randomized controlled trial (cRCT).
The planned cRCT was designed to identify effective educational strategies to increase vaccination rates for routine vaccines such as MMR or Tdap-IPV in students. For this planned cRCT, we developed an evidence- and theory-based, educational on-site vaccination intervention delivering vaccinations on school grounds in the Prevention Bus (see study protocol ), which was first applied and tested in the present pilot study.
Accordingly, this pilot study had three main objectives. The first aim was to test whether access to schools and recruitment strategies were suitable and effective for the planned cRCT. Second, the procedures of the educational/basic information intervention in combination with on-site, school-based vaccination were tested regarding feasibility. Third, measurement instruments including a self-report questionnaire on vaccination-related knowledge and a short version of a vaccination-related self-efficacy scale were evaluated in terms of internal consistency and sensitivity to change.
Design and study overview
The pilot study was conducted using a four-group intervention design from August to September 2017. We applied a pre-post session design, adapted from the Solomon four-group design , at two schools and only a postsession design at two other schools. The procedure at each school is illustrated in Fig. 1.
In the pilot phase, the schools were not randomized to conditions. Design elements that were to be evaluated regarding feasibility were allocated at the school level. More detailed information on the intervention conditions can be found in brief in the 6 section and in more detail in the study protocol of the planned cRCT .
All four participating schools were visited by the Prevention Bus team and the bus for an entire school week. The Prevention Bus team on-site at each school consisted of a medical team, with two physicians and two nurses, and a bus driver. The bus was converted into a doctor’s office in 2016, enabling vaccinations to be carried out inside it directly on school grounds, fully meeting medical quality standards. A detailed description of the Prevention Bus can be found in the study protocol  and additional materials were included in the Additional file 1: Appendix 2 (a). Information material and consent documents were distributed to all students and their parents by the school staff one week in advance. During the week on-site at school, the students were addressed in their respective class contexts with either one or another intervention procedure (see Fig. 1) that differed with respect to the level of knowledge transfer and interactivity (see Methods, Intervention conditions). Both procedures ended with a joint visit of the class to the Prevention Bus and the opportunity to receive the MMR or Tdap-IPV vaccination. However, the vaccinations could also be carried out on any other day of the week while the bus and medical team were on-site.
Schools in the pilot study were eligible for participation when they fulfilled two out of three inclusion criteria for the planned cRCT. For the pilot study, the recruited schools constituted a convenience sample. The inclusion criteria required that a school be an upper secondary school, i.e., a high school or a vocational school (for more information, see Additional file 1: Appendix 2 (b)) with at least 200 students in grades 9 to 11, and located in the city center of Berlin. This approach was chosen to achieve maximum comparability without interfering with schools eligible for the planned cRCT. Schools were recruited according to the described criteria, assuring balanced recruitment and the applicability of the pre-post design specific to the pilot study to different school types.
Students within the selected schools were eligible for participation in the educational/basic information components of the intervention if they were currently attending grades 9 to 11. The interventions were delivered during regular class times. Completing questionnaires and receiving vaccinations were optional.The vaccination decision for students under 18 years old required parental consent in the form of a signed consent form. For students under the age of 15, written parental consent was additionally reconfirmed by phone with the parent. For more information regarding the consent process, see Additional file 1: Appendix 2 (c).
The development of the intervention components was theory- and evidence-driven. It is described in detail in the study protocol of the planned cRCT  in accordance with the template for the intervention description and replication (TIDieR ) checklist and guide (e.g., theories, procedures, training). The following is a brief description of the intervention conditions that were tested regarding feasibility .
At all four schools included in the study, the Prevention Bus was present for an entire school week. The school secretary’s office received take-home materials together with a declaration of consent form for the parents one week in advance. The school administration was instructed to distribute the materials and to remind the students 1-2 days in advance to bring the materials, including their vaccination card, with them on the day of the intervention.
Two planned intervention conditions were tested, i.e., the Educational Class Condition (ECC) and Low-Intensity Information Condition (LIIC). Both conditions took place in the school class context. The ECC/LIIC both included the completion of the questionnaires in the classroom and a guided tour of the Prevention Bus. Students from all participating schools had an opportunity to be vaccinated. See Fig. 1 for the on-site procedure for each school.
At three schools (schools 1, 2 and 3), a 90-minute procedure was carried out that included an educational unit (45 min) taught by a physician in the classrooms. The educational unit consisted of a digital PowerPoint presentation with interactive elements. The topics addressed were the immune system and infectious diseases, vaccination processes, herd immunity, and the risks and benefits specific to measles vaccination. A group discussion as well as media elements such as newspaper articles and videos were also included. The educational unit was based on three theories of health behavior change (see Background, and study protocol of the planned cRCT ): SCT [24, 25], PMT , and the HBM . It was intended to increase knowledge by providing and discussing information [23,24,25,26], to address vaccination-/disease-related risk perception by risk communication , and to use a testimonial of a fictional role model to address self-efficacy [24, 25].
In school 4, a 45-minute unit was conducted with the individual school classes. In each participating class, the physicians orally provided brief information about the Prevention Bus and the vaccinations offered. Detailed vaccination questions were not discussed within the LIIC. Solely procedural information and information already provided in the written vaccination consent form were addressed.
With respect to the three aims, assessing the feasibility of the recruitment process and the feasibility of on-site procedures and to evaluate measurement instruments, we collected data for seven process indicators and measures: school recruitment log, vaccination documents, vaccinations delivered, rating of the educational unit, semistructured interviews on the educational unit, vaccination-related knowledge scale, and vaccination-related perceived self-efficacy scale. In addition, covariates that could influence vaccination behavior were assessed.
Using a school recruitment log, recruitment approaches and strategies were documented.
We assessed the presence and contents of vaccination documents as an indicator of the feasibility of on-site procedures regarding the requirement for vaccination in schools. We recorded the vaccination status (vaccinations: type and number of doses received) to determine the proportion of students with a need for vaccination in accordance with the German Vaccination Committee “Ständige Impfkommission am Robert-Koch Institut” (STIKO) . All indicators were documented by a physician or nurse during the ECC/LIIC and before on-site vaccination was offered.
For the vaccinations delivered on-site, the medical team documented how many students received a vaccination in the Prevention Bus. In this study, combination vaccinations against mumps, measles, rubella (MMR ) and tetanus, diphtheria, pertussis and polio (Tdap-IPV )Footnote 1 were offered. Vaccinations delivered were documented separately for MMR and Tdap-IPV at class-level.
The rating of the educational unit by all students in the ECC was documented. The students evaluated the course and content of the educational unit with a single item on a 3-point Likert-scale (scale: very interesting, interesting, or boring) administered after the ECC. Further feedback was recorded with semistructured interviews in the educational unit with selected students (single and group settings) in the ECC. The interviews were conducted after the students completed the individual questionnaire but before they were offered vaccinations in the bus. The translated questions can be found in Additional file 1: Appendix 2 (d).
Using a maximum of seven items, the vaccination-related knowledge scale indicated the level of immunization knowledge (see Additional file 1: Appendix 2 (e)). Figure 2 provides an overview of which items were assessed at which school. The items covered facts about target groups of infectious diseases, prevention of the spread of infectious diseases, herd immunity, vaccination, and side effects of infections. The items were multiple choice, with one correct answer. Across all items, an overall knowledge sum score could be generated.
Two different sum scores were calculated in the pilot study. The 4-item sum score included items 1-4 (childhood disease, herd immunity, immunization, measles outbreak) and was assessed in all four schools (see Fig. 2). In addition, for schools 3 and 4, a 6-item sum score was computed as all final items were applied, including the newly successively introduced items 6 and 7 (infertility, pregnancy malformation). A low sum score (0) represented a low level of vaccination-related knowledge, and a high score (4 or 6) represented a high level of vaccination-related knowledge. Item 5 (bacteria) was not selected for the formation of scales. See Additional file 1: Appendix 2 (e) for information on item adaptations.
The vaccination-related perceived self-efficacy scale reflected students’ beliefs about their own competency to understand, appraise, and apply vaccination-related health information (see Additional file 1: Appendix 2 (e)). The scale consisted of a short version of the European Health Literacy Survey Questionnaire (HLS-EU Q47,). The short version was created by selecting items that covered vaccination and prevention. The students were asked to rate five items on a 4-point Likert-type scale ranging from 1 (very difficult) to 4 (very easy). A mean score was computed, with low scores representing low and high scores representing high levels of perceived self-efficacy.
Additionally, covariates, including gender, socioeconomic status (SES), and migration status, were assessed at the school and/or individual level. Regarding SES, two items were applied: whether students at home had a room of their own [38, 39] and whether they owned a “berlinpass”, a ticket that provides students of unemployed parents or parents with low income with access to reduced public transport fares and discounted leisure activities. Migration background was documented at the school level, indicating the ratio of students with a foreign-language background.
The data were analyzed using IBM SPSS Statistics 25. Descriptive data of the school recruitment log were used to evaluate the feasibility of the recruitment processes. Prior to the scale analyses, missing values for all final vaccination-related knowledge items (ranging from 2.2 to 7.3%) and all perceived self-efficacy items (ranging from 9.5 to 12.0%) were imputed with a multiple imputation (MI) procedure using fully conditional specifications and 20 imputed datasets.
As documented in the school recruitment log, a ratio between the targeted schools and successfully recruited schools was used. Furthermore, absolute numbers of vaccination documents brought to school (the number of vaccination cards present, consent forms returned) and vaccinations delivered on-site were reported. A relative ratio of students with a need for vaccination and vaccinations carried out in this study were reported at a descriptive level.
For the vaccination-related perceived self-efficacy scale, the internal consistency (i.e., Cronbach’s alpha) and the factorial structure (varimax-rotated exploratory factorial analysis [EFA]) separately for pre- and post-educational unit were computed. To determine significant changes from pre- to postintervention in vaccination-related knowledge and perceived self-efficacy, linear mixed models (LMMs) for continuous outcomes (covariance type=variance components, estimation=restricted maximum likelihood) and generalized estimating equations (GEEs) for dichotomous outcomes (distribution=binomial, link function=logit) were used; these approaches allowed for an adjustment for the nested structure of students in classes and controlled for the influence of age, gender, and SES. The longitudinal pre- and post-educational unit measurements of the questionnaire in the same school class (see Fig. 1, schools 1 and 3) were used to test sensitivity to changes in vaccination-related knowledge and perceived self-efficacy measurements. In addition, we compared the schools in which the questionnaire was collected only once, either post-educational unit (school 2) or post-basic information (school 4).
All tests of significance were based on the p < .05 level, and confidence intervals of 95% were achieved.
To evaluate the feasibility of the educational unit, the frequencies of student ratings of the educational unit were used. Furthermore, a research assistant coded the transcripts of the semistructured interviews, and interrater reliability was tested by another research assistant coding the transcript. The mean-level results and distributions are presented at a descriptive level.
For this pilot study, four schools were contacted, and all four agreed to participate. In addition to prior email contact, preparatory telephone calls were made to all schools to provide additional information. At one school, an additional appointment was made in advance because more detailed information regarding on-site procedures was requested. One junior high school, one junior-senior high school and two academic high schools (see Additional file 1: Appendix 2 (b)) constituted the pilot sample. School 1 was located in the city center, and schools 2, 3, and 4 were located in a district of Berlin adjacent to the city center. The four enrolled schools had a total of 41 school classes in grades 9 to 11 and 863 participating students, with an average age of 14.8 years; 49.4% were female (see Table 1).
Out of the total sample, 437 students (50.6%) brought their vaccination card to school (see Table 2). The check of the vaccination cards yielded the possibility of identifying the vaccination status. This included how many doses of a vaccine someone had received and whether there was an indication/need for vaccination according to the official vaccination recommendations (STIKO).
The check of vaccination cards indicated that 16 students (3.7%) showed a need for the MMR vaccination. In the past, these students had received either only one vaccination or no vaccination against mumps, measles and/or rubella. Of these 16 students with a need for vaccination, 11 (68.8%) were vaccinated on-site as part of this study.
For Tdap-IPV vaccination, the check of vaccination cards indicated that 36 students (8.2%) had received only four doses of a tetanus, diphtheria, and pertussis vaccination (basic immunization to the age of 14 months) in the past and had a definite need for a booster vaccination. Another 152 students (34.8%) had received five doses of tetanus, diphtheria, and/or pertussis. Students with five doses showed a conditional need for a booster vaccination, and a sixth shot is recommended if the time distance to the last vaccination is greater than five years. Regarding polio, only 148 students (33.9%) had received up to four doses of a polio vaccination and had a need for a single booster with Tdap-IPV. In this pilot study, 68 students received Tdap-IPV vaccinations. It was not possible to provide information on the relative ratio of vaccinated students to the need for Tdap-IPV vaccination regarding tetanus, diphtheria, and pertussis. For these infectious diseases, five years should pass between vaccination doses five and six. For the students with five vaccinations, the time span to the last vaccination was not documented in the pilot study.
The documentation for the vaccination documents (vaccination card, parental consent) was expanded during the course of this pilot study to take into account on-site feedback from physicians regarding parental consent/dissent (explicit objection) to vaccination. Originally, parental consent was recorded only for minors who received a vaccination. Furthermore, each minor also had to agree to the vaccination. However, some parents explicitly objected to the on-site vaccination. At schools 3 and 4 (n=297), 121 students (40.7%) presented their vaccination card, and 78 (64.5%) of them also had written parental consent. However, 9 (3.0%) of these students had a written objection from their parents against the vaccination. Fifteen students (5.1%) without a vaccination card nevertheless had parental consent with them. A further 23 students (7.7%) who did not have a vaccination card with them had a written objection from their parents opposing vaccination.
Concerning the vaccination-related knowledge items with repeated measures (ECC: pre- and post-educational unit, schools 1 and 3), when GEE models were applied to each item, the percentage of correct responses for the seven knowledge items before the educational unit ranged from 22% (CI 16%/28%) to 70% (CI 65%/76%). After the educational unit, these rates increased to 32% (CI 23%/40%) to 86% (CI 81%/92%) (Table 3).
Item 5 (bacteria; see Fig. 2) was excluded from all further analyses and thus was also not included in the formation of the knowledge sum scores. Students had reported that item 5 was difficult to understand, and the item showed no sensitivity to change from pre- to post-educational unit (see Table 3).
Based on the results displayed for every knowledge item, the final knowledge items were selected, and 4- and 6-item sum scores were computed. All scale analyses were performed with LMM, which enabled us to account for between-class and between-school variation as well as the class-level male/female ratio, age, and SES.
Knowledge sum score, change from pre- to post-educational unit
Concerning the 4-item knowledge sum score, for schools 1 and 3, there were two data points for each student. In these schools, the students worked on the questionnaire both pre- and post-educational unit (i.e., 578 data points, 2 schools, 14 classes, 2 occasions, mean age 14.6 years, 48.0% female). The LMM showed a significant change (B=-0.69, CI -0.86/-0.53, p <.001) from pre-educational unit (M=1.92. CI 1.76/2.08) to post-educational unit (M=2.61, CI 2.46/2.77).
The pre-post analysis with the 6 final knowledge items (i.e., 6-item knowledge sum score) included 127/130 students from 1 school (6 classes, mean age 14.6 years, 50% female). The LMM yielded a significant change (B=-1.55, CI -1.83/-1.27, p <.001) from pre-educational unit (M=2.84, CI 2.69/3.10) to post-educational unit (M=4.45, CI 4.26/4.64).
The distribution of the number of correct answers (4-item/6-item sum score) for the students included in the pre-post condition is shown in Fig. 3.
Knowledge sum score post-basic information versus post-educational unit
Furthermore, the distribution of the correct answers was compared for the 4-item sum score between two schools where the questionnaire was applied only once. In school 2, the questionnaire was administered post-educational unit (292 students, 13 classes, mean age 14.9 years, 48.5% female), and in school 4, it was administered post-basic information unit (280 students, 14 classes, mean age 14.9 years, 54.3% female). The LMM showed a significant difference (B=-0.64, CI -0.94/-0.33, p <.001), indicating a higher knowledge sum score post-educational unit (M=2.98, CI 2.78/3.17) than post-basic information (M=2.34, CI 2.15/2.54).
For perceived self-efficacy, the item means ranged between M=2.5 (CI 2.4/2.6) and M=3.4 (CI 3.3/3.5) post-basic information and between M=2.9 (CI 2.8/3.0) and M=3.5 (CI 3.5/3.6) post-educational unit (Table 4).
The internal consistencies of the self-efficacy scale were alpha = 0.67 pre-educational unit and alpha = 0.76 post-educational unit, indicating acceptable reliability of the self-efficacy scale. When the factorial structure of the self-efficacy scale pre- and post-educational unit was explored by means of EFA, a unidimensional factor solution was suggested by the scree plots and the factor loadings in the component matrix were comparable for the items before and after the class.
Using all available data from students who completed the questionnaire pre- and post-educational unit (578 data points, 2 schools, 14 classes, 2 occasions; mean age 14.6 years, 48.0% female), an LMM that accounted for between-class variation was applied. The model showed a significant change of 0.3 points pre- to post-educational unit (B=-0.20, CI -0.40/-0.20, p <.001), with an increase from 2.9 (CI 2.78/3.00) to 3.2 (CI 3.10/3.24) on the perceived self-efficacy scale (range from 1 to 4).
Furthermore, we compared data from the other two schools, where the students worked on the questionnaire only once, either post-educational unit (school 2, 292 students, 13 classes, mean age 14.9 years, 48.5% female) or post-basic information (280 students, 14 classes, mean age 14.9 years. 54.3% female). The analysis revealed comparable results, showing a significant difference (B=-0.26, CI -0.33/-0.07, p <.01) for items assessed post-basic information (M=2.96, CI 2.88/3.04) and post-educational unit (M=3.15, CI 3.07/3.24).
The content analysis of the five semistructured interviews (n=12, 58.3% female) showed that all students considered the length of the educational unit to be appropriate. The teaching methods of the physicians were perceived as very good, especially regarding the activation elements and the possibility of interaction between the students and physicians. The social media post was rated as good or very good by four out of five groups. The content was considered modern, realistic, and easy to understand. The contents of the educational unit on the individual diseases as well as social aspects (e.g., herd immunity) and the video materials were perceived to be particularly interesting. The students stated that their attitude towards vaccination had not changed. Nevertheless, the ECC was perceived as a positive learning opportunity. Additional information on the diseases described during the ECC (e.g., on effects of rubella during pregnancy and on HPV) was requested by three groups.
The aims of the present pilot study were to test the feasibility of recruitment and on-site procedures (i.e., intervention conditions and on-site vaccination) of a planned cRCT. The further, methodological aim of this study was to evaluate the psychometric properties of the instruments.
The results of the current pilot study showed that the school-based on-site vaccination approach is a feasible way to improve vaccination rates. The recruitment strategies proved successful in gaining access to schools comparable to those that would be eligible for the planned cRCT. Students in all participating schools showed a good vaccination uptake rate after the pilot intervention and provided good feedback regarding the educational components of the intervention. Regarding the instruments’ psychometric properties, our measurement tool for vaccination-related knowledge showed a reasonable sensitivity to change. In addition, the self-efficacy scale presented with a one-factor structure was internally consistent, and self-efficacy levels regarding vaccination increased from before to after the educational unit.
For the successful implementation of the planned cRCT, the pilot study showed that our recruitment procedures for schools to participate in an educational, on-site vaccination project are very promising. In comparison to other on-site vaccination interventions, we successfully included 100% of the contacted schools, which represents an above-average participation rate [10, 13, 28,29,30]. To achieve an effective objective assessment of vaccination rates, it was also indispensable to gain a high participation rate of students providing their vaccination documents (i.e., vaccination cards and signed consent forms). Half of the students enrolled in this pilot study presented their vaccination cards. The parental consent rate for minors, documented at schools 3 and 4, was approximately 65%. The present participation rates thus corresponded to those of other on-site vaccination studies [11, 13, 18, 22, 28, 29]. Notably, documentation of response rate is not reported at all or very inconsistently in most studies (see Additional file 1: Appendix 1). The information that could be extracted from the studies indicated a range of number of vaccination documents brought to school and/or parental consent from less than 30% [11, 28], to 50% , up to 80% [13, 18, 29]. Thus, compared to the studies, the rate in our pilot study is in the comparable middle range. However, further efforts should definitely be made to improve the return rate of the vaccination documents. Suggested measures, which are based on other studies and feedback from the present participants, are a closer connection of teachers  and parents to the organization and the increased promotion of opportunities of contacting the study team, as well as improving the infrastructure to provide vaccination documents get vaccinated on subsequent days on the bus. Regarding vaccinations carried out, 11 out of 16 students, approximately 69%, with a need for vaccination received the MMR vaccination, and a total of 63 Tdap-IPV vaccine doses were administered. To be able to draw a conclusion about the total number of students who needed a booster vaccination, the time since the last Tdap IPV vaccination received must be determined. Due to insufficient information about the time passed since the last Tdap-IPV dose received, as there should be at least 5 years between doses five and six , the relative rate for this vaccination could not be determined. In sum, it is encouraging that the individual protection of the MMR vaccination in this study increased strongly. The need for the Tdap-IPV vaccination seemed to be relatively high, as approximately 15% of all students with a vaccination card had been vaccinated. Nevertheless, the documentation should be expanded. Generally, the applied recruitment processes and the on-site vaccination procedure seem to be feasible procedures for the planned cRCT.
As a result of the pilot study, we will improve documentation procedures on-site. For example, for the Tdap-IPV vaccination, in addition to the number of doses received, the time interval to the last Tdap-IPV vaccination should be recorded in the planned cRCT from the beginning to determine whether, after completing basic immunization (4 doses), a booster vaccination is due . Without this information, the actual need for vaccination cannot be determined. Further, by additionally documenting written parental objection to vaccination, insightful important information was provided by the pilot study that should be included in the subsequent study. Parents were informed in advance that if they did not want a vaccination to be carried out, not signing the consent form was sufficient action. The number of unsigned consent forms can be used as an indicator of whether there is an increased need for further interaction with parents in general or with specific subgroups. In the pilot study, the documentation of parental objection was carried out for two schools, and the number was relatively low, with nine objections (3.0%). Whether there is a need for further interaction with the parents cannot be adequately evaluated on the basis of this pilot study because the informational value was quite limited due to the small number of schools and their characteristics. Both where we documented the parental objection were academic high schools with above-average SES. In the main study, the data on explicit objection to vaccination additionally should be further investigated to determine whether, for example, there are associations between SES or migration background and vaccination objection or consent. In combination with these indicators, vaccination laggards should also be recorded in the future. In this pilot study, students were defined as vaccination laggards if they were not vaccinated on the bus on the day of the intervention but were vaccinated later in the week. In this way, it is possible to determine whether a visit of several days to a school and for which school types this approach makes sense. Also in this context, in the main trial information of vaccination laggards should also be analyzed as to whether other students in the class have already been vaccinated. This can be discussed as an indicator for actual vaccination behavior and the importance of having a role model . Additionally, it is useful to determine to what extent students from intervention groups use the educational components as a cue to action by taking delayed advantage of the on-site vaccination offer. The decision to use anonymous responses to the questionnaires and to document vaccination rates at class level was made explicitly in advance by the study team. This was the product of prior consultation with the schools and possible fears that parents and students might perceive the questionnaire responses as an individual knowledge test and that individual vaccinations or not receiving a vaccination could be traced back to the students. The pilot phase showed that this approach had a positive impact on the willingness to participate from schools, parents and students alike, as this point was repeatedly asked for. Broader documentation of data on vaccination needs, the parental consent process, and the time of take-up of vaccinations should be used in the future to increase the significance of a study.
Testing the previously developed theory- and evidence-based educational unit yielded helpful insights regarding which topics seemed to be of greater relevance to the students. According to the results of the qualitative interviews, for the planned cRCT, we slightly adapted the timing of the contents of the educational unit. This adaptation will result in a stronger focus on infectious diseases and social aspects. Length, thematic focus and interactive content as well as the implementation by a physician were considered positive by the majority of the students and could thus be adopted for the planned study.
The improvement in vaccination-related knowledge [12, 13, 15, 28] and the increase in perceived self-efficacy [12, 14, 18] are in line with previous findings. In terms of the knowledge scale, one item had to be dropped because of problems with understanding and lack of sensitivity to change. Two further items were introduced, both of which addressed complications of infectious diseases.
The findings of this pilot study indicate that it seems possible to increase the vaccination rate for mumps, measles, and rubella as well as tetanus, diphtheria, pertussis, and polio together with vaccination-related knowledge and vaccination-related self-efficacy in students.
Strengths and limitations
The key strengths of our pilot study include the large sample size and the elaborate study design. The design allowed us to test the feasibility and properties under conditions comparable to those of the planned cRCT; furthermore, the design provided opportunities for adjustments and for comparisons of different assessment strategies (e.g., pre-post, post only with and without educational unit).
There are several limitations to this study. First, due to the small number of schools, we were not able to differentiate the feasibility and psychometric properties of the assessment tools on the basis of school type. However, in the planned cRCT, we will be able to account for these variations. For logistical reasons, migration status at the individual level  and a scale assessing SES, including information on the parents , could not be evaluated, but such an evaluation will be possible in the planned cRCT. More detailed information on SES and migration status on an individual level is also important, as studies have shown that vaccination interventions as well as educational interventions vary in their effectiveness as a function of migration status [42, 43]. Finally, although we accounted for confounders statistically, we did not allocate the schools randomly; thus, full control over confounders was not possible, and the results may be biased. The generalizability of the results in terms of change in vaccination coverage is not given here. However, the purpose of this pilot study was to attain insights into the feasibility of access strategies to schools, intervention procedures and psychometric properties, for which the current study design was appropriate. On-site vaccination at schools was also successfully feasible but should be further investigated in a randomized design.
Implications for research, policy and practice
This pilot study has direct implications for the planned main study, particularly with respect to the reliability of the secondary outcome measures (e.g., vaccination-related knowledge) and concerning recruitment and data-handling structures. Furthermore, we showed substantial vaccination rates as well as rates of change regarding increases in knowledge and self-efficacy attributed to the educational unit. Moreover, future research may use the same assessments in other vaccination-related studies, either interventional or observational. We provided findings for the MMR and Tdap-IPV vaccinations; however, future research should include other types of vaccination, such as STI/HPV vaccinations, in the school-based approach [12,13,14,15,16,17,18,19,20]. These findings may also play a role in the context of the COVID-19 pandemic in terms of vaccinating students and staff directly in the school context. Especially with the possibility of regular booster vaccinations (e.g., annually), the Prevention Bus represents an efficient vaccination concept. Furthermore, we developed our intervention and procedures in the capital city of a high-income country. Future studies should test comparable approaches in low- and middle-income countries and in more rural areas, as the effects may be even larger in these regions.
Providing an on-site school-based vaccination program in combination with a health education intervention proved to be feasible and effective. The intervention may simultaneously increase the health literacy levels of adolescents and lower the structural barriers to vaccination. Nevertheless, for other future randomized controlled vaccination trial designs, the affective and implicit/impulsive aspects of vaccination decisions in comparison group designs should be addressed. Nudge theory  and dual process theory  suggest that emotional components, in particular, play a potential role in the school immunization context. Furthermore, this intervention strategy may be cost-effective and scalable and thus constitutes an additional public health strategy that might complement existing endeavors to improve vaccination rates. Data from the planned cRCT can be used to estimate cost-effectiveness and scalability. Subsequently, both the ECC and the LIIC should be reviewed in more detail with regard to a cost-benefit analysis to be able to represent the basis for practical care models of health policy.
We found that a school-based educational and on-site vaccination intervention was feasible regarding recruitment strategies and on-site procedures, and the vaccination-related instruments showed adequate psychometric properties. Further pursuit of this line of research may improve the currently suboptimal vaccination rates and thus help to protect adolescents and people of different ages from infectious diseases.
Availability of data and materials
The datasets generated and analyzed during the current study are not publicly available for participants’ confidentiality but are available from the corresponding author on reasonable request.
We applied a quadruple booster vaccination against tetanus, diphtheria and acellular pertussis (Tdap) together with polio (IPV). The vaccine offered is comparable to vaccinations applied in other studies named DT, DTP, DTaP, Tdap, but varies in antigen content (small vs. capital letters), and included components (polio, pertussis not always included).
cluster randomized controlled trial
varimax-rotated exploratory factorial analysis
linear mixed model
measles, mumps, rubella
tetanus, diphtheria, pertussis, polio
Organisation for Economic Co-operation and Development
World Health Organization
World Health Organization. Global Vaccine Action Plan 2011-2020. In. Geneva, Switzerland; 2012.
World Health Organization. Assessment report of the Global Vaccine Action Plan. Strategic Advisory Group of Experts on Immunization. In. Edited by World Health Organization. Geneva; 2018.
Pan American Health Organization, World Health Organization. Epidemiological Update: Measles. In. D.C.: PAHO/WHO; 2019.
Robert K-I. [Vaccination rates at the initial school examination in Germany 2017] Impfquoten bei der Schuleingangsuntersuchung in Deutschland 2017 Epid Bull 2019, 2019; 18:147–153. DOI:https://doi.org/10.25646/6120.
Robert K-I. [Vaccination rates at the initial school examination in Germany 2015] Impfquoten bei der Schuleingangsuntersuchung in Deutschland 2015. Epid Bull. 2017;2017:137–42. https://doi.org/10.17886/EpiBull-2017-020.
Robert K-I. [Vaccination rates at the initial school examination in Germany 2014] Impfquoten bei der Schuleingangsuntersuchung in Deutschland 2014. Epid Bull. 2016;2016:16):129–42. DOI:https://doi.org/10.17886/EpiBull-2016-024.
Centers for Disease Control and Prevention (CDC). Epidemiology and prevention of vaccine-preventable diseases. Atlanta: US Department of Health & Human Services, Centers for Disease Control and Prevention; 2015.
Takahashi K, Ohkusa Y, Kim J-Y. The economic disease burden of measles in Japan and a benefit cost analysis of vaccination, a retrospective study. BMC Health Serv Res. 2011;11(1):254. https://doi.org/10.1186/1472-6963-11-254.
Bester JC. Measles and measles vaccination: a review. JAMA Pediatrics. 2016;170(12):1209–15. https://doi.org/10.1001/jamapediatrics.2016.1787.
Humiston SG, Schaffer SJ, Szilagyi PG, Long CE, Chappel TR, Blumkin AK, Szydlowski J, Kolasa MS. Seasonal influenza vaccination at school: a randomized controlled trial. Am J Prev Med. 2014;46(1):1–9. DOI:https://doi.org/10.1016/j.amepre.2013.08.021.
Daley MF, Kempe A, Pyrzanowski J, Vogt TM, Dickinson LM, Kile D, Fang H, Rinehart DJ, Shlay JC. School-located vaccination of adolescents with insurance billing: cost, reimbursement, and vaccination outcomes. J Adolesc Health. 2014;54(3):282–8. DOI:https://doi.org/10.1016/j.jadohealth.2013.12.011.
Gottvall M, Tyden T, Hoglund AT, Larsson M. Knowledge of human papillomavirus among high school students can be increased by an educational intervention. Int J STD AIDS. 2010;21(8):558–62. DOI:https://doi.org/10.1258/ijsa.2010.010063.
Grandahl M, Rosenblad A, Stenhammar C, Tyden T, Westerling R, Larsson M, Oscarsson M, Andrae B, Dalianis T, Neveus T. School-based intervention for the prevention of HPV among adolescents: a cluster randomised controlled study. BMJ Open. 2016;6(1):e009875. DOI:https://doi.org/10.1136/bmjopen-2015-009875.
Coyle KK, Glassman JR, Franks HM, Campe SM, Denner J, Lepore GM. Interventions to reduce sexual risk behaviors among youth in alternative schools: a randomized controlled trial. J Adolesc Health. 2013;53(1):68–78. DOI:https://doi.org/10.1016/j.jadohealth.2012.12.012.
Kwan TT, Tam KF, Lee PW, Chan KK, Ngan HY. The effect of school-based cervical cancer education on perceptions towards human papillomavirus vaccination among Hong Kong Chinese adolescent girls. Patient Educ Couns. 2011;84(1):118–22. DOI:https://doi.org/10.1016/j.pec.2010.06.018.
Hill CA, Abraham C. School-based, randomised controlled trial of an evidence-based condom promotion leaflet. Psychol Health. 2008;23(1):41–56. DOI:https://doi.org/10.1080/08870440701619726.
Cox DS, Cox AD, Sturm L, Zimet G. Behavioral interventions to increase HPV vaccination acceptability among mothers of young girls. Health Psychol. 2010;29(1):29. DOI:https://doi.org/10.1037/a0016942.
Rickert VI, Auslander BA, Cox DS, Rosenthal SL, Rupp RE, Zimet GD. School-based HPV immunization of young adolescents: effects of two brief health interventions. Hum Vaccin Immunother. 2015;11(2):315–21. DOI:https://doi.org/10.1080/21645515.2014.1004022.
Wegwarth O, Kurzenhauser-Carstens S, Gigerenzer G. Overcoming the knowledge-behavior gap: The effect of evidence-based HPV vaccination leaflets on understanding, intention, and actual vaccination decision. Vaccine. 2014;32(12):1388–93. DOI:https://doi.org/10.1016/j.vaccine.2013.12.038.
Tull F, Borg K, Knott C, Beasley M, Halliday J, Faulkner N, Sutton K, Bragge P. Short message service reminders to parents for increasing adolescent human papillomavirus vaccination rates in a secondary school vaccine program: a randomized control trial. J Adolesc Health. 2019;65:116–23. DOI:https://doi.org/10.1016/j.jadohealth.2018.12.026.
Underwood NL, Gargano LM, Sales J, Vogt TM, Seib K, Hughes JM. Evaluation of educational interventions to enhance adolescent specific vaccination coverage. J Sch Health. 2019;89(8):603–11. DOI:https://doi.org/10.1111/josh.12786.
Esposito S, Bianchini S, Tagliabue C, Umbrello G, Madini B, Di Pietro G, Principi N. Impact of a website based educational program for increasing vaccination coverage among adolescents. Human Vaccines Immunotherapeutics. 2018;14(4):961–8. https://doi.org/10.1080/21645515.2017.1359453.
Rogers RW. A protection motivation theory of fear appeals and attitude change. J Psychol. 1975;91(1):93–114. https://doi.org/10.1080/00223980.1975.9915803.
Bandura A. Social cognitive theory: An agentic perspective. Ann Rev Psychol. 2001;52(1):1–26. DOI:https://doi.org/10.1146/annurev.psych.52.1.1.
Bandura A. Social foundations of thought and action. Englewood Cliffs; 1986.
Becker MH. The health belief model and personal health behavior. Health Educ Monographs. 1974;2:324–473.
Rosenstock IM. Historical origins of the health belief model. Health Educ Monographs. 1974;2(4):328–35.
Davies C, Skinner SR, Stoney T, Marshall HS, Collins J, Jones J, Hutton H, Parrella A, Cooper S, McGeechan K, et al. ‘Is it like one of those infectious kind of things?’ The importance of educating young people about HPV and HPV vaccination at school. Sex Education. 2017;17(3):256–75. DOI:https://doi.org/10.1080/14681811.2017.1300770.
Forster AS, Cornelius V, Rockliffe L, Marlow LA, Bedford H, Waller J. A cluster randomised feasibility study of an adolescent incentive intervention to increase uptake of HPV vaccination. Br J Cancer. 2017. DOI:https://doi.org/10.1038/bjc.2017.284.
Skinner SR, Imberger A, Nolan T, Glover S, Bowes G. Randomised controlled trial of an educational strategy to increase school-based adolescent hepatitis B vaccination. Aust N Z J Public Health. 2000;24(3):298–304. DOI:https://doi.org/10.1111/j.1467-842x.2000.tb01572.x.
Gellert P, Bethke N, Seybold J. School-based educational and on-site vaccination intervention among adolescents: study protocol of a cluster randomised controlled trial. BMJ open. 2019;9(1):e025113. DOI:https://doi.org/10.1136/bmjopen-2018-025113.
Solomon R. An extension of control group design. Psychological bulletin. 1949;46:137. DOI:https://doi.org/10.1037/h0062958.
Hoffmann T, Glasziou P, Boutron I, Milne R, Perera R, Moher D, Altman D, Barbour V, Macdonald H, Johnston M. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ 2014:348. DOI:https://doi.org/10.1136/bmj.g1687.
Ständige Impfkommission am Robert Koch-Institut (STIKO). [Vaccination recommendations of the German Vaccination Committee (STIKO) at the Robert-Koch Institut - 2016/2017] Empfehlungen der Ständigen Impfkommission (STIKO) am Robert Koch-Institut – 2016/2017. Epid Bull 2016, 34/2016. DOI:https://doi.org/10.17886/EpiBull-2016-051.4.
Deutsches Grünes Kreuz e.V.: [informed consent] Aufklärung - Nr. 7: MMR Englisch/English, Information, Combination vaccination against measles, mumps and rubella. In: Informationsmaterialien zum Impfen [Information material on vaccination]. Edited by Robert-Koch Institut. https://www.rki.de/DE/Content/Infekt/Impfen/Materialien/Downloads-Tdap-IPV/Tdap-IPV-englisch.pdf;jsessionid=439C7AB283EC432C997159384FDF666A.2_cid390?__blob=publicationFile; 2014.
Deutsches Grünes Kreuz e.V.: [informed consent] Aufklärung - Nr. 28: Tdap-IPV Englisch/English, about vaccinations against tetanus (lockjaw), diphtheria, pertussis (whooping cough), and polio (poliomyelitis). In: [Information material on vaccination] Informationsmaterialien zum Impfen Edited by Robert-Koch Institut. https://www.rki.de/DE/Content/Infekt/Impfen/Materialien/Downloads-Tdap-IPV/Tdap-IPV-englisch.pdf;jsessionid=439C7AB283EC432C997159384FDF666A.2_cid390?__blob=publicationFile; 2014.
Sørensen K, Van den Broucke S, Pelikan JM, Fullam J, Doyle G, Slonska Z, Kondilis B, Stoffels V, Osborne RH, Brand H. Measuring health literacy in populations: illuminating the design and development process of the European Health Literacy Survey Questionnaire (HLS-EU-Q). BMC Public Health. 2013;13(1):948. DOI:https://doi.org/10.1186/1471-2458-13-948.
Currie C, Molcho M, Boyce W, Holstein B, Torsheim T, Richter M. Researching health inequalities in adolescents: the development of the Health Behaviour in School-Aged Children (HBSC) family affluence scale. Soc Sci Med. 2008;66(6):1429–36. DOI:https://doi.org/10.1016/j.socscimed.2007.11.024.
Boyce W, Torsheim T, Currie C, Zambon A. The family affluence scale as a measure of national wealth: validation of an adolescent self-report measure. Soc Indic Res. 2006;78(3):473–87. DOI:https://doi.org/10.1007/s11205-005-1607-6.
Schenk L, Bau A-M, Borde T, Butler J, Lampert T, Neuhauser H, Razum O, Weilandt C. [Minimum set of indicators to measure migration status] Mindestindikatorensatz zur Erfassung des Migrationsstatus. Bundesgesundheitsblatt-Gesundheitsforschung-Gesundheitsschutz. 2006;49(9):853–60. DOI:https://doi.org/10.1007/s00103-006-0018-4.
Delekat D, Kis A: [Health Monitoring Berlin - Special Report 2001 - 1 - The health situation of children in Berlin] Gesundheitsberichterstattung Berlin - Spezialbericht 2001 - 1 - Zur gesundheitlichen Lage von Kindern in Berlin. In. Berlin; 2001.
Walter D, Atzpodien K, Pins C, Wichmann O, Reiter S. [Factors influencing the uptake of vaccines by adolescents with migration background. A qualitative study of adolescents, mothers, and physicians] Einflussfaktoren auf die Inanspruchnahme von Impfungen durch Jugendliche mit Migrationshintergrund. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2013;56(10):1368–75.
Centers for Disease Control and Prevention: National, state, and local area vaccination coverage among adolescents aged 13-17 years–United States. MMWR Morb Mortal Wkly Rep. 2010, 2010;59:1018–1023.
Thaler R. Nudge: Improving Decisions about Health, Wealth and Happiness. Yale University Press; 2008.
Groves P, Thompson R. Habituation: a dual-process theory. Psychological review. 1970;77:419. DOI:https://doi.org/10.1037/h0029810.
The authors would like to thank the entire Prevention Bus team of Charité – Universitätsmedizin Berlin, including physicians, nurses and our bus driver for their positive influence on the project during the planning and first implementation phase. We would also like to thank our team in the office for their support in planning and recruiting, as well as the Chief Medical Officer of Charité, Prof. Dr. Ulrich Frei for his continuous support of the research team. Furthermore, we would like to thank all headmasters, teachers, secretaries, parents and students who participated in the pilot study and gave valuable feedback on our procedures on-site as well as on the educational unit. We would also like to thank Lutz Fournell who, with his confident commitment, made the start of the pilot so efficacious. Additionally, we would like to thank Gudrun Widders, medical officer, head of the health department of Spandau (a district of Berlin) for her valuable support in the pilot study. Further, we acknowledge support from the German Research Foundation (DFG) and the Open Access Publication Fund of Charité – Universitätsmedizin Berlin. We also would like to thank Franka Brüggen for her background research and Ariadne Brandt for her translation work and language review.
Open Access funding enabled and organized by Projekt DEAL. The study was funded by the German Federal Ministry of Health (BMG; Grant number 1503/53105). The BMG was not involved in the study design, data collection, the analysis, interpretation of the data, nor in the writing of the manuscript.
Ethics approval and consent to participate
The Ethics Committee of the Charité – Universitätsmedizin Berlin, approved the procedure of the main trial, which was also used in the pilot study (EA1/059/17). All students, including those underage (under 18 years), were asked for their written consent right before vaccination took place. Parental written consent was obtained in advance, in case students were underage. For students under the age of 15, written parental consent was additionally reconfirmed by phone with the parent.
Consent for publication
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Bethke, N., Gellert, P., Knoll, N. et al. A school-based educational on-site vaccination intervention for adolescents in an urban area in Germany: feasibility and psychometric properties of instruments in a pilot study. BMC Public Health 22, 60 (2022). https://doi.org/10.1186/s12889-021-12443-8