Skip to main content

Can uptake of childhood influenza immunisation through schools and GP practices be increased through behaviourally-informed invitation letters and reminders: two pragmatic randomized controlled trials

Abstract

Background

The UK is rolling out a national childhood influenza immunisation programme for children, delivered through primary care and schools. Behaviourally-informed letters and reminders have been successful at increasing uptake of other public health interventions. Therefore, we investigated the effects of a behaviourally-informed letter on uptake of the vaccine at GP practices, and of a letter and a reminder (SMS/ email) on uptake at schools.

Methods and results

Study 1 was a cluster-randomised parallel trial of 21,786 two- and three-year olds in 250 GP practices, conducted during flu season (September to January inclusive) 2016/7. The intervention was a centrally-sent behaviourally-informed invitation letter, control was usual care. The proportion of two- and three-year olds in each practice who received a vaccination by 31st January 2017 was 23.4% in the control group compared to 37.1% in the intervention group (OR = 1.93; 95% CI = 1.82, 2.05, p <  0.001).

Study 2 was a 2 (behavioural letter vs standard letter) × 2 (reminder vs no reminder) factorial trial of 1108 primary schools which included 3010 school years 1–3. Letters were sent to parents from providers, and reminders sent to parents from the schools. In the standard-letter-no-reminder arm, an average of 61.6% of eligible children in each school year were vaccinated, compared to 61.9% in the behavioural-letter-no-reminder arm, 63.5% in the standard-letter-plus-reminder arm, and 62.9% in the behavioural-letter-plus reminder condition, F(3, 2990) = 2.68, p = 0.046. In a multi-level model, with demographic variables as fixed effects, the proportion of eligible students in the school year who were vaccinated increased with the reminder, β = 0.086 (0.041), p <  0.036, but there was no effect of the letter nor any interaction effect.

Conclusion

Sending a behaviourally informed invitation letter can increase uptake of childhood influenza vaccines at the GP surgery compared to usual practice. A reminder SMS or email can increase uptake of the influenza vaccine in schools, but the effect size was minimal.

Trial registration

Study 1: Trial registration: ClinicalTrials.gov Identifier: NCT02921633.

Study 2: Trial registration: ClinicalTrials.gov Identifier: NCT02883972.

Peer Review reports

Introduction

In 2012, the UK Joint Committee on Vaccination and Immunisation recommended a national childhood influenza immunisation programme be rolled out to 2- to 16-year olds, using a live attenuated influenza vaccine [1]. Roll out of the programme began in 2013/14 with 2- and 3-year olds offered the vaccine through general practice and seven pilot areas offering the vaccine to primary school-aged children mostly in the school setting. By 2016/17 the programme had expanded to include 2- to 6-year olds nationally. In pilot areas the vaccine continued to be offered to all primary school aged children.

In 2015/16 nationally, uptake in school years 1 and 2 was 53.6% [2]. In the pilot areas offering the vaccine to all primary school children (5–11 years), the overall uptake of vaccination in 5–11 years olds was 57.9% in 2015/6, which was a lower uptake than the 60.4% achieved in the previous year, 2014/5. The pilot areas also had lower uptake as age increased, with 62.6% in Year 1 and 54.7% in Year 6 in 2015/16 (see also [3]). Delivery methods had considerable impact on uptake, with higher uptake in those areas that delivered flu immunisation through schools (55.6%) than General Practices (GPs) (32.9%) and/or pharmacies (16.1%). There may be higher uptake in schools because parents feel the setting is an advantage, since it avoids the inconvenience of having to take their child to the GP, as well as there being beneficial effects of children being vaccinated in the company of their classmates [4,5,6]. Analysis has also shown that uptake is associated with deprivation and ethnicity. Children in the poorest deprivation quintile have been shown to be 19% less likely to receive influenza vaccine than those in the wealthiest quintile [3], and areas that have a higher percentage of black and ethnic minority (BAME) population have been shown to have a lower uptake: 14.5% lower uptake in those areas in the highest quartile (> 34% BAME) compared to the lowest quartile (< 5% BAME) [7].

National template letters are published on the Annual Flu Programme website,Footnote 1 for general practices and immunisation providers for schools to use. The letter for immunisation that is posted to parents/guardians from general practice asks them to book an appointment and to take their child to the practice to receive the immunisation. The letter for immunisation from schools asks parents/guardians to complete and return an enclosed consent form. While uptake in schools is higher than in general practice or pharmacies, there remains approximately 30% of children for whom consent is neither given nor actively withheld [8].

Much of the literature on vaccine uptake focusses on vaccine hesitancy and on knowledge, attitudes and beliefs about vaccines (e.g. [4, 9,10,11,12]). However, barriers to childhood vaccinations also include access issues, such as parents who might want their child to be vaccinated but experience difficulties in gaining an appointment [13]. People may intend well, but intentions do not always translate into action [14]. There is a role for interventions that change health behaviours by targeting environmental stimuli, in order to move them to action [15].

Applying behavioural science to invitation letters can increase the uptake of health interventions. For example, a 4% increase in the uptake of the NHS Health Checks was achieved by simplifying the invitation letter and adding a tear-off slip where individuals could note the time and date of their first appointment, as a memory aid [16]. Behaviourally-informed letters have also been effective at getting parents to take action on behalf of their children: an enhanced National Child Measurement Programme (NCMP) letter sent to parents of children with a higher than normal body mass index (BMI) led to them being more likely to enroll their children in weight management services [17].

Reminders can also increase uptake of interventions, with text message reminders having been successful at increasing uptake of NHS Health Checks [18] and breast cancer screening [19]. A randomised controlled trial (RCT) that sent text-message reminders for the influenza vaccination to at-risk adults under 65 years reported a 2.6% increase in uptake, but this was not statistically significant [20]. Both telephone and text message reminders have been shown to increase attendance at hospital appointments [21,22,23].

In 2016/17 Public Health England Behavioural Insights (PHEBI) worked with NHS England and Public Health England (PHE) immunisation team to redesign the template invitation letters for general practice and primary schools. In this paper we report on two RCTs, the first clustered at the GP level, and the second at school level, to test whether behaviourally-informed letters can increase uptake of the childhood influenza (flu) vaccination. In both cases, clustering was a pragmatic choice to deliver the intervention and reduce the potential for cross-treatment contamination.

Study 1: cluster-randomized controlled parallel trial of the effect of a behaviourally-informed letter on childhood flu vaccination uptake in general practice

Aim

To test whether a behaviourally-informed invitation letter will increase uptake of childhood flu vaccine in general practice (compared to standard practice).

Methods

The trial was registered at ClinicalTrials.gov on 03/10/2016 at NCT02921633. This was a cluster randomised controlled parallel trial using stratified randomisation. Participants were children aged 2 and 3 years on 31st August 2016 registered at 257 GP practices in seven Clinical Commissioning Groups (CCGs) in the area covered by the Immunisation and Screening Team of PHE East of England / NHS England Midlands & East (NHS Mid Essex, NHS North East Essex, NHS Thurrock, NHS West Essex, NHS Basildon and Brentwood, NHS Castlepoint and Rochford and NHS Southend CCG). CCGs are groups of general practices (GPs) which come together in each area to commission the best services for their patients and population. GP practices were the unit of randomisation.

Interventions

Parents of eligible children at practices in the intervention arm were sent the behaviourally-informed invitation letter by post with minimal local adjustments (e.g. reflecting the sender and flu clinic booking arrangements). A number of behavioural techniques were used, several of which were coded according to the Behavioural Change Technique (BCT) Taxonomy [24]. The letter included the GP practice name, as the NHS is a trusted and credible source when it comes to health issues (BCT 9.1: Credible source). The letter was reduced in length, simplified and made more salient by highlighting key points or actions required, thereby reducing the cognitive effort required to process the information and identify the action required [25,26,27,28]. It was personalised with the name of the child and the parent, increasing the letters personal relevance, and had a tear-off slip where individuals could note the time and date of their appointment, addressing implementation intentions (BCT 1.4: Action planning and goal achievement [29]).

Other behavioural techniques that were used included framing the message as a gain (‘This vaccination programme is in place to help protect your child against flu’ - BCT 13.2: Framing), providing information about the health consequences of flu and salience of consequences (‘Flu can be an unpleasant illness and sometimes causes serious complications’ - BCT 5:1: Information about health consequences and 5.2: Salience of consequences), providing information about social and environmental consequences [24] (‘Vaccinating your child will also help protect more vulnerable friends and family by preventing the spread of flu’ - BCT 5.3: Information about social and environmental consequences) and framing and reducing friction by eliminating the barrier of cost (‘The vaccination is free and recommended for young children … ’ - BCT 13.2: Framing). A full list of the behavioural techniques utilised and their rationales can be found in Table 1. A copy of the letter can be found in Supplementary Material 1.

Table 1 Behavioural-science informed changes to the flu invitation letter and their rationale

The letters were sent centrally by the Child Health Information System (CHIS) team on behalf of the practice between 21 and 25 October 2016.

Parents of eligible children registered at general practices in the control arm were only provided with the usual communication from their practice. GPs are contracted to call and recall for immunizations. The National Institute of Health and Care Excellence (NICE) recommends contacting people for immunisations by a variety of methods, including text messages, letters, emails, phone calls from staff or an auto dialler, social media, or a combination of methods, as well as informing and inviting people during face-to-face interactions whenever the opportunity arises [30].

We surveyed the GP practices to obtain information on their invitation communication with parents; 25% (63 out of 257) practices responded to the survey. The majority of practices confirmed that they had invited all eligible patients (76%), 17% to some parents and only one practice to no parents. Whilst the majority of practices reported sending letters to some or all parents, practices also used phone calls, text messages and opportunistic occasions. Recall was however less frequently undertaken by practices.

Outcomes

The pre-registered primary outcome for this study was immunisation uptake by eligible children (i.e. those aged 2 and 3 years on 31st August 2016) at primary care. Anonymised individual-level data was extracted from the CHIS on 28th March 2017. This included flu vaccine history in 2016/17 and 2015/16 flu seasons, age, gender, and GP practice.

Sample size

The sample was fixed as all practices in the participating areas. Power calculations indicated that, with 120 general practices, we would have 90% power to detect a 5% absolute increase in uptake, from 34 to 39% in children aged 2–3 years.

Randomisation

A stratified randomisation strategy was used. In total 14 strata were created (all of the possible combinations of the seven CCGs and whether or not they were SystmOne users: SystmOne is a software system used in some practices; the databases of practices with SystmOne were automatically updated with a copy of the letter sent on the patient’s record and any flu immunisations recorded on the GP practice system were automatically transferred to CHIS, whereas other practices may have done this manually). Randomisation was by general practice. General practices within each strata were randomly assigned to the intervention group (Group 1) or control group (Group 2). A code was developed in Stata by researchers at PHE to randomise practices. General practices in the intervention group were informed that CHIS was sending an invitation letter to the parents of two- and three-year olds as part of a trial to try to increase immunisation uptake. Parents were not informed that the letters were being sent as part of a trial. General practices in the control group were not informed about the trial.

Statistical methods

Classical linear logistic regression models were run, with a binary outcome variable equal to 1 if an eligible child was vaccinated, and 0 otherwise. The models included previous vaccination and demographic variables (age and sex) as fixed effects, in addition to the intervention. It also included GP practice as a random effect, to account for variation not explained by the fixed effects. Analyses were carried out using R, version 4.0.0.

Results

In total, 257 GP practices were randomised into the two conditions; however, 7 practices were subsequently dropped because they closed. This left 21,786 patients across 250 GP practices who were included in the analysis. Across the practices, there was a median of 73 patients with an interquartile range of 75. There were 125 GP practices with 10,698 eligible patients in the control condition and 125 practices with 11,088 eligible patients in the intervention. Figure 1 shows the participant flow diagram for this study.

Fig. 1
figure 1

GP Flu participant flow diagram

The demographics recorded in this study were not significantly different between the intervention and the control group (see Table 2.)

Table 2 Counts and percentages showing breakdown of demographic variables across groups and chi-square tests of independence

The proportion of children who were vaccinated was higher in the intervention group, who were sent the behavioural insights letter (37.1%, n = 4113) than the control group, who were not sent the letter (23.4%, n = 2499), OR = 1.93; 95% CI = 1.82, 2.05, p <  0.001. This represents a 13.7% change in absolute terms and a 48.8% increase in relative terms.

Model 1 showed that after controlling for demographic variables, the intervention group were significantly more likely to be vaccinated than the control group (OR = 2.24; 95% CI = 1.67, 3.00, p <  0.001). This conclusion remained unchanged after adding interaction effects in Model 2 (OR = 2.02; 95% CI = 1.49, 2.75, p <  0.001). Although there were statistically significant differences in vaccination rates across GP practices and across CCGs, there is no evidence to reject the hypothesis that there was an equal effect of general practice variation across intervention and control groups, since there were no significant differences between the slopes for intervention across general practices (χ2 (2) =0.09, p = 0.96) or across CCGs (χ2 (2) =4.18, p = 0.12). The results of the models can be found in Table 3.

Table 3 Logistic regression models predicting the odds of being vaccinated

There were no significant differences between males and females in either model (Model 2: OR = 0.96; 95% CI = 0.87, 1.05, p = 0.37). There was a statistically significant interaction between gender and receiving the intervention (Model 2: OR = 1.16; 95% CI = 1.02, 1.32 p = 0.024). Children aged 3 years were slightly less likely to receive a vaccine but this was not significant (Model 1: OR = 0.94; 95% CI = 0.88, 1.01, p = 0.08). There was no statistically significant interaction between age and receiving the intervention (OR = 1.06; 95% CI = 0.93, 1.21, p = 0.36).

Children who had previously been vaccinated were more likely to be vaccinated (these could only have been 3-year olds, since 2-year olds were not eligible the previous year) and the effect remained significant after adjusting for variation in general practices (OR = 4.33; 95% CI = 3.28, 5.72, p <  0.001). There was no evidence of a statistically significant interaction between previous vaccination and receiving the intervention (OR = 0.83; 95% CI = 0.55, 1.24, p = 0.36).

Practices who used SystmOne reported higher uptake, (Model 2: OR = 5.77; 95% CI = 3.94, 8.45, p <  0.001).

Study 2: randomized controlled trial of the effect of a behaviourally-informed letter and a reminder on childhood flu vaccination uptake schools (factorial design)

Aim

The aim of this study was to determine whether applying behaviourally-informed interventions to the invitation process will improve uptake of childhood flu immunisation in school-based programmes.

Our specific hypotheses were:

  1. 1.

    Behaviourally-informed changes to the invitation letter will increase uptake of childhood flu vaccine in schools.

  2. 2.

    A reminder to return the consent form will increase uptake of childhood flu vaccine through schools

By using a factorial design, we were also able to investigate any interactions between the behaviourally-informed letter and the reminder.

Methods

The trial was registered at ClinicalTrials.gov on 30/08/2016 at NCT02883972. This was an RCT with a 2 (behavioural letter vs. standard letter) × 2 (reminder vs no reminder) factorial design. Five of the six providers of childhood flu school vaccination in the Wessex, Leicester and Essex NHS England area teams agreed to take part (Solent NHS Trust, Dorset Healthcare University NHS Foundation Trust, Leicestershire Partnership NHS Trust, Boots UK and South Essex Partnership University NHS Foundation Trust). All primary schools in participating areas were eligible for inclusion. Each school vaccination session took place during a school day in the Autumn term. In the UK, parents are not required to be present for childhood vaccinations. The exact time and date of the sessions were chosen on a school-by-school basis. The trial took place from October to December 2016 during the delivery of the winter 2016/7 school-based flu vaccination programme.

Interventions

Intervention 1: Behaviourally-informed letter

A behaviourally-informed letter was sent via post by providers of childhood flu school vaccination to parents at those schools randomised to Intervention 1, with minimal local adjustments. The behavioural techniques used were the same as the ones used in the general practice trial except there was no personalisation (this was not feasible, since exactly the same letter is sent to all parents) or a tear-off appointment time slip (because the required action was returning a consent form, not booking an appointment). The schools letter also included a positive social norm statement (Last year, most children offered the vaccine in school had the immunisation’ – BCT 6.2: Social comparison). The formatting and phrasing, and the associated rationale for them are summarised in Table 4. A copy of the letter can be found in Supplementary Material 2. In all groups, schools gave out letters and an information leaflet, with information such as the possible side-effects of the vaccine, to children to take home to their parents.

Table 4 Behavioural insights informed changes to the flu invitation letter and rationale

Parents at schools randomised to a control letter group were given usual practice, a standard letter invitation letter sent to all parents from the provider. They were sent the letter used by the immunisation provider during the previous year (with necessary updates). These letters varied from area to area.

Intervention 2: reminder

Schools randomised to a reminder group were asked by the local immunisation team to send a timely reminder message to parents through their usual email or SMS system. The reminders were sent 2 days before the deadline for returning the consent form for pragmatic reasons of implementation. The reminder messages were informed by behavioural insights and were action-orientated with a focus on scarcity and anticipated regret in both messages (e.g., “ensure your child doesn’t miss out” and “There will be only one vaccination session at the school”). The SMS and email reminder messages are shown in full in Table 5. Immunisation teams were given a standard operating procedure detailing how to make this request to schools. All schools had either email or SMS systems to communicate with parents.

Table 5 Text for SMS and email reminder messages

Schools in the control group for the reminder message were not specifically asked to send a reminder, so they did whatever would be usual practice, but we would not expect this to include a reminder.

We endeavoured to collect data on the implementation of the trial to understand how rigidly the protocols were being applied locally and what usual practice was. This unfortunately proved difficult and data could not be obtained. Nonetheless, we assessed whether providing schools with recommended text for reminder messages, and the request that they send reminders increased uptake.

Outcomes

The pre-registered primary outcome for this study was the proportion of eligible children in the school years for each of years 1–3 (i.e. those aged 5 to 7 years on 31st August 2016) who received influenza immunisation as part of the national childhood immunisation programme. We focused only on children in years 1–3 during the 2016/17 winter season as they were the target age group for the national childhood influenza immunization campaign. The secondary outcomes also pre-registered were the proportion for whom the consent form was returned, the proportion of consent forms returned with consent granted, and the proportion of consent forms returned with consent denied.

Data collection

Immunisation programme data were collected by providers of childhood flu school vaccination on a PHE template spreadsheet. Providers submitted school-level data throughout the 2016/17 flu season and the data used was submitted as part of usual practice. No individual-level data or personal identifiable information were collected by the study team.

Data on characteristics of the schools were obtained from the publicly available ‘Compare school and college performance’ UK government website.Footnote 2 This included information on the proportion of children eligible for free school meals, the religious denomination of the school, and the type of school (state-funded primary, state-funded secondary, or independent). The postcode of schools was linked to Index of Multiple Deprivation (IMD) data using http://imd-by-postcode.opendatacommunities.org/ to obtain a quintile ranking for the school location. The top 20% were coded as deprived.

Sample size

The sample was fixed by the number of schools in participating areas. Power calculations indicated that with the original number of schools available (~ 1700 schools and six providers) and assuming no variation between local authorities and an average of 100 children in years 1–3 in each school, we would have 90% power to detect a 1% absolute increase in uptake, from 63 to 64%.

Randomisation

A stratified method of randomisation was used with each local authority representing a separate strata. Randomisation was at school level. The intervention was a 2 × 2 factorial design, with schools within each strata randomly assigned to one of four interventions arms, one for each combination of interventions. For every school, a random number between − 1 and 1 was drawn from a uniform distribution. The schools were ordered according to the random number that had been generated for them; then the lowest 25% were assigned to Arm 1, the next 25% Arm 2 and so on. This was done separately for each strata. We did not know at the time of randomisation which schools had email/SMS systems, so we did not include this in the randomisation.

Providers knew which school was in each arm, but neither the schools nor the parents who received the interventions knew that they were in a trial.

Statistical methods

We used multi-level Generalised Linear Model (GLM) regression models to predict the proportion of eligible children in the school year receiving a vaccine, with school year and school as random effects, and demographic variables as fixed effects. As random effects are included in the model there is no need to cluster standard errors. Analyses were carried out using Stata, Version 15.

Results

At randomisation there were 1358 schools and five providers in the trial. After excluding schools for which data were not available (one provider decided not to participate after randomisation.n = 44 and other reasons such as the school having closed), there were 1283 schools remaining. Only school years 1, 2 or 3 were included in the analysis (schools labelled as state-funded secondary schools (n = 6: 0.5%) were excluded as there were no state-funded secondary schools in the control or letter condition groups). Data for some of our independent variables (student ethnicity and free school meal eligibility) was not available for independent schools. Therefore, we excluded the independent schools from the analysis. We further excluded those school-years where the number of forms received or doses given was greater than the number of pupils on roll and where no children were recorded as being on roll. Fig. 2 shows the participant flow diagram for this study.

Fig. 2
figure 2

School Flu participant flow diagram

After exclusions, there were four providers with 1108 schools and 3010 school years in the analysis. For 892 (80.4%) of schools we observed 3 school years of childhood vaccination behaviour (Year 1, 2, and 3). Across the school years, there was a median of 42 children eligible for a vaccination, with an interquartile range of 34 (from 26 to 60).

Some of the demographic variables were not distributed evenly across groups (see Table 6). These were the percentage eligible for free school meals F(3, 2990) = 2.88, p = 0.035; the religious denomination of the school χ2 (15) = 57.41, p <  0.001; and whether the school was in an urban or a rural location, χ2 (3) = 13.226, p = 0.004.

Table 6 Outcome measures and breakdown of demographic variables across experimental conditionsa

The proportion of eligible children in the school year who received a vaccination differed across groups, F(3, 3010) = 2.62, p = 0.049: In the control group, an average of 61.6% of eligible children in each school year were vaccinated, compared to 61.9% in the letter group, 63.5% in the reminder group, and 62.9% in the letter and reminder group (see Table 6). When a multi-level model was run that included school and school year nested within school as random effects, which adjusted for demographic variables, there was a statistically significant increase in vaccination rates due to the reminder β = 0.086, p = 0.036. However, there was no effect of the letter, β = 0.029, p = 0.476, or the interaction of letter and reminder β = − 0.036, p = 0.533. The full model is shown as Model 1 in Table 7.

Table 7 Multi-level GLM models predicting the outcomes, school and school year nested in schools as random effects*

Of the demographic factors, the percentage of pupils in the school who receive free school meals was negatively associated with uptake, β = − 0.017, p <  0.001, as was the percentage of students of Black ethnicity and percentage of Asian ethnicity, both of which had β = − 0.012, p <  0.001. There was no statistically significant effect of the school being a faith school associated with a particular religious denomination, being in the most deprived quintile by postcode, or being urban (versus rural). Variation remained between schools (var = 0.165, p <  0.001) and between school year nested in schools (var = 0.042, p <  0.001). The full model is shown in Model 1, Table 7.

The interventions increased the proportion of eligible children whose consent form was returned: In the control group, an average of 73.6% of eligible children in each school year returned their consent forms, compared to 75.7% in the letter group, 76.2% in the reminder group, and 76% in the letter and reminder group (see Table 6). When a multi-level model was run that included school and school year nested within school as random effects, which adjusted for demographic variables, there was a statistically significant effect of the letter (β = 0.129, p = 0.03) and of the reminder, (β = 0.150, p = 0.01), but no evidence of an effect of the interaction of letter and reminder (β = − 0.118, p = 0.16). See Model 2 in Table 7.

Receiving the reminder led to an increase in the proportion of eligible children for whom consent was granted, β = 0.100, p = 0.01; neither the letter nor the interaction of letter and reminder had statistically significant effects (see Model 3, Table 7). In the control group, an average of 64.9% children in each year had consent granted, compared to 65.5% in the letter only group, 67% in the reminder group and 66.3% in the letter and reminder group (see Table 6).

However, receiving the reminder led to an increase in the proportion of eligible children for whom consent was granted, β = 0.100, p = 0.01 neither the letter nor the interaction of letter and reminder had statistically significant effects (see Model 4, Table 7). In the control group, an average of 8.6% children in each year had consent refused, compared to 10.2% in the letter only group, 9.2% in the reminder group and 9.7% in the letter and reminder group (see Table 6).

Some schools had very small numbers of pupils and our results were robust to their exclusion from the analyses. We reran the model of our primary outcome variable (Model 1 in Table 7), excluding all year groups with less than ten pupils (144 datapoints). This did not have any effect on which variables had a statistical significance of p <  0.05.

Discussion

We explored the effects of a behaviourally-informed letter on uptake of childhood influenza vaccination in general practices, and of a letter and a reminder (SMS/email) on uptake at schools. The behaviourally-informed, centrally sent invitation letter increased the proportion of children who received a vaccination at their general practice in absolute terms by 13.7% (from 23.4 to 37.1%). The effect of the invitation letter remained significant after adjusting for demographic variables and interaction effects, with children in the intervention group being more likely to be vaccinated than the control, OR = 2.17, p <  0.001, which is a medium-sized effect [31].

The effect of the interventions in schools was much smaller, though still statistically significant, with uptake ranging from 61.6% of the school year in the control group, who received the standard invitation letter and no reminder, to 63.5% in the group who received the standard letter and a reminder, an increase of almost 2% in absolute terms. In a fully adjusted model receiving a reminder had a statistically significant effect on vaccine uptake, β = 0.086, p = 0.036, but the behaviourally informed letter did not have a statistically significant effect.

Our behaviourally-informed letter increased uptake of the flu vaccine in general practice but it did not increase uptake in schools. In both studies, the control groups received usual practice. In the schools study, there was a standard letter invitation letter sent to all parents from the provider. In the general practice study, control practices and intervention practices may have sent parents an invitation letter, issued an opportunistic invitation, or not sent an invitation at all directly. GPs are contracted to call and recall for flu vaccinations. The National Institute of Health and Care Excellence (NICE) recommends contacting people for immunisations by a variety of methods, including text messages, letters, emails, phone calls from staff or an auto dialler, social media, or a combination of methods, as well as informing and inviting people during face-to-face interactions whenever the opportunity arises [30]. However, we do not know if the GP practices actually issued invitations; the comparison with the schools study suggests that they may not. It is important that they send letters because parents may expect an invitation for their child’s vaccinations; failing to receive one can be a reason for not attending [13]. Therefore, it may be the fact that our invitation was centrally-issued rather than the specific behavioural content that led to the increase in uptake; sending parents invitations is important.

There were some differences between the behavioural letter in the general practice and the schools study. The schools letter did not use personalisation, as that could not be implemented; nor was there was a tear off slip for an appointment, since the action was to complete and return the consent form. The schools letter had a positive social norms statement that was not in the GP letter. Since these differences between the letters are confounded with the difference in controls, we cannot be completely sure that the difference in effectiveness was due to the control (receipt of a letter invitation vs usual practice) or due to the differences in the letter (personalisation vs than norms).

Another difference between the GP and the schools trials is that the school-based programme sends a leaflet with the invitation letter, which has information about side-effects. In the behaviourally-informed letters, we did not address concerns about the vaccine’s effectiveness and side-effects, which have been shown to cause influenza vaccine hesitancy in parents [4, 9,10,11,12,13]. In other health domains, such as the NHS Health Check, letters that gave counter-arguments to common reasons for not attending have proved successful in increasing uptake [32]. However, a trial of behaviourally-informed patient information leaflets for the NHS Health Check leaflet did not find a significant effect, possibly because people do not pay attention to leaflets enclosed with invitation letters [33]. The effect of addressing concerns about vaccine hesitancy within the letter is a potential future avenue for research.

In an intention-to-treat analysis, our reminder led to a small increase in the proportion of children being vaccinated in schools, at the cost of an additional workload for schools. We collected data on fidelity to the study protocol in Dorset and the fidelity was poor: the providers did not necessarily use the wording that we gave them. We also found that a lot of the control schools were sending out reminders. We expect that the reminder would have increased uptake by increasing the return of consent forms; we found that both the letter and the reminder increased the number of consent forms returned (with no interaction effect), with increases in the proportion of forms returned of up to 2.6% in the reminder only condition compared to the control, taking the percentage for forms returned up to 76%. But there were still ~ 25% of parents who were not returning the consent forms in each condition, which suggests that there may be further scope for interventions that target the return of consent forms, especially given that 92.7% of people in the UK agree that vaccines are important for children to have [34]. Other techniques to improve uptake could include electronic consent, with parents consenting by SMS or email in reply to the reminder, or sending parents multiple reminders. However, the effect of sending one reminder was small and one might already ask questions about its cost effectiveness. Multiple reminders would further increase the workload for schools, with possibly diminishing returns.

Further, we found that the proportion of forms returned with consent refused increased when the intervention letter was sent, with increases of up to 1.6% in the letter only condition, taking refusals up to 10%. While reminders can be effective for parents who want their child to be vaccinated but do not get around to it [13], there is a ceiling effect on the effectiveness of reminders because we would not expect them to affect people who are vaccine hesitant. In the UK, 85.4% agree that the seasonal influenza vaccine is safe and 80.7% that it is important [34]. Parents may also decline the vaccine for faith reasons, due to the presence of porcine gelatine in the vaccine [4]. Again, this could contribute to a ceiling effect on reminders; in the UK, 81.6% agree that vaccines are compatible with their religious belief [34]. For those groups who are vaccine hesitant, and would actively refuse to let their children be vaccinated, we will need to design interventions that target the causes of their vaccine hesitancy.

This could also be an explanation for why our GP trial had larger effects. The baseline uptake rate in schools is higher than in general practice, so the interventions in schools are more likely to have been subject to a ceiling effect. The difference in baseline uptake rate is not surprising. The two settings target children of different ages, with the school children being older than those vaccinated in general practice, and data suggests that vaccine uptake decreases as age increases [35]. Because the schools vaccine programme already has a higher uptake, it may already have reached many of the parents who would accept a vaccine for their children. If many of the remaining parents are vaccine hesitant, then an approach that specifically targets the causes of their vaccine hesitancy may be needed to increase uptake.

Across all groups in the school study, we found that uptake of the vaccination decreased with the percentage of children in the school who were eligible for school meals, β = − 0.017, p <  0.001, and with the percentage of Black and Asian students, both β = − 0.012, p <  0.001. This is consistent with prior analyses, which have shown that there is lower uptake for children in higher areas of deprivation [3] and children of non-White ethnicity [7]. However, we do not know whether there were differences in the effectiveness of the intervention across demographic groups.

In the general practice study, children who had been vaccinated the previous year were more likely to be vaccinated, OR = 3.83, p <  0.001 a medium-large effect [31]. This could only apply to 3-year olds, as 2-year olds would have been too young to be eligible the previous year. However, it is not just an effect of age, since the model controlled for the age of the child, which was not statistically significant. There was no differential effect of the intervention across those who had and had not received a vaccination the previous year. Practices who used SystmOne had higher uptake. This could reflect a difference in practices who choose to use the SystmOne software or be due to SystmOne itself, which extracts immunization data automatically, rather than relying on manual input.

In the general practice study, we found variation between practices and CCGs, and in the school study we found variation between both school years and schools, suggesting that there are practice/school level factors that influence uptake. The CCG-level differences are consistent with other data, which shows that uptake of the flu vaccine for 2- to 3-year olds varies from 19 to 61% across CCGs [7]. In the case of the GP practices, there is no evidence of difference in the amount of practice variation between the intervention and control groups. In the case of the schools, some of the inter-school variation was probably accounted for by the differing demographics of the schools, since the variation decreased when we put demographic factors into the model. However, it remained statistically significant even after the addition of demographic control variables.

Limitations

Process evaluations for each study, which would have enhanced our contextual understanding of the study outcomes, were not conducted. Future research investigating the effectiveness of behaviourally-informed letters should therefore undertake process evaluation to better understand how and why the interventions may be effective. Also, the trials were not designed to be compared. As such there are many differences between the two trials (i.e., setting, age group, and trial design) which make comparing the results from each trial to better understand the determinants of an effective letter intervention difficult.

Conclusion

Sending a behaviourally-informed invitation letter can increase uptake of childhood influenza vaccines at the GP surgery compared to usual practice. A reminder SMS or email, which follows on from an invitation letter, can lead to a small increase in uptake of the influenza vaccine in schools.

Availability of data and materials

The datasets generated and analysed during the current study are available from the corresponding author on reasonable request.

Notes

  1. https://www.gov.uk/government/collections/annual-flu-programme

  2. Available at https://www.compare-school-performance.service.gov.uk/download-data

Abbreviations

GP:

General Practices

BAME:

Black and Ethnic Minority

NCMP:

National Child Measurement Programme

BMI:

Body Mass Index

RTI:

Randomised Controlled Trial

PHEBI:

PHE Behavioural Insights

CCG’s:

Clinical Commissioning Groups

BCT:

Behavioural Change Technique

CHIS:

Child Health Information System

NICE:

National Institute of Health and Care Excellence

IMD:

Index of Multiple Deprivation

GLM:

Generalised Linear Model

References

  1. Joint Committee on Vaccination and Immunisation, JCVI statement on the annual influenza vaccination programme – extension of the programme to children. 2012.

    Google Scholar 

  2. Public Health England, National Childhood Influenza Vaccination Programme 2015 to 2016: Seasonal influenza vaccine uptake for children of primary school age 2016.

  3. Hardelid P, et al. Factors associated with influenza vaccine uptake during a universal vaccination programme of preschool children in England and Wales: a cohort study. J Epidemiol Community Health. 2016;70(11):1082–7.

    Article  PubMed  Google Scholar 

  4. Paterson P, Chantler T, Larson HJ. Reasons for non-vaccination: parental vaccine hesitancy and the childhood influenza vaccination school pilot programme in England. Vaccine. 2018;36(36):5397–401.

    Article  PubMed  Google Scholar 

  5. MacDougall D, et al. Parental perceptions of school-based influenza immunisation in Ontario, Canada: a qualitative study. BMJ Open. 2014;4(6).

  6. Paterson P, et al. Parents’ experience and views of vaccinating their child against influenza at primary school and at the general practice. Int J Environ Res Public Health. 2018;15(4):622.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Green HK, et al. Phased introduction of a universal childhood influenza vaccination programme in England: population-level factors predicting variation in national uptake during the first year, 2013/14. Vaccine. 2015;33(22):2620–8.

    Article  CAS  PubMed  Google Scholar 

  8. Public Health England, Childhood influenza vaccination pilot Programme, England 2014/15: End of season report. 2016.

    Google Scholar 

  9. Nowak GJ, et al. Promoting influenza vaccination: insights from a qualitative meta-analysis of 14 years of influenza-related communications research by US Centers for Disease Control and Prevention (CDC). Vaccine. 2015;33(24):2741–56.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Harmsen IA, et al. Why parents refuse childhood vaccination: a qualitative study using online focus groups. BMC Public Health. 2013;13(1):1–8.

    Article  Google Scholar 

  11. Smith LE, et al. Psychological factors associated with uptake of the childhood influenza vaccine and perception of post-vaccination side-effects: a cross-sectional survey in England. Vaccine. 2017;35(15):1936–45.

    Article  PubMed  Google Scholar 

  12. Smith LE, et al. A systematic review of factors affecting vaccine uptake in young children. Vaccine. 2017;35(45):6059–69.

    Article  PubMed  Google Scholar 

  13. Sampson R, Wong L, MacVicar R. Parental reasons for non-uptake of influenza vaccination in young at-risk groups: a qualitative study. Br J Gen Pract. 2011;61(588):e386–91.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Sheeran P, Webb TL. The intention–behavior gap. Soc Person Psychol. 2016;10(9):503–18.

    Google Scholar 

  15. Marteau TM, Hollands GJ, Fletcher PC. Changing human behavior to prevent disease: the importance of targeting automatic processes. Science. 2012;337(6101):1492–5.

    Article  CAS  PubMed  Google Scholar 

  16. Sallis A, et al. The effectiveness of an enhanced invitation letter on uptake of National Health Service Health Checks in primary care: a pragmatic quasi-randomised controlled trial. BMC Fam Pract. 2016;17:35.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Sallis A, et al. Improving child weight management uptake through enhanced National Child Measurement Programmed parental feedback letters: a cluster randomised controlled trial. Prev Med. 2019;121:128–35.

    Article  CAS  PubMed  Google Scholar 

  18. Sallis A, et al. Pre-notification and reminder SMS text messages with behaviourally informed invitation letters to improve uptake of NHS health checks: a factorial randomised controlled trial. BMC Public Health. 2019;19(1):1162.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Kerrison R, et al. Text-message reminders increase uptake of routine breast screening appointments: a randomised controlled trial in a hard-to-reach population. Br J Cancer. 2015;112(6):1005.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Herrett E, et al. Text messaging reminders for influenza vaccine in primary care: a cluster randomised controlled trial (TXT4FLUJAB). BMJ Open. 2016;6(2):e010069.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Hallsworth M, et al. Stating appointment costs in SMS reminders reduces missed hospital appointments: findings from two randomised controlled trials. PLoS One. 2015;10(9):e0137306.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Hasvold PE, Wootton R. Use of telephone and SMS reminders to improve attendance at hospital appointments: a systematic review. J Telemed Telecare. 2011;17(7):358–64.

    Article  PubMed  PubMed Central  Google Scholar 

  23. McLean S, et al. Targeting the use of reminders and notifications for uptake by populations (TURNUP): a systematic review and evidence synthesis. Health Serv Deliver Res. 2014;2(34):1–184.

    Article  Google Scholar 

  24. Michie S, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.

    Article  PubMed  Google Scholar 

  25. Fiske ST, Taylor SEJA. New York, Social cognition. 2; 1991. p. 253.

    Google Scholar 

  26. Kazdin AE. Behavior modification in applied settings: Waveland Press; 2012.

    Google Scholar 

  27. Ley P. Communicating with patients: improving communication, satisfaction and compliance: Croom Helm; 1988.

    Google Scholar 

  28. Ley P, Baum A. Cambridge handbook of psychology, health and medicine: Cambridge University Press Cambridge; 1997. p. 331–4.

    Google Scholar 

  29. Gollwitzer PM, Sheeran P. Implementation intentions and goal achievement: a meta-analysis of effects and processes. Adv Exp Soc Psychol. 2006;38:69–119.

    Article  Google Scholar 

  30. NICE, Flu vaccination: increasing uptake. NICE guideline [NG103]. 2018.

    Google Scholar 

  31. Olivier J, et al. Relative effect sizes for measures of risk. 2017;46(14):6774–81.

    Google Scholar 

  32. Sallis A, et al. Increasing uptake of National Health Service Health Checks in primary care: a pragmatic randomized controlled trial of enhanced invitation letters in Northamptonshire, England. Journal of Public Health. 2019.

  33. Gold N, et al. A randomised controlled trial to compare the effect of two new behaviourally enhanced NHS health check leaflets and the current nationally recommended leaflet on uptake of NHS health checks. BMC Public Health. 2019;19.

  34. Larson H, et al. State of vaccine confidence in the EU 2018. Luxembourg: European Union; 2018.

    Google Scholar 

  35. Public Health England, Seasonal influenza vaccine uptake in children of primary school age - Winter season 2019 to 2020. 2020.

    Google Scholar 

Download references

Acknowledgments

Our thanks go to the hard work of the staff at the participating provider sites who co-ordinated the trial on the ground. We also thank Pam Hall, Deborah Saban, Oliver Jackson and Chris Wright for their assistance, and Louise Letley and Angela Edwards for facilitating the implementation of the trial.

Funding

The study was funded by Public Health England.

Author information

Authors and Affiliations

Authors

Contributions

R H-J, AB, SJ, PM, KT and TC conceived of the studies, R H-J implemented the studies and wrote the first draft of the paper, NG managed the data analysis and wrote up Study 1 and revised the manuscript, KT reviewed drafts of the letters and did data cleaning and preliminary statistical analysis, AS performed the randomization and gave statistical oversight, RW did statistical analysis for study 1, SB did statistical analysis for study 2, KB reran and checked the statistical analyses and helped revise the manuscript. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Natalie Gold.

Ethics declarations

Ethics approval and consent to participate

Study 1: Ethical approval: Health Research Authority, REC reference16/WS/0181.

Study 2: Ethical approval: PHE Research Ethics and Governance Group, Reference number R&D 281.

All methods were carried out in accordance with relevant guidelines and regulations. CONSORT reporting guidelines were followed (see the Supplementary Materials).

Informed consent was obtained from the participating CCG’s within study 1. For study 2, informed consent was obtained from the participating childhood flu school vaccination providers.

Study 2 was discussed with the PHE ethics committee who have stated that total informed consent from parents of the school children was not required due to the following reasons:

  1. 1.

    Parents were expecting to receive a letter about the flu immunisation, so they were not getting anything unexpected.

  2. 2.

    If parents had known ahead of receiving the letter that different letters were going to be sent this may have influenced the response of the parent to the letter and the researcher would not have got an accurate picture of how effective the different letters had been.

  3. 3.

    Also it was necessary for all parents to be included in the study. Some may not have had time to give consent and it needed everybody to receive and react to their letter in order to see which worked best. If numbers had been too low there would have been insufficient study data to see an effect.

Consent for publication

Not Applicable.

Competing interests

There are no conflicts of interest to report.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Supplementary File 1.

GP Flu Vaccine Invitation Letter. This file contains the vaccine invitation letter sent out by the GP to patients.

Additional file 2: Supplementary File 2.

School Flu Behavioural Invitation Letter. The file contains the behaviourally-informed letter which was sent by providers of childhood flu school vaccination to parents at those schools.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Howell-Jones, R., Gold, N., Bowen, S. et al. Can uptake of childhood influenza immunisation through schools and GP practices be increased through behaviourally-informed invitation letters and reminders: two pragmatic randomized controlled trials. BMC Public Health 23, 143 (2023). https://doi.org/10.1186/s12889-022-14439-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-022-14439-4

Keywords