Comparatively low attendance during Human Papillomavirus catch-up vaccination among teenage girls in the Netherlands: Insights from a behavioral survey among parents
BMC Public Health volume 12, Article number: 498 (2012)
The Dutch Human Papillomavirus (HPV) catch-up vaccination program in 2009 appeared less successful than expected. We aimed to identify the most important determinants of refusing the vaccination.
Two thousand parents of girls born in 1996 targeted for HPV vaccination received an invitation letter to participate in a questionnaire study. Two study groups were defined: the first group consisted of parents of girls who had accepted the vaccine and already received the first dose of HPV vaccination. The second group consisted of parents whose daughters were not vaccinated. The questionnaire consisted of a broad spectrum of possible determinants that were revealed after literature search and discussions with the stakeholders.
Four hundred sixty nine questionnaires (24%) were returned, 307 (31%) from those who accepted and 162 (16%) from those who declined the vaccine. The decision not to accept the vaccine was largely determined by: (i) perception that the information provided by the government about the vaccine was limited or biased (OR 13.27); (ii) limited trust, that the government would stop the vaccination program if there were serious side effects (OR 9.95); (iii) lack of knowledge about the effectiveness of the vaccine (OR 7.67); (iv) concerns about the side effects of the vaccine (OR 4.94); (v) lack of conviction that HPV can be extremely harmful (OR 3.78); (vi) perception that the government is strongly influenced by vaccine producers (OR 3.54); and (vii) religious convictions (OR 2.18).
This study revealed several determinants for HPV vaccination uptake after implementation of the HPV vaccine for adolescent girls. These determinants should be taken into consideration in order to successfully implement HPV vaccination into National Immunization Programs.
Based on the recommendations by the Dutch Health Council (DHC) in March 2008 , the Dutch government approved implementation of the Human Papillomavirus (HPV) vaccination as part of the National Immunization Program (NIP). The vaccine to be used was Cervarix™ (GlaxoSmithKline), which is a bivalent vaccine against HPV16 and HPV18, and consists of three doses administered at baseline, one and six months . The vaccine was mainly targeted at 12-year-old girls (1997 birth cohort) and a catch-up vaccination program was planned for 13- to16-year-old girls (1993–1996 birth cohort) . The catch-up vaccination campaign started in March 2009, and the regular vaccination campaign began in 2010. For all targeted girls the vaccination campaign was free of charge. The girls received a personal invitation letter with an information leaflet and were invited to visit local vaccination sessions . Although no permission of the parents was required, the girls were advised to discuss the information and their decision regarding HPV vaccination with parents or other family members .
Ultimately, slightly above fifty percent (52.3%) of the targeted catch-up cohort received the HPV vaccine . The vaccination rates varied by age, from 49.0% in 1993 birth cohort to 54.2% in, 1996 birth cohort . By February 2011, similar vaccination rates (52.5%) were observed in the 1997 birth cohort . One suggested reason for such a low HPV vaccination uptake, as compared to the normal attendance rates for the regular vaccinations of the NIP of 90% , was critical reporting in the media, which accused the government of emphasizing the advantages rather than the potential disadvantages of the vaccine. Other reasons, such as the relative novelty of the vaccine, the fact that it was the first vaccine for a sexually transmitted infection and the first vaccine for girls only, and its unknown effectiveness in preventing cancer could have engendered distrust in the parents as well. Another possible factor in declining HPV vaccination or vaccinations in general, could be religious beliefs. In the Netherlands, the overall vaccination coverage is much lower in the so-called Bible-belt region where relatively many people decline vaccinations because of their religious convictions (http://www.rivm.nl/en/infectious-diseases/topics/nip/).
Several Dutch studies have already assessed the knowledge about and the willingness to receive the HPV vaccine. These studies have shown that 56%–88% of the respondents would be willing to receive or have their daughter receive the HPV vaccine [6, 7]. Several studies from other countries that assessed parental attitudes towards HPV vaccination showed similar rates of intention to vaccinate (70–80%) [8–10]. Since actual behavior may be different from intentions, we designed a study which aimed to assess a broad range of demographic, behavioral, and organizational determinants, and knowledge and concerns that were influential in parents’ decision to either accept or decline the vaccination for their daughters during the HPV vaccination campaign. Although in the catch-up vaccination campaign 13- to 16-years-old girls were invited to receive HPV vaccinations, only the girls of 13 years of age were invited to our study as with regard to age their parents resembled the parents of the 12-years-old girls the best.
In July 2009, four months after the HPV vaccination catch-up program for 13- to 16-year-old girls was initiated, we randomly selected parents of girls born in 1996 who had received a call for the HPV vaccine in the Northern provinces of the Netherlands. Two study groups were defined. The first group consisted of parents of girls who had accepted the vaccine and already received the first dose of HPV vaccination. The second group consisted of vaccine decliners. The two groups, including 1000 parents each, were randomly sampled from the vaccination register. On behalf of the researchers, the Institute for Public Health and the Environment (RIVM) sent 2000 invitations to eligible parents to ask if they would be willing to participate in the study. Parents who agreed to enroll in the study returned the response cards with a positive reply and parents who were willing to participate received a paper questionnaire in Dutch (the English version added in Additional file 1). After three weeks a reminder to fill out the questionnaire was sent.
The study was conducted in accordance with the Dutch Law for the Protection of Personal Data (Wet Bescherming Persoonsgegevens) and the Declaration of Helsinki (http://www.wma.net/e/policy/b3.htm). No medical ethical committee approval was required.
We used an anonymous, self-administered questionnaire to identify the determinants for not accepting the HPV vaccination. In a stakeholders meeting with professionals involved in the HPV campaign, (a gynecologic oncologist, a sexologist, a doctor of the Municipal Health Service, a regional manager of coordination programs at the center for infectious disease control, an epidemiologist, and municipal health advisors), possible determinants for the uptake of the HPV vaccination were explored. In addition, a review of the literature, a stakeholder analysis, and questionnaires previously developed by our and other research groups  were used to construct a new questionnaire. The parents were asked to fill out the questionnaire (in Dutch) on behalf of their daughter who had received a call for the HPV vaccination. Parents could also express their attitudes towards HPV vaccination in a free text.
The demographical determinants of the parents included gender, age, marital status, educational level (none, primary, prevocational, secondary, pre-university, higher-professional, university), religion (Catholic, Protestant, Islam or other) and country of birth. We also assessed the participation in a cervical screening program. We asked whether a participant knew someone with an abnormal cervical smear or cervical cancer in his/her family or circle of acquaintances. Items reflecting behavioral determinants were based on health behavior criteria according to the “Health Belief Model” and “Behavioral Intention Model” [11, 12]. We formulated questions based on five of the six domains in the Health Belief Model; perceived susceptibility, perceived severity, perceived benefits, perceived barriers and cues to action. We posed questions on two more domains that exist in the Behavioral Intention Model; attitudes and social influences. We also posed questions about parents’ knowledge concerning HPV and cervical cancer, information services and sources that influenced decision-making, trust in the government, vaccination concerns, age-related items, financial issues, intention to accept the vaccination later, involvement of their daughter in the final decision and future acceptance of other vaccines.
We dichotomized the following variables: education (high (university, higher professional)/other), being religious (yes/no), country of birth (the Netherlands/other), knowing someone with an abnormal cervical smear or cervical cancer in his/her family or circle of acquaintances (yes/no), and participation in cervical screening program (yes/no). The variables assessed with the four- and five-point Likert scale were dichotomized according to the degree of agreement with the proposition, (4–5 [agree - strongly agree]) for the indicator group, and (1–3 [strongly disagree, disagree and disagree nor agree]) for the reference group.
Knowledge about HPV and HPV vaccination was assessed by using 10 statements (true/false/does not know), see Appendix 1. The mean knowledge score was calculated.
The primary outcome was the uptake of the first dose of the HPV vaccine obtained from RIVM.
All determinants with a p-value lower or equal to 0.10 in the univariate analyses were used in the multivariate analysis. We used all determinants with a p-value of 0.05 or lower to construct a final logistic regression model. We calculated odds ratios (OR) and 95% confidence intervals (95% CI) as measures of associations. The area under the curve (AUC) for the receiver operating characteristic (ROC) with its 95% CI was calculated. The statistical analysis was performed using SPSS for Windows (version 16.0; SPSS, Inc Chicago Illinois).
Of the 2000 parents approached by the administrative offices of the RIVM, 863 parents responded and 609 parents were willing to co-operate. Four hundred sixty nine parents returned the questionnaire. Overall the response rate was 24% (469/2000), 31% (307) in the group who received the vaccine versus 16% (162) in the group who did not. Of the respondents 93% (435/468) were female, and mean age was 44 years (range 35–55 years). The mean score for knowledge about HPV and cervical cancer was 5.65/10 correct answers, 5.54 and 5.88 (p = .09) in those accepting and refusing the vaccine respectively.
The HPV vaccine was accepted by 66% of the respondents’ daughters while 34% (162/469) declined it. The majority (96%) of the girls received the second dose.
When the parents could express their attitudes towards the HPV vaccination, no new determinants of refusing the vaccine were encountered.
Determinants associated with not accepting the HPV vaccination
The results from the univariate analysis to determine the association between the demographic determinants and not accepting the HPV vaccine are shown in Table 1. Being religious was a strong demographic determinant for declining HPV vaccination.
Several behavioral determinants were associated with declining the HPV vaccination (Table 2). These included the conviction of the parents that their daughter would not get infected with HPV, lack of belief that HPV can be extremely harmful, judgment that it would be unlikely that their daughter might get cervical cancer in the future, perception that vaccinations are not effective in preventing disease, and conviction that HPV is not sufficiently serious to warrant vaccination.
Many determinants regarding the knowledge, and concerns about the safety of the vaccine and organizational issues related to government and information services were associated with declining HPV vaccination (Table 3).
The results from the multivariate analyses indicate that the strongest determinants of not accepting HPV vaccination were: limited information about the vaccine provided by the government, limited trust that the government would stop vaccinations if there were serious side effects and concerns related to vaccine safety, effectiveness and religion (Table 4). The AUC for the final model, including all 7 determinants, was 0.96 (95% CI 0.94–0.97).
In our study we aimed to identify the determinants among parents associated with refusal of HPV vaccination for their daughters. We found that, according to reports of parents, limited information provided by the government was the strongest predictor for declining the HPV vaccinations. Although the HPV vaccination campaign included the distribution of invitation letters to families with daughters in the target group and recruitment was supported by a nationwide information campaign targeting health care professionals and the general public , these efforts were not sufficient to persuade people to accept the vaccine. Possible explanation, as mentioned before, could include critical media reports that accused the government of emphasizing the advantages rather than the disadvantages of the vaccine. However, it has also been shown that the content of media reports sometimes may lack important information related to the vaccination or the disease  which could be misleading.
Another strong determinant for declining the HPV vaccination was a lack of trust that the government would stop vaccination if there were serious side effects. This concern might partly be a consequence of reports about potential associations between certain vaccines and serious adverse events, such as pandemic influenza vaccine and Guillain-Barré syndrome . This suggests that providing information about the management of vaccine side effects may improve the trust in the government as well.
Concerns about the HPV vaccine effectiveness and safety were associated with refusal of the HPV vaccination. One Dutch study showed that those who were not willing to have their children vaccinated said that they would agree to do so after the vaccine had been used for several years . Secondly, it has also been found that 88% of parents said they would be willing to have their children vaccinated if the government approved the vaccine . Although the HPV vaccine was approved by the Dutch government, which means that a list of criteria such as acceptable safety and effectiveness profiles had to be met , the actual behavior was not consistent with parents’ reported intentions. Only slightly above 50% of the target population accepted the HPV vaccine. Differences between the intentions and the actual behavior regarding the uptake of the HPV vaccinations may therefore be of interest for future research.
Our findings indicate that parents of vaccinated and unvaccinated girls hold very different views on the severity of HPV infection and the likelihood that their daughters might acquire an HPV infection or cervical cancer and on the question as to whether the information about HPV vaccination was adequate. Parents whose daughters were not vaccinated perceived less risk associated with HPV and cervical cancer. Interestingly they felt, more often, that information about HPV vaccination was not sufficient to make a good decision. Although the entire target group received the same information about the HPV vaccination, these findings suggest that the attitudes towards HPV vaccination were largely influenced by more subjective reasons.
The results of our study show that religious respondents were less likely to accept the vaccine. Another Dutch study also found that voters for religious parties are less likely to accept HPV vaccination . This observation is consistent with the general refusal of childhood vaccination by a group of reformed orthodox living in the Netherlands (http://www.rivm.nl/en/infectious-diseases/topics/nip/). (http://www.zorgatlas.nl/preventie/vaccinaties-en-screening/hpv-cohort-1997-per-gemeente-2010/#breadcrumb). The findings from other countries however provide only limited evidence about the association between religion and HPV vaccine uptake [10, 9].
Moreover, preliminary results from other countries show that HPV vaccination coverage largely depends on the type of vaccination program that is implemented. A school-based approach was superior to vaccination programs on-demand through health professionals, the latter being implemented in the Netherlands . The three-dose vaccination coverage in Scotland in the 1996 birth cohort via a school-based HPV vaccination campaign was 86% . It therefore appears that apart from a need for clearer and more transparent messages to the public, different approaches to reach the target population should also be considered.
From the discussions with the stakeholders at the beginning of our study and during the start of the HPV vaccination campaign in the Netherlands it appeared that parents have much influence on the decision as to whether or not to vaccinate their daughters. However, vaccination coverage rates may also be influenced by the girls’ opinions themselves. It has been shown that different information sources may be preferred by girls of different age [18, 19]. For example, information provided by health care professionals and mass media (television, the internet) seemed to be a preferred source of information among older teenage girls (15- to 18- or 19-years-old) while younger teenagers (11- or 12- to 14-years-old) had more trust in schools, teachers and family [18, 19]. Guidance about HPV and HPV vaccination could therefore be provided through the preferred sources of information for different age groups.
Some limitations of the study need to be addressed. The overall response rate was not high (24%). One of the possible explanations is the two-step response process we employed in which parents were first asked to return a card for participation and only then received a questionnaire. Importantly, the response rate was twice as high among those who received the vaccine versus those who did not (31% versus 16%). This might have introduced bias because those with more positive attitudes towards vaccination were better represented in our study. We expect that the bias introduced more contrast between positive and negative attitudes than in the general population, which agrees with the exceptionally high discriminative value of the predictive model (AUC-value of 0.96). This means that in the general population the role of these determinants is likely to be less important than what we observed in our study. On the other hand, given the fact that some baseline characteristics were comparable to the general Dutch population the sample seemed to mirror the source population of the Netherlands. Our study also assessed a broad spectrum of possible determinants associated with declining HPV vaccination.
The incidence and mortality from cervical cancer in the Netherlands is one of the lowest in Europe. However, since it is the second most common cancer in 18- to 44-years-old women , efforts should be made to prevent it. If 70% of the cervical cancers can be prevented by the currently registered HPV vaccines, it could largely reduce physical and psychological disease burden for the females and their families.
We identified several determinants for the low HPV vaccination uptake. Modifying these determinants might be essential during planning, implementation and continuation of the HPV vaccination programs inside and outside the Netherlands. Furthermore, openness and discussion about the pros and cons of HPV vaccination as well as the use of a variety of communication strategies may be helpful for a more successful implementation of HPV vaccination programs.
Appendix 1. Knowledge about HPV infection
Often HPV does not present with visible symptoms (true).
A cervical smear induces cervical HPV infection (false).
HPV usually disappears without treatment (true).
More sexual partners increase the risk to get HPV infection (true).
It is possible to have HPV for a long time without knowing (true).
HPV can be transmitted during the sexual contact (true).
HPV can cause the cervical cancer (true).
Most of the sexually active people at some point get HPV (true).
A condom provides 100% protection against HPV (false).
If you have HPV, you always know it (false).
National Immunization Program
Institute for Public Health and the Environment.
Health Council of the Netherlands: Vaccination against cervical cancer. 2008, Health Council of the Netherlands, The Hague
GlaxoSmithKline Biologicals: Cervarix Product Information. 2009
Rondy M, van Lier A, van de Kassteele J, Rust L, de Melker H: Determinants for HPV vaccine uptake in the Netherlands: A multilevel study. Vaccine. 2010, 28 (9): 2070-2075. 10.1016/j.vaccine.2009.12.042.
Institute for Public Health and the Environment (RIVM): Prik en bescherm. 2011
van Lier EA, Oomen PJ, Giesbers H, Drijfhout IH, de Hoogh PAAM, de Melker HE: Vaccinatiegraad Rijksvaccinatieprogramma Nederland. 2011, RIVM
Lenselink CH, Schmeink CE, Melchers WJG, Massuger LFAG, Hendriks JCM, van Hamont D, Bekkers RLM: Young adults and acceptance of the human papillomavirus vaccine. Public Health. 2008, 122 (12): 1295-1301. 10.1016/j.puhe.2008.02.010.
Lenselink CH, Gerrits MMJG, Melchers WJG, Massuger LFAG, van Hamont D, Bekkers RLM: Parental acceptance of Human Papillomavirus vaccines. Eur J Obstet Gynaecol Reprod Biol. 2008, 137 (1): 103-107. 10.1016/j.ejogrb.2007.02.012.
Ogilvie GS, Remple VP, Marra F, McNeil SA, Naus M, Pielak KL, Ehlen TG, Dobson SR, Money DM, Patrick DM: Parental intention to have daughters receive the human papillomavirus vaccine. CMAJ. 2007, 177 (12):
Marlow LAV, Waller J, Wardle J: Parental attitudes to pre-pubertal HPV vaccination. Vaccine. 2007, 25 (11): 1945-1952. 10.1016/j.vaccine.2007.01.059.
Brabin L, Roberts SA, Farzaneh F, Kitchener HC: Future acceptance of adolescent human papillomavirus vaccination: A survey of parental attitudes. Vaccine. 2006, 24 (16): 3087-3094. 10.1016/j.vaccine.2006.01.048.
Fishbein M: Belief, attitude, intention and behaviour: an introduction to theory and research. Reading. 1975
Hankins M: Statistical guidelines for studies of the theory of reasoned action and theory of planned behaviour. Psychology and Health. 2000, 15: 151-161. 10.1080/08870440008400297.
European Cervical Cancer Association (ECCA): HPV Vaccination Across Europe. 2009
Kelly BJ, Leader AE, Mittermaier DJ, Hornik RC, Cappella JN: The HPV vaccine and the media: how has the topic been covered and what are the effects on knowledge about the virus and cervical cancer?. Patient Educ Couns. 2009, 77 (2): 308-313. 10.1016/j.pec.2009.03.018.
Dieleman J, Romio S, Johansen K, Weibel D, Bonhoeffer J, Sturkenboom M: VAESCO-GBS Case–control study group: Guillain-Barre syndrome and adjuvanted pandemic influenza A (H1N1) 2009 vaccine: multinational case–control study in Europe. BMJ. 2011, 12 (343): d3908-
Houweling H, Verweij M, Ruitenberg EJ: National Immunisation Programme Review Committee of the Health Council of the Netherlands: Criteria for inclusion of vaccinations in public programmes. Vaccine. 2010, 28 (17): 2924-2931. 10.1016/j.vaccine.2010.02.021.
ISD Scotland: Human Papilloma Virus (HPV). Immunisation Programme in Scotland, , http://www.isdscotlandarchive.scot.nhs.uk/isd/5921.html,
Kemberling M, Hagan K, Leston J, Kitka S, Provost E, Hennessy T: Alaska Native adolescent views on cervical cancer, the human papillomavirus (HPV), genital warts and the quadrivalent HPV vaccine. Int J Circumpolar Health. 2011, 70 (3): 245-253.
Marek E, Dergez T, Rebek-Nagy G, Kricskovics A, Kovacs K, Bozsa S, Kiss I, Ember I, Gocze P: Adolescents’ awareness of HPV infections and attitudes towards HPV vaccination 3 years following the introduction of the HPV vaccine in Hungary. Vaccine. 2011, 29 (47): 8591-8598. 10.1016/j.vaccine.2011.09.018.
European Cervical Cancer Association (ECCA): Cervical Cancer Rates in Europe - An ECCA Guide. http://www.ecca.info/cervical-cancer/cervical-cancer-rates.html,
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/12/498/prepub
We would like to thank the participants of this study.
This study was funded by the Netherlands Vaccine Institute.
All authors declare to have no competing interest.
MS conducted the study, collected, analyzed the data and drafted the first version of a manuscript. GG re-analyzed the data and drafted the final version of the manuscript. HWN and ATG contributed to the design of the study and critically reviewed the manuscript. IHD and BW participated in the qualitative assessments and critically reviewed the manuscript. MJP, JCW and JJMvD critically commented on the manuscript. EH contributed to the analysis of the study and critically commented on the manuscript. All authors read and approved the final version of a manuscript.
Electronic supplementary material
About this article
Cite this article
Gefenaite, G., Smit, M., Nijman, H.W. et al. Comparatively low attendance during Human Papillomavirus catch-up vaccination among teenage girls in the Netherlands: Insights from a behavioral survey among parents. BMC Public Health 12, 498 (2012). https://doi.org/10.1186/1471-2458-12-498