Skip to main content
Download PDF

Performance of 21 HPV vaccination programs implemented in low and middle-income countries, 2009–2013

BMC Public Health volume 14, Article number: 670 (2014) Cite this article

Abstract

Background

Cervical cancer is the third most common cancer in women worldwide, with high incidence in lowest income countries. Vaccination against Human Papilloma Virus (HPV) may help to reduce the incidence of cervical cancer. The aim of the study was to analyze HPV vaccination programs performance implemented in low and middle-income countries.

Methods

The Gardasil Access Program provides HPV vaccine at no cost to help national institutions gain experience implementing HPV vaccination. Data on vaccine delivery model, number of girls vaccinated, number of girls completing the three-dose campaign, duration of vaccination program, community involvement and sensitization strategies were collected from each program upon completion. Vaccine Uptake Rate (VUR) and Vaccine Adherence between the first and third doses (VA) rate were calculated. Multivariate linear regressions analyses were fitted.

Results

Twenty-one programs were included in 14 low and middle-income countries. Managing institutions were non-governmental organizations (NGOs) (n = 8) or Ministries of Health (n = 13). Twelve programs were school-based, five were health clinic-based and four utilized a mixed model. A total of 217,786 girls received a full course of vaccination.

Mean VUR was 88.7% (SD = 10.5) and VA was 90.8% (SD = 7.3). The mean total number of girls vaccinated per program-month was 2,426.8 (SD = 2,826.6) in school model, 335.1 (SD = 202.5) in the health clinic and 544.7 (SD = 369.2) in the mixed models (p = 0.15). Community involvement in the follow-up of girls participating in the vaccination campaign was significantly associated with VUR. Multivariate analyses identified school-based (β = 13.35, p = 0.001) and health clinic (β = 13.51, p = 0.03) models, NGO management (β = 14.58, p < 10-3) and duration of program vaccination (β = -1.37, p = 0.03) as significant factors associated with VUR.

Conclusion

School and health clinic-based models appeared as predictive factors for vaccination coverage, as was management by an NGO; program duration could play a role in the program’s effectiveness. Results suggest that HPV vaccine campaigns tailored to meet the needs of communities can be effective. These results may be useful in the development of national HPV vaccination policies in low and middle-income countries.

Peer Review reports

Background

Cervical cancer, the third most common cause of cancer in women around the world, is a significant global health challenge, and is the greatest cause of age-weighted years of life lost in the developing world due its high incidence [1, 2]. Approximately 291 million women worldwide are estimated to have human papillomavirus (HPV) infection of the cervix [2]. This corresponds to an average prevalence of 10.4% for all women, although the prevalence is higher in women younger than 25 years (16.9%) [3]. HPV is a requirement for developing cervical cancer and is found in 99.7% of cervical cancers diagnosed worldwide [4]. Two HPV serotypes, HPV-16 and HPV-18 are found in nearly 70% of the high-grade cervical lesions that increase a woman’s risk for developing cervical cancer [5].

Since 2006, two prophylactic HPV vaccines have been available, and each has shown > 90% efficacy in preventing HPV type 16- and 18-associated high-grade cervical lesions [6–10]. While both vaccines are being deployed in developed countries, their use of in low and middle-income countries has been limited due to cost and a variety of other factors [11–15]. Recognizing that these factors were impeding the broad use of HPV vaccination in low and middle-income countries, Merck & Co. Inc pledged to donate Gardasil [Human Papillomavirus Quadrivalent (Types 6, 11, 16 and 18) Vaccine, Recombinant] to eligible income countries through the Gardasil Access Program (GAP). Axios Healthcare Development is the recipient of this donation and is responsible for managing GAP. The program was established to enable organizations and institutions in eligible low and middle-income countries to gain operational experience designing and implementing HPV vaccination programs, with the goal of supporting the development of successful child and adolescent immunization models. Most vaccination programs target newborns and young children. In addition, given the substantial morbidity and mortality associated with cervical cancer, effective strategies for its prevention and treatment are critical for improving women’s health throughout the developing world [14]. Pilot programs undertaken in different low and middle-income countries support the use of universal vaccination against HPV as an effective strategy for reducing cervical cancer incidence in these areas [16, 17].

Through the provision of vaccines at no cost, GAP aims to foster experience in key implementation areas that are often a challenge in lowest-income countries. These challenges include difficulties in reaching adolescent target populations, resource constraints due to existing needs of routine vaccination campaigns, and selection of optimal vaccination delivery models that most effectively reach the eligible population with the three-dose vaccine series [14, 18]. Cultural issues, such as lack of awareness of the connection between HPV infection and cervical cancer, reticence to discuss a sexually transmitted disease, prior negative experience with other vaccine campaigns, safety concerns, and worries about future fertility may also create barriers to deploying HPV vaccination effectively on a broad scale [17–28]. Concerns about public health policy, such as the role of government in deciding who should be vaccinated, may also impact families’ willingness to have their daughters vaccinated [21].

GAP supports programs that are designed and implemented by local and national institutions and organizations. The goal of this approach is to have participating organizations and countries gain experience in the development of relevant and effective strategies for addressing issues that can affect coverage rates, such as infrastructure, culture, and politics. The data gathered from programs implemented under GAP reflect the experiences and lessons learned from multiple countries and represent diverse cultural, political, and health care environments [18, 28, 29]. These data can be used to guide the development of future national HPV vaccine campaigns in different countries. This approach is consistent with the objectives that the WHO’s Decade of Vaccines Collaboration Research and Development Working Group has outlined in their strategy to address the need for targeted implementation research to improve both coverage of basic vaccines and uptake of new vaccines [30].

While a number of HPV vaccination pilot programs have been undertaken in lowest-income countries, published results from these programs do not typically include information related to program management. Moreover, whereas most published studies describe results from individual programs, GAP provides an opportunity to evaluate a variety of HPV vaccine program types implemented in a number of low and middle-income countries. Consequently, GAP data has the potential to provide important insight into performance factors such as vaccine delivery model, program management and timing, community involvement and sensitization. The aim of this study was to analyze such factors in HPV vaccination programs included in GAP and implemented in low and middle-income countries.

Methods

Setting

Organizations and institutions participating in GAP are responsible for covering all other costs associated with their vaccination campaigns, including importation, storage, cold chain management, distribution of vaccine, data collection, and management of the vaccination campaigns (i.e. community outreach and sensitization). GAP encourages participating organizations to adhere to WHO guidelines for HPV vaccination [30]. The WHO recommends that the target age range is 9 or 10 years of age through 13 years of age [30].

Program inclusion

For inclusion in GAP, interested organizations and institutions completed a detailed application form to describe the characteristics of their institution and their related vaccination experience [31]. Eligible organizations and institutions included both Ministries of Health (MoH) and local non-governmental organizations (NGOs). The application collected information on the managing institution (MoH or NGOs), vaccination implementation plan, estimated target population of girls, logistics, human and financial resources available to support the program, and health services provided by the institution implementing the program. A standardized review form was used to consider the applications; independent experts reviewed the applications and recommended individual programs for inclusion. The GAP Advisory Board reviewed the applications and expert recommendations before issuing a recommendation for final inclusion in GAP.

Program follow-up

Organizations and institutions participating in GAP are required to submit final program reports once the vaccination program has completed administration of all three doses of vaccine. These reports described final program outcomes, including the number of girls vaccinated per round, the number of girls who received a full course of vaccine, total number of vaccination sites and number of girls vaccinated in each type of delivery site (schools and/or health clinics). The reports also gathered financial data (if available). The reports gathered information related to community involvement actions, communication key messages and methods. The program duration was defined as the time from the date of initial vaccine shipment through the date of delivery of the third vaccine dose (expressed in months).

Three models of vaccine delivery were used: schools, health clinics, and mixed models comprising both schools and health clinic delivery sites. The primary model of vaccination delivery was defined according to the type of site at which > 80% of the targeted population was vaccinated, with mixed models defined as those using both schools and health clinics without either site achieving 80% of target population vaccinations.

Vaccination indicators

The factors associated with program effectiveness were assessed using two indicators: Vaccine Uptake Rate (VUR) and Vaccine Adherence (VA). The VUR was defined as the number of vaccinated girls that received a full-course of vaccination (three doses) divided by the number of girls targeted. For each program, the number of targeted girls was determined prior to implementation using available population, census and/or school enrollment data, among other sources. The VA was defined as the number of girls receiving a full course of vaccination divided by the number of girls who received a first dose. VA was calculated between doses (D)2 and D1, D3 and D2, and D3 and D1. Adherence between D3 and D1 (VA D3-D1) was used as a metric of program effectiveness. In addition, the speed of each vaccination program was estimated by calculating a VUR per program-month (p-m), which is defined as the number of girls completely vaccinated divided by the number of girls targeted and multiplied by the program duration; speed was expressed in %.

Cost analyses

The cost analysis was conducted using only those programs that provided comprehensive financial data, including staff costs. Cost data were available for seven of the 21 programs included in this study. Cost categories were not standardized among all programs. Because GAP is a donation program, the cost of vaccine was excluded from the total costs. Two costs measures were used: delivery cost per dose and delivery cost per fully-immunized girl (FIG). Cost per FIG is defined as the cost per dose multiplied by the total number of doses delivered over three vaccination rounds divided by the total number of girls who received all three doses. Program costs were calculated in U.S. dollars (USD).

Statistical analyses

For continuous variables, data are expressed as mean values with their standard deviation (SD) and median (M). Student t test for parametric quantitative data and Mann–Whitney U test for non-parametric data were used. The Kruskal-Wallis test was used to compare VUR and VA D3-D1 and the three vaccination delivery models. Correlations between the number of vaccination sites, the number of girls vaccinated by program-month, programs duration, and VUR and VA D3-D1 were tested using the Spearman correlation rank (rs). Two weighted multiple linear regression analyses were fitted to determine predictive independent factors associated with VUR and VA D3-D1. The two models were weighted on the number of girls vaccinated per program-month. The decision was made to use the same independent variables in the two weighted multiple linear regressions: type of institution (MoH, NGO), vaccination delivery model (school, health clinic and mixed), the number or vaccination sites, and the duration of the program. A significance level of 0.05 was used for all analyses. Statistical analyses were carried out in Statview® 5.0 SAS (SAS Institute Inc.).

Role of funding source

Merck & Co., Inc. had no role in study design, data collection, data analysis, data interpretation, or manuscript development. All data analyses were conducted with authorization from Merck & Co., Inc. The authors had full access to all data in the study and had final responsibility for the decision to submit for publication. Although Axios Healthcare Development received financial compensation for managing the GAP, the results presented here are a complete and accurate representation of data collected through the study tools.

Results

A total of 21 HPV vaccination programs in 14 countries were included. Table 1 presents the baseline characteristic of the 21 programs. Thirteen programs (61.9%) were managed by Ministry of Health, and eight programs were managed by an NGO. With respect to vaccine delivery models, 12 programs were school-based, five were health clinic-based, and four programs were mixed models (Table 1).

Table 1 Baseline characteristics of the 21 HPV vaccinations programs included in the Gardasil Access Program, 2009–2013
Full size table

Of the 21 programs, seven programs began implementation in 2009 (Bhutan, Bolivia, Cambodia, Haiti, Lesotho, Moldova and Uzbekistan); nine programs in 2010 (Bolivia [2], Cambodia, Cameroon, Georgia, Lesotho, Nepal, Tanzania and Uganda); four programs in 2011 (Bolivia, Honduras, Kenya and Nepal); and one program implemented in 2012 (Honduras). Overall, mean program duration was 10.7 months (SD = 5.0, median M = 9.1). Mean duration for programs conducted by MoH was 10.8 months (SD = 5.7, M = 7.6) and mean duration for programs conducted by NGOs was 10.4 months (SD = 3.7, M = 9.1) (p = 0.88).

The mean VUR was 88.7% (SD = 10.5). The mean VA between D2 and D1, D3 and D2, and D3 and D1 was 95.9% (SD = 3.9), 94.6% (SD = 5.6) and 90.8% (SD = 7.3) respectively (Table 1).

The mean total number of girls vaccinated per program-month (p-m) for all programs was 1,570.3 (SD = 2,336.1, M = 523.1) (Table 1). The mean total number of girls vaccinated per p-m by type of institution was 1,811 (SD = 2,765.1, M = 646.7) for MoH programs and 1,178 (SD = 1483.8, M = 513.0) for programs managed by NGOs (p = 0.56). The number of girls vaccinated per p-m by type of program is shown in Figure 1. The mean total number of girls vaccinated per p-m was the highest in the school model, with a mean of 2,426.8 (SD = 2,826.6), 335.1 (SD = 202.5) in mean in the health clinic models and 544.7 (SD = 369.2) in the mixed models (p = 0.15).

Figure 1
figure 1

Mean total number of girls vaccinated per program-month (p-m) by vaccine delivery model, Gardasil Access Program, 2009–2013 (N = 21 programs).

Full size image

Table 2 summarizes the baseline characteristics and program sensitization methods according to VUR and VA D3-D1. As shown, programs managed by an NGO had a higher VUR than programs managed by MoH (96.0% vs. 87.2%, respectively, p = 0.05), whereas the institution type did not impact VA D3-D1. There was no statistically significant difference in VUR and VA D3-D1 based on the health services provided at the institution. The type of delivery model did not have a significant impact on VUR or VA D3-D1 (Table 2).

Table 2 Baseline program characteristics and sensitisation methods of programs according to vaccine uptake rate (VUR) and D3-D1 adherence to HPV-vaccination, Gardasil Access Program, 2009–2013 (N = 21 programs)
Full size table

Community involvement in following-up with girls participating in the vaccination campaign was significantly associated with mean VUR, 95.4% (SD = 9.4) versus 86.1% (SD = 10.8) for communities with and without involvement, respectively (p = 0.05) (Table 2). Although VUR increased with the number of community involvement actions, the difference remained insignificant (Table 2). Mean VUR for programs with and without key messages about the safety and efficacy of the vaccine was 93.3% (SD = 9.1) and 83.6% (SD = 10.8), respectively (p = 0.05).

Overall, the mean VUR per p-m was 7.53% (SD = 0.88, M = 7.54). The mean VUR p-m did not differ significantly among the different delivery models: schools (7.73%, SD = 0.78), health clinics (7.48%, SD = 1.13), and mixed models (6.99%, SD = 0.80) (p = 0.35). There was a significant correlation between the VUR p-m and the VA D3-D1 (rs = 0.66, p < 10-4), as well as between the total number of girls vaccinated per p-m and the number of vaccination sites (rs = 0.57, p = 0.007). When the correlations were stratified on vaccine delivery models, the three correlations remained positive: health clinic (rs = 0.65, p = 0.27), school (rs = 0.18, p = 0.66), and mixed (rs = 0.72, p = 0.03). There was a negative correlation between the vaccination program duration and VUR (rs = -0.27, p = 0.23), and a significantly negative correlation between duration and VA D1-D3 (rs = -0.48, p = 0.03).

The first weighted multiple linear regression model identified program management by an NGO (p < 10-3), school and health clinic delivery model, and duration of the program as significantly independent predictors of VUR (Table 3). In the second weighted multiple linear regression model, no significant association was found between VA D3-D1 and the independent variables fitted in the model, and program duration was the only independent variable that approached statistical significance (p = 0.07) (Table 3).

Table 3 Weighted multiple linear regressions* analysis of predictive factors of HPV-vaccination uptake rate (VUR) and D3-D1 vaccination adherence (VA), Gardasil Access Program, 2009–2013 (N = 21 programs)
Full size table

Although comprehensive cost data were not proactively collected from programs participating in GAP, these data were available for seven programs. The mean cost per FIG was USD 8.75 (SD = 4.31, M = 7.10, range = 5.00–17.26) (Table 4). For five programs, the mean cost ranged from USD 5.0 to 7.23, while the two programs with the lowest target populations had substantially higher costs per FIG (USD 11.73 and 17.26). Mean cost per vaccine dose was USD 2.74 (SD = 1.35, M = 2.34, range = 1.38–5.39) (Table 4). There was no significant difference in cost per FIG or per vaccine dose among the three vaccine delivery models, and the cost per FIG was similar in each of the three school-based models included in the analysis (USD 7.02 in Moldova, 7.12 in Lesotho, and 7.23 in Nepal) (data not shown).

Table 4 Cost analysis* (in US$) in seven programs included in Gardasil Access Program, 2009–2013 (N = 7 programs)
Full size table

Discussion

This study provides insight into factors that impact the outcome of HPV vaccine campaigns in lowest-income countries. Among the key findings of this study are: first, high VUR (mean VUR = 88.7%), and VA D3-D1 (mean VA = 90.8%) were found across the 21 programs assessed; second, school-based vaccine delivery models and program management by an NGO each had a positive and statistically significant impact on VUR; third, duration of the vaccination campaign appears also as a predictive factor for VUR and VA, with increased speed of vaccination predicting higher VUR and VA.

Program management by NGOs was significantly associated with VUR. NGOs are typically smaller and face fewer internal bureaucratic hurdles than a Ministry of Health. Consequently, the finding that NGO management of a program could predict better VUR compared with MoH management may be related to the relative speed with which each type of organization can implement and execute a program, rather than reflecting overall capabilities or competencies of either type of institution. It should also be noted that programs implemented by NGOs have benefited from the authorization and the support of the national health authorities of the country.

Our results found also that program duration is a significant predictor of VUR (p = 0.03) and shows an association with VA (p = 0.07). Shorter duration predicted improved vaccination indicators, suggesting that a longer interval between vaccine shipment and initiation of the third vaccine dose reflects difficulty in vaccinating girls against HPV in a timely manner. A lack of momentum within a given program may lead to loss of interest in completing all three doses of vaccine among girls and their parents. Similarly, a delay in completing all three doses of vaccine may reflect logistical difficulties related to vaccine supplies or personnel. While speed of vaccination has not typically been included in standard efficacy metrics for vaccine programs, these data could suggest that it could be as an aggregate indicator of a well-run program. This result should be confirmed in further studies, and we hope that other investigators will include speed of vaccination in their future studies in order to determine if this metric is a reproducible and reliable predictive factor for program performance. It should be noted that specific program duration was not a requirement imposed on Program grantees by the GAP.

Of the three types of vaccine delivery models assessed in this study, the school-based model was found to be the strongest positive predictive factor of higher VUR. School-based programs likely have the strongest impact on VUR; daily attendance of target girls at school allows them to be vaccinated more quickly than might occur at a health clinic that requires the girl to make a special trip. Given that this finding is based on data from a relatively large number of programs, we believe that this result supports the use of school-based models as a way to optimize delivery of HPV vaccines to school-aged girls. School-based delivery models may be more effective at delivering HPV vaccine because girls between the ages of 9 and 13 years, the target population recommended by the WHO for HPV vaccination, are likely to be present at school in the 12 programs.

The association between school-based models and increased VUR is supported by other studies that demonstrate the relevance of such models in delivering HPV vaccine. A high rate of HPV vaccine coverage (93.2% after three doses) was achieved in Rwanda using a school model [32]. One study found that school-based models have also been effective in demonstration programs in Peru, Uganda, Viet Nam, and India (vaccine coverage ranged from 82.6% to 96.1%) [17], That report suggests that schools may be especially well-suited to reaching girls in the targeted HPV vaccine age range [32]. Additional studies also support the effectiveness of school-based HPV vaccine delivery programs in developing countries [33]. Similarly, a study in Brazil found VURs of 87.5%, 86.3%, and 85.0% at D1, D2 and D3 time respectively, in school-based vaccination delivery programs [34]. In that study, no significant differences in VUR were observed between public and private schools or urban and rural schools [34].

Other studies indicate that school-based models may be more effective than age-based models [32, 33, 35]. With 84% of children in developing world attending primary school in 2006, school-based models should be considered as an effective method for delivering HPV vaccine to target populations [36]. However, as previously reported, school-based programs may face obstacles if vaccination dates occur on non-school days, and clinic and/or door-to-door follow up may be required in order to complete the three-dose vaccine series [31]. Within the scope of GAP, girls moving away during school breaks or between school years were reported as a key factor that increased the number of girls lost to follow-up. In order to address this issue, it is important that the full vaccination course is administered during the academic school year. This again advocates for the need to carefully monitor the duration of the campaign and to ensure that girls receive all three doses within the recommended vaccine administration schedule that runs for a period of six months. We should also note that while an earlier analysis of only 8 programs participating in GAP found that mixed models were more effective than school-based models, the current analysis contains a larger number of programs, includes a higher number of vaccinated girls, and also utilizes more sophisticated statistical analyses [31].

Community involvement actions appeared to impact the efficacy of the programs, especially the VUR [32]. Programs in which communities were engaged in following-up with girls participating in the vaccination campaign had a higher mean VUR compared with programs that did not engage the community in this activity. This action had no effect on VA, suggesting that enrollment in the vaccine campaign is a bigger hurdle than getting girls who have enrolled to complete the three vaccine doses. There was an interesting trend toward increased VUR with an increase in the number of community involvement actions, suggesting a dose-effect response. However, this trend did not reach statistical significance, which may indicate that the type of activity in which communities are involved may be more important than the overall level of community engagement.

Understanding which aspects of an HPV vaccine campaign are most influenced by community standards, morals, and expectations may help in developing community engagement actions that impact VUR and VA [29]. Community sensitization about the availability and value of vaccinating school-aged girls against HPV may impact vaccine uptake. A study in Brazil found that the method used initially to notify parents about the vaccine had a significant impact on vaccine indicators [34]. That study found that information disseminated by schools was more important than information provided by local media with respect to vaccine uptake [34].

The inclusion of key messages regarding the safety and efficacy of the vaccine had a positive impact on VUR. This finding again suggests that initial enrollment is a greater barrier to completing the three doses of vaccine than is the need to return for repeated vaccine administrations. Key messages that address safety and efficacy at the launch of a vaccine campaign may help to increase enrollment by easing safety concerns and educating girls and their parents about the potential benefits of protection against the long-term consequences of HPV infection. The relatively high rate of VA D3-D1 (90.8%) found in the 21 programs suggests that most girls who participate in the first dose of the campaign remain in the program and complete the vaccine series. These results are consistent with those of a study conducted in Brazil, which found a 97.2% three-dose adherence rate in a school-based HPV vaccine delivery model [34]. This finding is important for those countries interested in implementing an HPV vaccination program to consider [26, 34]. Given the availability of census data from the Ministry of Education, and the high density of targeted girls within school populations, school-based delivery models appear to be the optimum approach for reaching girls eligible for vaccination against HPV [33]. Significant effort should be made at the start of any HPV vaccine program to identify all eligible girls and determine the most effective way to include them in the vaccine campaign.

For low and middle-income countries, it is a challenge to conduct effective cost analyses around HPV vaccination. Many countries adapt existing cost models, but these have been developed for high-income countries and may not be relevant [37]. Model predictions using six different vaccination models suggest that vaccination can reduce the incidence of HPV infection and cervical cancer in a cost-effective manner [38]. In these models, factors that influence cost effectiveness are discount rate, duration of vaccine protection, vaccine price, and HPV prevalence. In an effort to provide relevant data that could be used in designing HPV vaccine programs for low- and middle-income countries, we gathered cost data for seven of the GAP programs.

The mean cost per FIG and vaccine dose across the seven programs was estimated to be USD 8.80 and USD 2.70, respectively. Due to the small number programs with cost data available for this study, it was not possible to detect a significant difference in cost per FIG or per vaccine dose among the three models of vaccine delivery in this analysis. However, a study conducted in Tanzania found that the cost per FIG was lower for class-based delivery models compared with age-based delivery in a large schools-based delivery programs including a total of 134 primary schools [39]. Another study in Tanzania found that implementation of a nationwide HPV vaccine program was associated with significant non-vaccine costs, such as financing of pre-introduction activities, development of new delivery infrastructure, and the deployment of new human resources or reallocation of existing personnel [40]. A study that was conducted in Peru, Uganda and Viet Nam and included five HPV vaccination projects found that the cost per vaccine was lower when vaccine delivery was integrated into health services compared with school-based and integrated outreach [41]. Given the importance of building and enhancing the infrastructure for delivering health care to pre-adolescents, investments in non-vaccine costs related to HPV vaccination campaigns could be amortized over a broader array of health services that deliver a variety of interventions to the HPV vaccine target population [33, 41].

While our cost data include staffing costs for the programs assessed, they do not provide more detailed information on other non-vaccine costs categories that could substantively impact the implementation or sustainability of the programs [42]. A review of the available data from low- and middle-income countries found that HPV vaccination is cost-effective and potentially cost saving, especially in settings without organized cervical screening programs [43].

Our study has several limitations. First, the 21 programs used various sources of census data that may have been potentially inaccurate to calculate their target populations, which could impact VUR results. Our finding of VUR greater than 100% in three programs may indicate an under-estimation of the target population and/or recruitment of girls from outside of the original target area, suggesting that the methodologies used for determining the target population may be suboptimal. Second, because 21 programs were included in the study, a potential lack of statistical power could be discussed, particularly for the analysis between the sensitization methods used in different programs and VUR and VA results. Consequently, the results from a given model may not accurately reflect the potential performance of that model over an entire population and larger vaccination programs. Third, we have defined program duration as the time from the date of shipment of first vaccine dose to the date of delivery of the third vaccine dose. Although this may not be the most precise measurement of program duration, the definition that we used yielded interesting results and warrants further evaluation. Despite these limitations, this study provides important insight into factors that impact VUR and VA in a very large sample of HPV vaccine programs reaching more than 217,000 girls within a broad range of low and middle-income country contexts.

Conclusions

The high VUR and VA results across the 21 programs assessed in this study are consistent with previously reported studies from a variety of other HPV vaccine pilot programs [31, 32, 34, 44–47]. A school-based model appeared to be a predictive factor for vaccination coverage, as was management by an NGO. Taken together, these findings suggest that there may not be a “gold standard” vaccination program applicable on a global or even national scale. Rather, tailoring vaccine campaigns to meet the needs, challenges, and cultural priorities of specific regions or communities appears to generate programs with a high rate of success as determined by VUR and VA [48]. The diverse HPV vaccine programs included in this study provide concrete examples of how such programs can be adapted to address local and regional issues and concerns, and provide a useful framework in which countries can consider how to best expand their own HPV vaccination programs based on their individual epidemiological, economic, and health system challenges. The programs included in this study may be used as a starting point for national-scale HPV vaccination programs in their respective countries and related results may also be useful in the development of national HPV vaccination policies in low and middle-income countries.

References

  1. Ferlay J, Shin H, Baray F, Forman D, Mathers C, Parkin DM: Estimate of worldwide burden of in 2008. Globocan 2008. Int J Cancer. 2010, 127: 2893-2917. 10.1002/ijc.25516.

    Article  CAS  PubMed  Google Scholar 

  2. Yang BH, Bray FI, Parkin DM, Sellors JW, Zhang ZF: Cervical cancer as a priority for prevention in different world regions: an evaluation using years of life lost. Int J Cancer. 2004, 109: 418-424. 10.1002/ijc.11719.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Crosbie EJ, Einstein MH, Franceschi S, Kitchener HC: Human papillomavirus and cervical cancer. Lancet. 2013, 382: 889-899. 10.1016/S0140-6736(13)60022-7.

    Article  PubMed  Google Scholar 

  4. Walboomers JM, Jacobs MV, Manos MM, Bosch FX, Kummer JA, Shah KV, Snijders PJ, Peto J, Meijer CJ, Muñoz N: Human papillomavirus is a necessary cause of invasive cervical cancer worldwide. J Pathol. 1999, 189: 12-19. 10.1002/(SICI)1096-9896(199909)189:1<12::AID-PATH431>3.0.CO;2-F.

    Article  CAS  PubMed  Google Scholar 

  5. Munoz N, Bosch FX, de Sanjose S, Herrero R, Castellsague X, Shah KV, Snijders PJ, Meijer CJ, International Agency for Research on Cancer Multicenter Cervical Cancer Study Group: Epidemiologic classification of human papillomavirus types associated with cervical cancer. N Engl J Med. 2003, 348: 518-527. 10.1056/NEJMoa021641.

    Article  PubMed  Google Scholar 

  6. Quadrivalent V: Quadrivalent vaccine against human papillomavirus to prevent high-grade cervical lesions. N Engl J Med. 2007, 356: 1915-1927.

    Article  Google Scholar 

  7. Paavonen J, Jenkins D, Bosch FX, Naud P, Salmeron J, Wheeler CM, Chow SN, Apter DL, Kitchener HC, Castellsague X, de Carvalho NS, Skinner SR, Harper DM, Hedrick JA, Jaisamrarn U, Limson GA, Dionne M, Quint W, Spiessens B, Peeters P, Struyf F, Wieting SL, Lehtinen MO, Dubin G, HPV PATRICIA study group: Efficacy of a prophylactic adjuvanted bivalent L1 virus-like-particle vaccine against infection with human papillomavirus types 16 and 18 in young women: an interim analysis of a phase III double-blind, randomised controlled trial. Lancet. 2007, 369: 2161-2170. 10.1016/S0140-6736(07)60946-5.

    Article  CAS  PubMed  Google Scholar 

  8. Paavonen J, Naud P, Salmeron J, Wheeler CM, Chow SN, Apter D, Kitchener H, Castellsague X, Teixeira JC, Skinner SR, Hedrick J, Jaisamrarn U, Limson G, Garland S, Szarewski A, Romanowski B, Aoki FY, Schwarz TF, Poppe WA, Bosch FX, Jenkins D, Hardt K, Zahaf T, Descamps D, Struyf F, Lehtinen M, Dubin G, HPV PATRICIA Study Group: Efficacy of human papillomavirus (HPV)-16/18 AS04-adjuvanted vaccine against cervical infection and precancer caused by oncogenic HPV types (PATRICIA): final analysis of a double-blind, randomised study in young women. Lancet. 2009, 374: 301-314. 10.1016/S0140-6736(09)61248-4.

    Article  CAS  PubMed  Google Scholar 

  9. Taira AV, Neukermans CP, Sanders GD: Evaluating human papillomavirus vaccination programs. Emerg Inf Dis. 2004, 10: 1915-1923. 10.3201/eid1011.040222.

    Article  Google Scholar 

  10. Villa LL, Costa RL, Petta CA, Andrade RP, Paavonen J, Iversen OE, Olsson SE, Høye J, Steinwall M, Riis-Johannessen G, Andersson-Ellstrom A, Elfgren K, Krogh G, Lehtinen M, Malm C, Tamms GM, Giacoletti K, Lupinacci L, Railkar R, Taddeo FJ, Bryan J, Esser MT, Sings HL, Saah AJ, Barr E: High sustained efficacy of a prophylactic quadrivalent human papillomavirus types 6/11/16/18 L1 virus-like particle vaccine through 5 years of follow-up. Brit J Cancer. 2006, 95: 1459-1466. 10.1038/sj.bjc.6603469.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Katahoire RA, Jitta J, Kivumbi G, Murokora D, Arube WJ, Siu G, Arinaitwe L, Bingham A, Mugisha E, Tsu V, LaMontagne DS: An assessment of the readiness for introduction of the HPV vaccine in Uganda. Afr J Reprod Health. 2008, 12: 159-172.

    CAS  PubMed  Google Scholar 

  12. Harries J, Moodley J, Barone MA, Mall S, Sinanovic E: Preparing for HPV vaccination in South Africa: key challenges and opinions. Vaccine. 2009, 27: 38-44. 10.1016/j.vaccine.2008.10.033.

    Article  PubMed  Google Scholar 

  13. Becker-Dreps S, Otieno WA, Brewer NT, Agot K, Smith JS: HPV vaccine acceptability among Kenyan women. Vaccine. 2012, 28: 4864-4867.

    Article  Google Scholar 

  14. Agosti JM, Goldie SJ: Introducing HPV vaccine in developing countries–key challenges and issues. N Engl J Med. 2007, 356: 1908-1910. 10.1056/NEJMp078053.

    Article  CAS  PubMed  Google Scholar 

  15. Goldie SJ, O’Shea M, Diaz M, Kim SY: Benefits, cost requirements and cost-effectiveness of the HPV16, 18 vaccine for cervical cancer prevention in developing countries: policy implications. Reprod Health Matters. 2008, 32: 86-96.

    Article  Google Scholar 

  16. Franco EL, Tsu V, Herrero R, Lazcano-Ponce E, Hildesheim A, Munoz N, Murillo R, Sánchez GI, Andrus JK: Integration of human papillomavirus vaccination and cervical cancer screening in Latin America and the Caribbean. Vaccine. 2008, 26 (Suppl11): L88-L95.

    Article  PubMed  Google Scholar 

  17. LaMontagne DS, Barge S, Le NT, Mugisha E, Penny ME, Gandhi S, Janmohamed A, Kumakech E, Mosqueira NR, Nguyen NQ, Paul P, Tang Y, Minh TH, Uttekar BP, Jumaan AO: Human papillomavirus vaccine delivery strategies that achieved high coverage in low- and middle-income countries. J Bull World Health Organ. 2011, 89: 821-830B. 10.2471/BLT.11.08986.

    Article  Google Scholar 

  18. Brewer NT, Fazekas KI: Predictors of HPV vaccine acceptability: a theory-informed, systematic review. Prev Med. 2007, 45: 107-114. 10.1016/j.ypmed.2007.05.013.

    Article  PubMed  Google Scholar 

  19. Biellik R, Levin C, Mugisha E, LaMontagne DS, Bingham A, Kaipilyawar S, Gandhi S: Health systems and immunization financing for human papillomavirus vaccine introduction in low-resource settings. Vaccine. 2009, 44: 6203-6209.

    Article  Google Scholar 

  20. Bingham A, Drake JK, LaMontagne DS: Sociocultural issues in the introduction of human papillomavirus vaccine in low-resource settings. Arch Pediatr Adolesc Med. 2009, 163: 455-461. 10.1001/archpediatrics.2009.50.

    Article  PubMed  Google Scholar 

  21. Coleman MA, Levison J, Sangi-Haghpeykar H: HPV vaccine acceptability in Ghana, West Africa. Vaccine. 2011, 29: 3945-3950. 10.1016/j.vaccine.2011.03.093.

    Article  PubMed  Google Scholar 

  22. DiAngi YT, Panozzo CA, Ramogola-Masire D, Steenhoff AP, Brewer NT: A cross-sectional study of HPV vaccine acceptability in Gaborone, Botswana. PLoS One. 2011, 6 (10): e25481-10.1371/journal.pone.0025481.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. Jaspers L, Budiningsih S, Wolterbeek R, Henderson FC, Peters AA: Parental acceptance of human papillomavirus (HPV) vaccination in Indonesia: a cross-sectional study. Vaccine. 2011, 29: 7785-7793. 10.1016/j.vaccine.2011.07.107.

    Article  CAS  PubMed  Google Scholar 

  24. Kane MA, Sherris J, Coursaget P, Aguado T, Cutts F: Chapter 15: HPV vaccine use in the developing world. Vaccine. 2006, 24 (Suppl 3S3): 132-139.

    Article  Google Scholar 

  25. Louie KS, de Sanjose S, Mayaud P: Epidemiology and prevention of human papillomavirus and cervical cancer in sub-Saharan Africa: a comprehensive review. Trop Med Int Health. 2009, 14: 1287-1302. 10.1111/j.1365-3156.2009.02372.x.

    Article  PubMed  Google Scholar 

  26. Sherris J, Friedman A, Wittet S, Davies P, Steben M, Saraiya M: Chapter 25: Education, training, and communication for HPV vaccines. Vaccine. 2006, 24 (Suppl 3): 210-218.

    Article  Google Scholar 

  27. Wigle J, Coast E, Watson-Jones D: Human papillomavirus (HPV) vaccine implementation in low and middle-income countries (LMICs): health system experiences and prospects. Vaccine. 2013, 31: 3811-3817. 10.1016/j.vaccine.2013.06.016.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Wright TC, Bosch FX, Franco EL, Cuzick J, Schiller JT, Garnett GP, Meheus A: Chapter 30: HPV vaccines and screening in the prevention of cervical cancer; conclusions from a 2006 workshop of international experts. Vaccine. 2006, 24 (Suppl 3): 251-261.

    Article  Google Scholar 

  29. WHO: Human papillomavirus vaccines: WHO position paper. WHO Weekly Epidemiol Record. 2009, 84: 117-132.

    Google Scholar 

  30. Arora NK, Lal AA, Hombach JM, Santos JI, Bhutta ZA, Sow SO, Greenwood B: The need for targeted implementation research to improve coverage of basic vaccines and introduction of new vaccines. Vaccine. 2008, 31 (Suppl 2): B129-B136.

    Google Scholar 

  31. Ladner J, Besson MH, Hampshire R, Tapert L, Chirenje M, Saba J: Assessment of eight HPV vaccination programs implemented in lowest income countries. BMC Public Health. 2012, 12: 370-10.1186/1471-2458-12-370.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Binagwaho A, Wagner CM, Gatera M, Karema C, Nutt CT, Ngabo F: Achieving high coverage in Rwanda’s national human papillomavirus vaccination programme. J Bull World Health Organ. 2012, 90: 623-628. 10.2471/BLT.11.097253.

    Article  Google Scholar 

  33. Kane MA, Serrano B, de Sanjose S, Wittet S: Implementation of human papillomavirus immunization in the developing world. Vaccine. 2012, 30 (Suppl5): F192-F200.

    Article  PubMed  Google Scholar 

  34. Fregnani JH, Carvalho AL, Eluf-Neto J, Ribeiro Kde C, Kuil Lde M, Da Silva TA, Rodrigues SL, Mauad EC, Longatto-Filho A, Villa LL: A school-based human papillomavirus vaccination program in barretos, Brazil: final results of a demonstrative study. PLoS One. 2013, 8: e62647-10.1371/journal.pone.0062647.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Watson-Jones D, Baisley K, Ponsiano R, Lemme F, Remes P, Ross D, Kapiga S, Mayaud P, de Sanjosé S, Wight D, Changalucha J, Hayes R: Human papillomavirus vaccination in Tanzanian schoolgirls: cluster-randomized trial comparing 2 vaccine-delivery strategies. J Inf Dis. 2012, 206: 678-686. 10.1093/infdis/jis407.

    Article  Google Scholar 

  36. UNICEF: Progress for Children 2007 - Primary Education. 2007, New York: United Nations Children’s Fund, Available at:http://www.unicef.org/progressforchildren/2007n6/files/Progress_for_Children_-_No._6.pdf (last accessed May 2014)

    Google Scholar 

  37. Jit M, Levin C, Brisson M, Levin A, Resch S, Berkhof J, Kim J, Hutubessy R: Economic analyses to support decisions about HPV vaccination in low- and middle-income countries: a consensus report and guide for analysts. BMC Med. 2013, 11: 23-10.1186/1741-7015-11-23.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Jit M, Demarteau N, Elbasha E, Ginsberg G, Kim J, Praditsitthikorn N, Sinanovic E, Hutubessy R: Human papillomavirus vaccine introduction in low-income and middle-income countries: guidance on the use of cost-effectiveness models. BMC Med. 2011, 9: 54-10.1186/1741-7015-9-54.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Quentin W, Terris-Prestholt F, Changalucha J, Soteli S, Edmunds WJ, Hutubessy R, Ross DA, Kapiga S, Hayes R, Watson-Jones D: Costs of delivering human papillomavirus vaccination to schoolgirls in Mwanza Region, Tanzania. BMC Med. 2012, 10: 137-10.1186/1741-7015-10-137.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Hutubessy R, Levin A, Wang S, Morgan W, Ally M, John T, Broutet N: A case study using the United Republic of Tanzania: costing nationwide HPV vaccine delivery using the WHO Cervical Cancer Prevention and Control Costing Tool. BMC Med. 2012, 10: 136-10.1186/1741-7015-10-136.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Levin CE, Van Minh H, Odaga J, Sari Rout S, Nguyen Thi Ngoc D, Menezes L, Araujo MA, LaMontagne DS: Delivery costs of human papillomavirus vaccination of young adolescent girls in Peru, Uganda and Viet Nam. Bull World Health Organ. 2013, 91: 595-920.

    Article  Google Scholar 

  42. Broutet N, Lehnertz N, Mehl G, Camacho AV, Bloem P, Chandra-Mouli V, Ferguson J, Dick B: Effective health interventions for adolescents that could be integrated with human papillomavirus vaccination programs. J Adolesc Health. 2013, 53: 6-13. 10.1016/j.jadohealth.2013.02.022.

    Article  PubMed  Google Scholar 

  43. Fesenfeld M, Hutubessy R, Jit M: Cost-effectiveness of human papillomavirus vaccination in low and middle-income countries: a systematic review. Vaccine. 2013, 31: 3786-3804. 10.1016/j.vaccine.2013.06.060.

    Article  PubMed  Google Scholar 

  44. Penny M, Bartolini R, Mosqueira NR, LaMontagne DS, Mendoza MA, Ramos I, Winkler JL, Villafana J, Janmohamed A, Jumaan AO: Strategies to vaccinate against cancer of the cervix: feasibility of a school-based HPV vaccination program in Peru. Vaccine. 2011, 29: 5022-5030. 10.1016/j.vaccine.2011.04.078.

    Article  PubMed  Google Scholar 

  45. Moodley I, Tathiah N, Mubaiwa V, Denny L: High uptake of Gardasil vaccine among 9–12 years-old schoolgirls participating in an HPV vaccination demonstration project in KwaZulu-Natal, South Africa. S Afr Med J. 2013, 105: 318-321.

    Google Scholar 

  46. Singh Y, Shah A, Singh M, Verma S, Shrestha BM, Vaida P, Nakarmi RP, Shrestha SB: Human papilloma virus vaccination in Nepal: an initial experience in Nepal. Asian Pac J Cancer Prev. 2010, 11: 615-617.

    PubMed  Google Scholar 

  47. Cover JK, Nghi NQ, LaMontagne DS, Huyen DT, Hien NT, Nga T: Acceptance patterns and decision-making for human papilloma virus vaccination among parents in Vietnam: an in-depth qualitative study post-vaccination. BMC Public Health. 2012, 12: 629-10.1186/1471-2458-12-629.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Russell M, Raheja V, Jaiyesimi R: Human papillomavirus vaccination in adolescence. Perspect Public Health. 2013, 133: 320-324. 10.1177/1757913913499091.

    Article  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgements

The authors would like to acknowledge the contributions of the following institutions: National Referral Hospital (Bhutan), International Planned Parenthood Federation [IPPF] Centro de Investigación, Educación y Servicios [CIES], Ministerio de Salud y Deportes, Universidad Mayor de San Andrés (Bolivia), Hôpital de l’Amitié Khméro-Soviétique (Cambodia), Cameroon Baptist Convention Health Services (Cameroon), National Screening Center with Ministry of Health Republican Immunoprophylactic Center (Georgia), Zanmi Lasante [ZL] (Haiti), Hospital Santo Hermano Pedro Betancourt, Fundación Hondureña para el Niño con Cáncer, Ministry of Health (Honduras), Moi Teaching and Referral Hospital (Kenya) Ministry of Health and Social Welfare (Lesotho), Ministry of Health (Moldova), Nepal Network for Cancer Treatment and Research [NNCTR] (Nepal), National Institute for Medical Research (Tanzania), Mildmay Uganda (Uganda), Ministry of Health (Uzbekistan) and their respective team and partners.

The authors acknowledge the contributions made by the members of the Gardasil Access Program Advisory Board.

Special thanks to Dr. Stephanie Seiler for editing and revision of the manuscript.

Author information

Authors and Affiliations

  1. Rouen University Hospital, Epidemiology and Public Health Department, Hôpital Charles Nicolle, 1, rue de Germont, 76 031, Rouen, France

    Joël Ladner

  2. Axios International, Paris, France

    Marie-Hélène Besson, Mariana Rodrigues & Joseph Saba

  3. Hôpital Henri Mondor Hospital, Public Health, Assistance Publique Hôpitaux de Paris, Paris Est University, Créteil, France

    Etienne Audureau

Authors
  1. Joël Ladner
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marie-Hélène Besson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mariana Rodrigues
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Etienne Audureau
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Joseph Saba
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Joël Ladner.

Additional information

Competing interests

Although Axios Healthcare Development received financial compensation from Merck & Co. for the routine management of the Gardasil Access Program (GAP), the results of the 21 programs presented here are a complete and accurate representation of the data collected through the program’s pre-specified follow-up process. Additionally, JL (corresponding author) and EA are not Axios employees and declare that they have no competing interests. These two authors had the primary roles in developing the concept and design of the study, and JL performed the analysis and wrote the manuscript.

Authors’ contributions

JL conceived the study, wrote the manuscript and performed the analysis. MHB conceived the study, collected data and helped to draft the manuscript. MR helped to draft the manuscript. EA helped to analysis and to draft the manuscript. JS conceived the study and revised the manuscript. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ladner, J., Besson, MH., Rodrigues, M. et al. Performance of 21 HPV vaccination programs implemented in low and middle-income countries, 2009–2013. BMC Public Health 14, 670 (2014). https://doi.org/10.1186/1471-2458-14-670

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2458-14-670

Keywords

BMC Public Health

ISSN: 1471-2458

Contact us