Skip to main content

Who gets vaccinated in a measles-rubella campaign in Nepal?: results from a post-campaign coverage survey

Abstract

Background

Following the 2015 earthquake, a measles-rubella (MR) supplementary immunization activity (SIA), in four phases, was implemented in Nepal in 2015–2016. A post-campaign coverage survey (PCCS) was then conducted in 2017 to assess SIA performance and explore factors that were associated with vaccine uptake.

Methods

A household survey using stratified multi-stage probability sampling was conducted to assess coverage for a MR dose in the 2015–2016 SIA in Nepal. Logistic regression was then used to identify factors related to vaccine uptake.

Results

Eleven thousand two hundred fifty-three households, with 4870 eligible children provided information on vaccination during the 2015–2016 MR SIA. Overall coverage of measles-rubella vaccine was 84.7% (95% CI: 82.0–87.0), but varied between 77.5% (95% CI: 72.0, 82.2) in phase-3, of 21 districts vaccinated in Feb-Mar 2016, to 97.7% (CI: 95.4, 98.9) in phase-4, of the last seven mountainous districts vaccinated in Mar-Apr 2016. Coverage in rural areas was higher at 85.6% (CI: 81.9, 88.8) than in urban areas at 79.0% (CI: 75.5, 82.1). Of the 4223 children whose caregivers knew about the SIA, 96.5% received the MR dose and of the 647 children whose caregivers had not heard about the campaign, only 1.8% received the MR dose.

Conclusions

The coverage in the 2015–2016 MR SIA in Nepal varied by geographical region with rural areas achieving higher coverage than urban areas. The single most important predictor of vaccination was the caregiver being informed in advance about the vaccination campaign. Enhanced efforts on social mobilization for vaccination have been used in Nepal since this survey, notably for the most recent 2020 MR campaign.

Peer Review reports

Introduction

In Nepal, the Expanded Program on Immunization (EPI) was launched in 1977 and was expanded to all district by 1989. Initially, the national immunization schedule included one dose of measles vaccine recommended at 9 months [1, 2]. Since conducting a measles catch-up campaign in 2004–2005 and a follow-up campaign in 2008, Nepal saw a 98% drop in reported measles cases, from 12,074 in 2004 to 190 in 2010 [2]. In the pre-rubella vaccine era in Nepal, up to 1426 children or 192 cases per 100,000 live births were estimated to be born each year with congenital rubella syndrome (CRS). In 2013, the measles-rubella (MR) vaccine was introduced in routine immunization following an MR vaccination campaign [1, 3].

To maintain the achievements in measles and rubella control and to prevent a measles outbreak after the devastating earthquake of 2015, a MR (and polio) supplementary immunization activity (SIA), or “MR campaign”, was conducted in four phases covering all districts between 2015 and 2016. The campaign targeted children aged 6 months to 5 years in earthquake affected districts and 9 months to 5 years in other districts. MR campaign phases were:

  • First phase conducted in in Aug-Sep 2015, in the 14 districts highly affected by the 2015 earthquake.

    • ◦ This phase was followed by the introduction of a second MR dose in the national routine immunization schedule targeting children aged 15 months

  • Second phase in 33 districts Feb-Mar 2016,

  • Third phase in 21 districts starting later in Feb-Mar 2016, and

  • Fourth phase in the last seven mountainous districts Mar-Apr 2016.

The overall administrative coverage of the 2015–2016 campaign was above 95% [4]. The planning for each SIA phase was done at national and district levels. Nepal has very well spread out network of Female Community Health Volunteers (FCHV) who were utilized for community mobilization. Opinion leaders at national as well as sub-national levels are always involved in major public health activities like an SIA and they also helped in communication and social mobilization. For immunization, Nepal has an institutionalized mechanism of community ownership and engagement of opinion leaders through Immunization Coordination Committees at successive subnational levels; members include elected representatives (Mayors, Chairpersons of municipalities, municipal ward members etc.) and members of civil society organizations. Health workers and independent monitors were deployed for house to house visit to identify missed children and to vaccinate through campaign. Key elements added to SIA planning for the SIA in earthquake-affected areas included: a) microplanning to accommodate displaced populations - additional session sites were planned in makeshift camps where affected population were residing along with usual one site per ward (standard practice for campaign planning); b) revamping of cold chain - Identification of cold-chain equipment destroyed, replaced with passive cold -chain equipment for vaccine storage; and c) In places where vaccine transportation was an added challenge after the earthquake, alternate arrangements were made with porters.Footnote 1

Since 2017, MR1 coverage in routine immunization in Nepal has remained at or above 90%, while MR2 coverage has gradually increased from 59% in 2017 to an estimated 76% in 2019 at the national level [2]. And yet, measles and rubella cases have continued to occur. Coverage with two doses of measles containing vaccine (MCV) has not reached 95% and latest surveys have shown geographic inequities between provinces [5]. Another vaccination campaign was planned for 2019, but it was postponed to 2020, and this last MR, plus polio, campaign was conducted in the midst of the COVID-19 pandemic [6].

A household survey was done in 2017 to assess coverage achieved in the 2015–2016 post earthquake measles-rubella immunization campaign. Here we report campaign coverage and explore correlation of some socio-epidemiological parameters and programmatic interventions with vaccination uptake in the campaign. We also discuss how these survey results vindicate the strategies undertaken by the Nepal national immunization program (NIP) for the MR-polio vaccine campaign conducted in Nepal in 2020.

Methods

2017 vaccination coverage survey

The MR post-campaign coverage survey (PCCS) was conducted with the main objective of estimating coverage obtained by the MR vaccination campaign 2015–2016 by rural/urban setting for each phase of the SIA campaign in the target age group of children. A sub-objective was to assess covariates positively associated with SIA dose uptake.

At the time of the MR campaign, Nepal was in the phase of transformation from unitary governance to federal government. Nepal did not have a federal governance structure and the country was administratively divided into five Development Regions and 75 districts with no provinces. Nepal transitioned to a federal governance structure fully in 2018 with seven provinces and 753 municipalities. In our analysis, we present weighted estimates of immunization coverage by phase (as per a-priori sampling design) as well as by province (by re-grouping the districts by province).

Table 1 shows correspondence between the phases of the MR SIA campaign and present provincial structure. Each district was subdivided into Village Development Committees (VDC) and Urban municipalities and all VDCs and municipalities in a district conducted the campaign at the time periods shown.

Table 1 Measles-Rubella vaccination campaign 2015–2016 – districts covered, age-group and target population, campaign duration and administrative coverage

Study population and sampling

The sampling universe included all children aged 9–59 months at the time of the 2015–2016 campaign (6–59 months in earthquake affected districts). An overlapping subset of children aged 12–23 months at the time of the survey was studied for routine immunization (RI) coverage as well as women who had given birth in the previous 12 months to estimate tetanus protection at birth; these two populations and survey results of these subsets are not described here.

The PCCS was conducted following the World Health Organization (WHO) vaccination coverage cluster survey reference manual (2015 working draft; finalized in 2018 and revised (minimally) in 2019 and again (minimally) in 2021) [7]. For variables related to religion and caste/ethnicity, we follow the definitions used by Government of Nepal programs and those used in the latest Nepal Demographic and Health Survey (NDHS). The country was divided into seven strata, by phase of campaign and by rural (VDC) and urban (municipality) setting: the first three phases of the campaign had both urban and rural settings and formed six strata; the fourth phase included only rural settings (VDC) adding the seventh stratum to the survey. Urban and rural estimates were combined using a weighted average to estimate coverage by campaign phase.

The primary sampling units (PSU) sampling frame was the list of enumeration areas (EAs) with population and household information from VDC or municipal setting developed by the Central Bureau of Statistics from the 2011 Population Census. EAs that were determined a priori to be of insufficient size (mostly in rural areas) were merged with a nearby PSU and those determined to be too large (mostly in urban areas) were segmented into 250–300 households in each segment and one segment was randomly selected. Selection of PSUs was done using probability proportional to the number of households in the EA in the 2011 census. A household listing and mapping exercise was done in each selected PSU right before the survey. Households were selected using a sampling interval supported by a digital tool built into the tablets used for data collection.

Sample size estimation

Sample size was calculated using the method given in Annex B of the 2015 draft WHO coverage survey manual [8]. The sample size for each stratum was calculated for the campaign outcome assuming vaccination coverage of 95%, a desired precision no wider than ±5% for the two-sided 95% confidence interval which gave the effective sample size as 162. The design effect was assumed to be no greater than 2.5 (estimated intra-cluster coefficient (ICC) of 1/6 and 10 respondents per cluster) and so sample size per stratum would be 410 (rounded) with a target of 10 children to be selected in each of 41 clusters. Applying birth and infant mortality rates, an average of 4 and 3 households would need to be visited to find an eligible child for MR campaign in urban and rural strata, respectively. Non-response was assumed to be 10%. Thus, the sample per stratum included 41 clusters, with an objective to visit 44 and 35 households per cluster in urban and rural areas, respectively. All eligible children in a selected household were included in the survey if the caregiver consented. Up to three visits were attempted per selected household to secure a completed interview.

Data collection

Field work took place from February to June 2017 for six strata and was deferred to October 2017 for the last stratum because of national elections. WHO Nepal engaged an external agency, Center for Molecular Dynamics (CMDN) for survey data collection. All enumerators and supervisors were trained through a 5-day training session that included practical work and pilot testing of the tools, and a 1-day refresher session in October for the last strata. Training sessions were led by experts from Department of Health Services and WHO. Data was collected using tablets and standardized questionnaires developed using CSPro [9]. MR-SIA campaign dates for different phases were pre-inputted in the program, so that the data collection tools would automatically identify if a sampled child was in the eligible age-group for that district at the time of the campaign. The interview included questions on campaign vaccination status and reasons for missing vaccination. Campaign cards were not used so only caregiver recall could be used to ascertain MR vaccination during the campaign. The questionnaires were developed in English and then translated into Nepali language (and back translated into English to verify accuracy). Pre-testing was carried out in a non-sample location in Kathmandu valley, which includes both urban and rural areas. The final questionnaire was bilingual on paper (English and Nepali), but the questions were asked in Nepali or the local language. The surveyor teams included local enumerators who could fluently speak the local language, and who could translate questions in the field. This was the case for all local level data collection activities. Additionally, all interviews were recorded on digital recorders to ensure no information was left out while back translating. Each tablet was synchronized and backed up daily to ensure safety of the data. To ensure adherence to the survey protocol and maximize data quality, field monitoring activities were done regularly by staff from CMDN, WHO and staff from National Immunization Program (NIP).

Ethical considerations

Ethical approval was obtained from Nepal Health Research Council (NHRC) prior to start of the survey (Reg. no. 33O/2O16). All the participants were informed about the survey purpose and recruitment procedures and about their right to decide whether to participate in the survey and to abstain from answering particular question/s. Informed consent was sought before starting the interview. Data was maintained safe and the database was deidentified. See section on “Ethics approval and consent to participate” for further details.

Statistical analysis

Survey weights were calculated in two steps: base weights were calculated as the inverse of the cumulative probability of selection over four stages (enumeration area, segment, household, child). Then base weights were post-stratified so the sum of weights in each stratum would match administrative province-level estimates of 2014/15 population under age 5 years [7].

Data was cleaned using SPSS and exported into Stata. Descriptive household demographics analyses and reasons for missing SIA vaccination are presented as weighted proportions (unless otherwise mentioned) and measures of central tendencies for continuous variables. The WHO survey analysis package Vaccination Coverage Quality Indicators (VCQI) was used to automate the calculation of coverage-related indicators [10, 11]. Weighted coverage estimates and 95% confidence intervals (CI) using the Wilson method were calculated for each stratum and the country, taking into account the sampling design [12]. Rao-Scott chi-square tests were used to compare coverage between various subgroups [13]. A p-value < 0.05 was considered statistically significant. Logistic regression was employed to assess demographic and program intervention covariates for association with whether a child received the campaign dose (response variable).

In an early screening step, numerous explanatory variables were assessed with univariable logistic regression. For each such regression, five performance metrics were noted:

  1. 1.

    The p-value of the regression: any covariate with a p-value smaller than 0.25 was considered a candidate to enter a later multivariable logistic regression.

  2. 2.

    The concordance statistic (c-statistic): The proportion of all possible pairs of vaccinated and unvaccinated children where the explanatory variable correctly predicted the response variable (vaccination status). A perfect model would yield a value of 1.0, meaning that every child who was vaccinated would be assigned a higher probability of the vaccination outcome than every child who was not vaccinated. When the value falls between 0 and 1.0, it represents the portion of pairs of vaccinated and unvaccinated children for whom the predicted probability is ordered correctly; a c-statistic of 90% is considered ‘outstanding discrimination’. This metric is also known as the area under the receiver operating characteristic (ROC) curve [14].

  3. 3.

    The proportion of children for whom the model predicts the probability of vaccination is > 50%.

  4. 4.

    The proportion of vaccinated children for whom the model predicts probability of vaccination is > 50%. Ideally 100%.

  5. 5.

    The proportion of un-vaccinated children for whom the model predicts probability of vaccination is < 50%. Ideally 100%.

A multivariable model was constructed using purposeful variable selection, starting with all variables in the model whose univariable p-value was smaller than 0.25 and then removing, one-by-one, the covariate with the highest p-value over 0.05, unless removing that variable changed the coefficients on one or more of the remaining covariates by more than 20% [15]. When that process was finished, the so-called main effects multivariable logistic regression model was estimated, and its utility was evaluated using the same five criteria used for univariable models. Interactions were not explored because there were an abundance of two-way interaction possibilities and none had been identified a priori as being of programmatic interest.

Regression analyses were conducted with Stata version 16 using syntax that takes the complex sample design into account [16]. The main effects model was assessed for goodness of fit to the data using the un-trimmed survey weights and three modified sets of weights that were trimmed using modest, medium, and aggressive trimming criteria; those methods and results are described in the electronic supplement [17, 18].

Results

A total of 11,275 households were sampled and 11,253 were interviewed for a response rate of 99.8%. In the interviewed households, 4870 children were identified as eligible for a MR dose in the 2015–2016 campaign and interviews were completed for all (Table 2).

Table 2 Number of households, number of interviews and response rates according to residence (unweighted), Nepal PCCS, 2017

Household characteristics (unweighted proportions)

Mean household size was 4.2 (SD: ±1.6). Among the 11,253 households interviewed, 4163 (37.0%) had at least one child eligible for the 2015–2016 MR vaccination campaign. Almost a third (31.0%) of the persons in the households interviewed were aged < 15 years. Almost all households had electricity (including solar electricity) (98.6%), access to improved source of drinking water (97.1%), an improved toilet facility (93.8%) and access to a mobile phone (98.4%). Nearly half of the respondents (45.4%) had migrated to their current location, (urban 54.8%; rural 12.3%). Among those who migrated, most had been living in the place of migration for more than 5 years in both the urban (70.9%) and rural settings (79.8%); 27.2% of households had at least one family member working abroad (usually in India).

Vaccination coverage during the 2015–2016 MR campaign

Overall, 84.7% (95% CI: 82.0–87.0) of eligible children received MR vaccine during the campaign. However, MR coverage varied from 77.5% (95% CI: 72.0, 82.2) in phase-3 to 97.7% (CI: 95.4, 98.9) in phase-4. The coverage in rural areas was higher at 85.6% (CI: 81.9, 88.8) than in urban areas at 79.0% (CI: 75.5, 82.1) (Table 3) Survey coverage was lower than that estimated through administrative reporting of number of doses administered divided by estimated target population in all strata (Table 1).

Table 3 National Measles-Rubella Campaign Coverage by selected characteristics, Vaccination Coverage Survey, Nepal, 2017

Of all caregivers (4870), 83.3% (95% CI: 79.8–86.3) reported having been informed about the campaign, with a higher proportion informed in rural (87.8%; 95% CI: 84.1–90.8) compared to urban areas (81.6%; 95% CI: 77.4–85.2) (Table 3).

Of 4223 caregivers who also stated the source of this prior information, 64.2% identified the female community health volunteer (FCHV) as the source. The second most common source of information was local health workers (LHW) at 21.4%. For rural residents, FCHV or LHW were the primary sources of prior information for 82.2 and 16.8% caregivers; for urban residents, these proportions were 57.2 and 23.2%. Some received the information from more than one source (Table 3).

Among the 759 (15.3%) caregivers of children not vaccinated during the campaign, the most common reason for non-vaccination was reported as lack of information by 93.1%, while 29.1% reported some form of obstacles to reach vaccination session sites and 19.9% did not feel the need to get their children vaccinated or had some fear of adverse reactions (the question allowed multiple responses).

Correlates of receiving SIA measles rubella (MR) vaccination

Table 4 shows survey estimated campaign coverage levels for different levels of 17 demographic and program intervention variables along with the odds ratio, p-value, and model performance metrics of univariable regression. The first entry in the table is quite notable: of the 4223 children whose caregivers knew about the campaign, 96.5% received the MR dose and of the 647 children whose caregivers did not know about the campaign, only 1.8% received the MR dose. The odds ratio for that variable is 1477; the p-value is infinitesimal, and if a predicted probability of 50% were used as the threshold for predicting vaccination, the univariable regression model would predict that 87.5% of the children were vaccinated: predicting correctly for 99.7% of children who were vaccinated and for 80.1% of children who were not. While some of the other univariable predictors show some power to discriminate between children who were vaccinated and those who were not, all of those models predict > 50% probability of vaccination for every child. Of the 17 univariable models tested, the concordance statistic (c-statistic) was 90% for the variable about caregiver ‘knew of MR-SIA campaign’, 60% and above for four variables (ethnic group, source of income, province, and ecological zone), and for the remaining 12 variables, it was between 50 and 59%. The higher the c-statistic, the better the model discriminates between vaccinated and unvaccinated children [14].

Table 4 Logistic regression model performance of exploratory univariable models and the multivariable main effects model

Twelve variables with univariable p-values below 0.25 met the criteria to remain in the initial multivariable model and in a final round of variable checking, one of the original variables with univariable p-value > 0.25 (child age group) entered the main effects model with a p-value smaller than 0.05, so was retained. Caregiver marital status and caregiver religion had p-values below 0.05 but were dropped because a) marital status led to a very large odds ratio for the N = 33 unmarried women and b) religion appeared to be colinear with ethnic group and including both in the model yielded an extremely high odds ratio for the Muslim ethnic group. Dropping these two covariates did not notably change the prediction performance of the model. The variables in the main effects model are listed in Table 5 and the classification performance of the main effects model is described in the final row of Table 4. The odds ratios and model output of the main effects model are shown in Table 6. The main effects model yielded a c-statistic of 0.96, which is considered “outstanding discrimination”. Note in Table 4 that the prediction performance of the main effects model is very nearly equivalent to that of the univariable model with ‘caregiver knew about campaign’. An electronic supplement includes additional commentary on the univariable and multivariable regression models.

Table 5 Variables in the main effects model
Table 6 Logistic regression parameters for multivariable main effects model

Discussion

The Gorkha earthquake in April 2015 and a major aftershock in May devastated Nepal and killed nearly 9000 people and injured 22,000 [19]. Measles outbreaks often follow natural disasters like these [20, 21]. The national immunization programme of Nepal responded promptly with a preventive SIA with measles-rubella and oral polio vaccines within 4 months of the earthquake in the affected districts (1st phase). The remaining districts were covered through a phased (three phases) campaign between February and April 2016. The campaign was effective in preventing any major outbreak of measles or rubella. In 2015, 2016 and 2017 there were 272, 282 and 99 confirmed measles cases and 9, 22 and 21 confirmed cases of rubella [22].

This post-campaign coverage survey (PCCS) estimated that the SIA campaign vaccinated 83% of the target children in the immediate post-earthquake phase and achieved an overall coverage of 85% for all phases combined, ranging from 78 to 98% between the four phases. Thus the overall coverage was lower than the target of at least 90% coverage but coupled with a sustained relatively high coverage with at least one dose of measles containing vaccine in routine immunization, it was probably sufficient to prevent the anticipated post-disaster flare-up of measles transmission evidenced by the declining trend in cases seen in national surveillance data [5, 23]. The fourth phase in mountain districts achieved the highest coverage of 98%, whereas the third phase covering mostly Terai and hill districts had the lowest coverage at 78%. We did not specifically look at province level factors determining immunization status. However, immunization coverage in Terai districts, especially province 2 has been historically low and may require further investigation. Published coverage evaluation data from SIA in Nepal is scanty. An unpublished report from an SIA campaign with MR vaccine in 2013 estimated the national vaccination coverage was 89.3% in 9–59 month old children (WHO-IPD data). No disaggregation by terrain was available [24].

Other surveys have also shown lower coverage in routine immunization in some Terai districts or in provinces which comprise mostly of Terai districts [5, 25]. As these districts have lesser challenges with physical access as compared to mountain districts, the reasons for lower immunization coverage should be explored by examining societal, communication or other programmatic challenges rather than physical access challenges alone. Results from the survey were compared with administrative coverage. While the ranking of performance of each phase is somewhat maintained, i.e., higher coverage in phases 4 and 2 and lower in phases 1 and 3, survey estimates are lower. This can be explained by several factors including difficulties in exactly ascertaining age, vaccination in campaigns of children above and below the target age, and a mismatch (often difficult to quantify) between where a person gets vaccinated and where he/she resides, the latter more frequent in urban settings [26].

In our survey, a limited number of socio-economic and geographic characteristics were explored and none was found to be significantly associated with SIA immunization status except residence by ecological zone where the mountain districts had the highest coverage of 96.1% (95% CI: 89.3, 98.6) while the Terai districts had lowest coverage of 80.0% (74.4, 84.7). Other authors have recently explored inequalities in immunization and other maternal and child health interventions in Nepal noting that the equity gap has been rapidly narrowing [27].

Other correlates of immunization coverage were explored to obtain actionable information from this survey which could inform future immunization programme interventions. Having information about the campaign ahead of time was almost perfectly predictive of whether the child received the MR dose. A child whose caregiver knew about the campaign beforehand was 53.6 times more likely to be vaccinated than one whose caregiver did not.

It is simple and reasonably accurate to say that although some other factors are correlated with receiving the campaign dose, the strongest predictor is one that agrees with what we know about Nepali culture and thankfully, one which the Ministry of Health and Population has power to affect: Nepali caregivers utilize child health services that they know about. The strong recommendation that comes through in these analyses is to let caregivers know about the time and place of vaccination campaigns and most will avail themselves of the service. Reaching out to caregivers with information about SIA through interpersonal communication is a program intervention that can be implemented by program managers with the right strategy and resources. Prior communication before an SIA to increase awareness in the community has also been effective in other countries. In Haiti, a similar analysis showed that children from household with prior knowledge of the SIA were significantly more likely to get vaccinated in the SIA [28].

The survey had several limitations. The fieldwork was conducted more than a year after completion of the SIA campaign and because there was no child-level written record of the SIA doses given, there could have been recall bias in ascertainment of SIA vaccination status. However, in Nepal routine immunization is delivered on the same date of the month from fixed posts. Immunization campaigns with injectable vaccines are delivered from the same posts but on a different date and the target age groups are different which would help distinct recall of the SIA campaign. As FCHV and health workers are personally known to the caregivers in most villages through frequent interactions, it is unlikely that the history about prior information would be subject to substantial recall bias. The response rate in the survey was very high at 99.8% which would mitigate against biases from selection or non-response, and indirectly reflects the Nepali community’s openness and trust in sharing immunization related information.

The observed design effect in this survey was 8.6, which is over three times the value used when calculating the survey sample size (2.5). The observed intra-cluster correlation coefficient in this survey was 0.178 which is only slightly higher than the assumed value of 0.167. But the average number of respondents per cluster was 17 instead of the 10 that were targeted. Also, there was some heterogeneity in the survey weights which contributed to the design effect – a topic that was not addressed in WHO’s 2015 draft reference manual but was added to Annex B1 of the finalized manual in 2018 [7]. Some expected heterogeneity of weights should be taken into account in future immunization survey sample size calculations in Nepal. The number of target households per cluster may be reduced somewhat compared with the planning parameters used for this survey to avoid collecting data from more respondents per cluster than planned.

The regression analyses ignore supply-side covariates, using only the fixed effect of province to control for differences in how the campaign was advertised, supplied, and conducted. It would be a good idea for vaccination campaigns to closely document supply-side problems and furnish those records to coverage survey analysts, but in practice this is not usually prioritized. As mentioned by a helpful reviewer, it would be nice to also capture a rich set of covariates from several levels of the health system and use multilevel regression to explore factors that correlate with differences in campaign outcomes across subnational strata. Instead, the regression analyses reported here are limited to individual level covariates collected from children’s caregivers and therefore only useful for describing differences at the individual level and not aggregated to subnational strata.

A final limitation is that a cross-sectional survey cannot be used to confirm causal relationships between respondent characteristics and whether they received the campaign dose. The regression analyses reported here describe correlation, but not necessarily causation.

This is the first time that the current WHO-vaccination cluster survey guidance was applied in Nepal. Beyond navigating difficult terrain in some of the selected clusters, there were no serious operational issues faced during selection of the primary sampling units or in the fieldwork to select households and caregivers. This showed that the new guidance based on a fixed number of households per cluster, rather than the earlier 30 × 7, or any quota sampling method for children used for immunization cluster surveys, is feasible to apply even in developing countries with a diverse terrain like Nepal [7].

Nepal has recently conducted another nationwide MR SIA campaign in 2020. Although the detailed analysis presented here was not yet known at that time when this SIA was being initially planned in 2018, for conduction in 2019, preliminary data from this PCCS had indicated that reaching prior information to caregivers would be a key intervention to increase coverage and that information received through interpersonal interaction with FCHV and local health worker was the most important source of prior information. The 2020 MR SIA campaign thus strategically planned to distribute invitation cards to caregivers through house visits by FCHV and health workers before the campaign, as well as SIA cards to caregivers as a record of SIA vaccination and undertook other mass communication strategies described below. Our analyses vindicate those strategic decisions.

For those caregivers whose children were not vaccinated in the 2015–2016 MR campaign, 93% mentioned lack of information as the main reason for not getting vaccinated. Only about 20% also mentioned any fear of adverse events following immunization as the reason for not getting vaccinated. As Nepal rolls out COVID-19 vaccination programme in 2021, these results should inform decisions regarding interpersonal communications through FCHV or local HW to harness community demand for COVID-19 vaccination.

It was well understood that communication would hold the key for successful immunization campaigns in Nepal. In the 2020 campaign, within the framework of vaccination as a human right as envisaged in the Immunization Act of Nepal, mayors and municipal chairpersons, non-governmental organization and local volunteers (FCHV, mothers’ groups and school personnel) were involved to make it a success [29].

This study explored for evidence of factors influencing positive deviance behaviour in supplementary immunization activities. In Nepal the programme intervention of giving prior intimation to caregivers through interpersonal communication worked with such astounding impact presumably because other components of the immunization value chain (micro-planning, cold chain and logistics, timely sessions, safe injections, management of adverse events etc.) also functioned properly. Using survey data to identify one or more specific actionable programme intervention(s), like better communication in this case, which influence positive deviance behaviour, can be pursued by immunization programmes and considered as part of a global best practice package.

Availability of data and materials

The datasets used and/or analysed during the current study available from the corresponding author on reasonable request. Also, the link to .zip file holding the anonymized vaccine coverage quality indicator (VCQI) tool compatible datasets, VCQI control program, VCQI augmented dataset, codebooks, Stata .do-file that estimates the logistic regressions from Table 4 and makes the figure in supplement #1, and a link to a .zip file holding the VCQI source code used for the analysis.

https://www.dropbox.com/s/el6qcqyeyrj05un/Nepal%202016%20PCCS%20measles%20data%20and%20analysis%20programs.zip?dl=0

Notes

  1. More details about the SIA implementation can be found in the SIA report, which is available upon request to the authors.

References

  1. Khanal S, Sedai TR, Choudary GR, Giri JN, Bohara R, Pant R, et al. Progress toward measles elimination - Nepal, 2007-2014. MMWR Morb Mortal Wkly Rep. 2016;65:206–10. https://doi.org/10.15585/mmwr.mm6508a3.

    Article  PubMed  Google Scholar 

  2. World Health Organization. WHO Immunization monitoring global summary time series 2020. https://apps.who.int/immunization_monitoring/globalsummary/timeseries/tsincidencemeasles.html. Accessed 18 Oct 2021.

  3. Upreti SR, Thapa K, Pradhan YV, Shakya G, Sapkota YD, Anand A, et al. Developing rubella vaccination policy in Nepal--results from rubella surveillance and seroprevalence and congenital rubella syndrome studies. J Infect Dis. 2011;204(Suppl 1):S433–8. https://doi.org/10.1093/infdis/jir078.

    Article  PubMed  Google Scholar 

  4. World Health Organization, Regional Office for South-East Asia. Joint National and International Measles, Rubella and Congenital Rubella Syndrome Programme Review, Nepal, 2019. New Delhi: World Health Organization, Regional Office for South-East Asia; 2019.

    Google Scholar 

  5. Ministry of Health - MOH/Nepal, New ERA/Nepal, and ICF. 2017. Nepal Demographic and Health Survey 2016. Kathmandu, Nepal: MOH/Nepal, New ERA/Nepal, and ICF. Available at: https://dhsprogram.com/publications/publication-FR336-DHS-Final-Reports.cfm.

  6. UNICEF. Getting immunization back on track 2020. https://www.unicef.org/nepal/stories/getting-immunization-back-track. Accessed 18 Oct 2021.

  7. World Health Organization. Vaccination coverage cluster surveys: reference manual. March 2021 update; (WHO/IVB/18.09). License: CC BY-NC-SA 3.0 IGO. Geneva: World Health Organization; 2018.

    Google Scholar 

  8. WHO. Vaccination coverage cluster surveys: reference manual - working draft. 2015.

    Google Scholar 

  9. United States Census Bureau. Census and survey processing system (CSPro) 2020. https://www.census.gov/data/software/cspro.Documentation.html. Accessed 18 Oct 2021.

    Google Scholar 

  10. Biostat Global Consulting. Vaccination Coverage Quality Indicators (VCQI) - resources 2021. http://www.biostatglobal.com/VCQI_RESOURCES.HTML. Accessed 18 Oct 2021.

  11. Wagai JN, Rhoda DA, Prier ML, Trimner MK, Clary CB, Oteri J, et al. Implementing WHO guidance on conducting and analysing vaccination coverage cluster surveys: two examples from Nigeria. PLoS One. 2021;16:e0247415. https://doi.org/10.1371/journal.pone.0247415.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Dean N, Pagano M. Evaluating confidence interval methods for binomial proportions in clustered surveys. J Surv Stat Methodol. 2021;3:484–503. https://doi.org/10.1093/jssam/smv024.

    Article  Google Scholar 

  13. Rao JNK, Scott AJ. On chi-squared tests for multiway contingency tables with cell proportions estimated from survey data. Ann Stat. 1984;12:46–60. https://doi.org/10.1214/aos/1176346391.

    Article  Google Scholar 

  14. Hosmer DW, Lemeshow S, Sturdivant RX. Applied logistic regression. 3rd ed. Hoboken: Wiley; 2013.

    Book  Google Scholar 

  15. Heeringa SG, West BT, Berglund PA. Applied survey data analysis. 2nd ed. Boca Raton: CRC Press - Taylor & Francis Group; 2017.

    Google Scholar 

  16. StataCorp. Stata statistical software. College Station: StataCorp LLC: StataCorp.; 2019.

    Google Scholar 

  17. Archer KJ, Lemeshow S, et al. Goodness-of-fit test for a logistic regression model fitted using survey sample data. Stata J. 2006;6:97–105.

    Article  Google Scholar 

  18. Valliant R, Dever JA, Kreuter F. Practical tools for designing and weighting survey samples. New York: Springer New York; 2013.

    Book  Google Scholar 

  19. National Planning Commission, Government of Nepal. Nepal earthquake 2015 post disaster needs assessment vol. B: sector reports. Kathmandu: Government of Nepal National Planning Commission; 2015.

    Google Scholar 

  20. Sphere Association, editor. The sphere handbook: humanitarian charter and minimum standards in humanitarian response. 4th ed. Geneva: Sphere Association; 2018.

    Google Scholar 

  21. World Health Organization. Vaccination in acute humanitarian emergencies: a framework for decision making. Geneva: World Health Organization; 2017.

    Google Scholar 

  22. Baral K. Annual country report on progress toward measles elimination and rubella/CRS control year 2017 (Jan-Dec): National Verification Committee (Available from WHO Nepal upon request); 2018.

  23. World Health Organization. Immunization Country Profile: WHO UNICEF estimates time series for Nepal 2021. https://apps.who.int/immunization_monitoring/globalsummary/estimates?c=NPL. Accessed 18 Oct 2021.

  24. Center for Molecular Dynamics. Report on coverage survey and sero-survey following measles-rubella vaccination campaign in Nepal – 2013. Kathmandu: (Available from WHO Nepal upon request); 2014.

    Google Scholar 

  25. Acharya K, Paudel YR, Dharel D. The trend of full vaccination coverage in infants and inequalities by wealth quintile and maternal education: analysis from four recent demographic and health surveys in Nepal. BMC Public Health. 2019;19:1–11. https://doi.org/10.1186/s12889-019-7995-3.

    Article  Google Scholar 

  26. Scobie HM, Edelstein M, Nicol E, Morice A, Rahimi N, MacDonald NE, et al. Improving the quality and use of immunization and surveillance data: summary report of the Working Group of the Strategic Advisory Group of Experts on Immunization. Vaccine. 2020;38(46):7183–97. https://doi.org/10.1016/j.vaccine.2020.09.017.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Kc A, Nelin V, Raaijmakers H, Kim HJ, Singh C, Målqvist M. Increased immunization coverage addresses the equity gap in Nepal. Bull World Health Organ. 2017;95(4):261–9. https://doi.org/10.2471/BLT.16.178327 Epub 2017 Feb 2. PMID: 28479621; PMCID: PMC5407251.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Tohme RA, François J, Wannemuehler K, Magloire R, Danovaro-Holliday MC, Flannery B, et al. Measles and rubella vaccination coverage in Haiti, 2012: progress towards verifying and challenges to maintaining measles and rubella elimination. Tropical Med Int Health. 2014;19:1105–15. https://doi.org/10.1111/tmi.12335.

    Article  Google Scholar 

  29. Sabin Vaccine Institute. Nepal enacts bill to strengthen national immunization program, reduce dependency on external funding 2016. https://www.sabin.org/updates/pressreleases/nepal-enacts-bill-strengthen-national-immunization-program-reduce-dependency. Accessed 18 Oct 2021.

Download references

Acknowledgements

The authors are grateful to CMDN staff, WHO-IPD staff (Dr Rahul Pradhan, Dr. Dipesh Shrestha and all field office staff of WHO-IPD), staff of Family Welfare Division, Department of Health Services (Mr Bharat Bhandari, Mr. Basanta Shrestha). Ultimately, we are grateful to the health workers of Nepal who tirelessly bring vaccines to their communities and the participants who generously gave their time and shared information for this survey.

Disclaimer

M. Carolina Danovaro-Holliday, Mona Lacoul and Anindya Bose work for the World Health Organization (WHO). CMDN and Biostat Global Consulting (BGC) were contracted by WHO Nepal for this work. The authors alone are responsible for the views expressed in this publication and they do not necessarily represent the decisions, policies or views of the World Health Organization.

Funding

Funds from United Nations Fund for International Partnership (UNFIP) and WHO core budget were used for field work and analysis for this coverage evaluation survey. The donors had no role in the analysis and/or decision to publish the results.

Author information

Authors and Affiliations

Authors

Contributions

MC Danovaro-Holliday: Conceptualization, Writing - original draft. DA Rhoda: Methodology, analytical software, formal analysis, writing - original draft. M Lacoul: project administration, formal analysis, map development, review & editing. ML Prier: analytical software, data preparation, and analysis. JS Gautam and T Pokhrel: project administration, supervision, review & editing. SM Dixit: survey implementation, data collection. RM Rajbhandari: survey implementation, data collection, formal analysis. AS Bose: Conceptualization, project administration, funding acquisition, Writing - original draft. All authors reviewed the final version and provided critical inputs before submission. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to M. Carolina Danovaro-Holliday.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Ethical committee of the Nepal Health Research Council (NHRC).

All methods were carried out in accordance with relevant guidelines and regulations and in compliance with ethical and human rights standards.

All the participants were informed about purpose, recruitment procedures, possible risks and benefits of the study and they were also informed about their rights of decision to participate and abstain from answering particular question/s. Study participants were made aware about confidentiality of their information and also voluntary and anonymity nature of the survey. Confidentiality and anonymity of the participants was maintained strictly. No persons < 16 years were interviewed. Informed consent was sought following these steps:

Step 1: Interviewer read out and explained the purpose of the study from NHRC approved consent form in Nepali.

Step 2: Interviewer and interviewee discussed and the interviewer clarified issues, if any. To be doubly sure, the interviewer asked the interviewee to explain back the same to interviewer.

Step 3: Once the interviewer is convinced that the interviewee understood the purpose of the survey and interviewee has agreed to be interviewed, the interviewee was requested to sign the consent form (if literate) or thumb impression (if illiterate).

Step 4: The interviewer also signed the form to attest that the consent form was administered with due process.

Step 5: Interview started. If consent not given, interview stopped.

These steps were included in the protocol approved by the ethical committee at NCHR.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Supplement 1-Nepal PCCS.

Additional detail and commentary on logistic regression models.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Danovaro-Holliday, M.C., Rhoda, D.A., Lacoul, M. et al. Who gets vaccinated in a measles-rubella campaign in Nepal?: results from a post-campaign coverage survey. BMC Public Health 22, 221 (2022). https://doi.org/10.1186/s12889-021-12475-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-021-12475-0

Keywords