Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Cost-effectiveness of childhood pneumococcal vaccination program in Ethiopia: results from a quasi-experimental evaluation

BMC Public Health volume 19, Article number: 1078 (2019) Cite this article

Abstract

Background

Ethiopia was among the 15 countries that, together accounted for 64% of the world’s severe episodes of pneumonia among children below the age of 5 in 2011. To reduce this burden, the 10-valent pneumococcal conjugate vaccine (PCV 10) was introduced into the general childhood national immunization program in Ethiopia in 2011. However, there is little evidence on its cost-effectiveness, and the aim of this study was to estimate the cost-effectiveness of the introduction of PCV 10 vaccination in the Ethiopian setting.

Methods

The cost-effectiveness analysis was carried out based on a quasi-experimental evaluation of implementing PCV 10 at the Butajira rural health program site in Ethiopia. The intervention and the control groups consisted 876 and 1010 children, respectively. Using data from program site’s surveillance system database as a framework, health outcome and vaccination data were collected from medical records, immunization registration books and reports. Disability- Adjusted Life Year (DALY) was a main health outcome metric complimented by incidence of acute lower respiratory infection/1000-person years. Vaccination and treatment costs were collected by document review and cross-sectional household survey.

Results

In the intervention cohort, 626 of 876 (71.5%) children received PCV 10 vaccination. Until the first year of life, the incidence of acute lower respiratory infection was higher in the intervention group. After the first year of life, the incidence rate was 35.2 per 1000-person years in the intervention group compared to 60.4 per 1000-person years in the control group. The incremental cost-effectiveness ratio (ICER) per averted DALY for the intervention group during the total follow-up period was (2013 US$) 394.3 (undiscounted) and 413.8 (discounted). The ICER per averted DALY excluding the first year of life was (2013 US$) 225 (undiscounted) and 292.7 (discounted).

Conclusion

Compared to the WHO’s suggested cost-effectiveness threshold value, the results indicate that the general childhood PCV 10 vaccination was a cost-effective intervention in the Butajira rural health program site.

Peer Review reports

Background

Child health has been a major public health priority during the past few decades at global and regional levels. Child health improvements represented a major part of the 1990–2015 millennium development goals (MDGs), and the international and local communities committed to reducing mortality in children under-five by two thirds [1]. Now the MDGs implementation period is over and the effect of the interventions and commitments can be measured, and lessons can be drawn. Globally, the mortality rate in children under five decreased by 52.4%, from 87.1 per 1000 live births in 1990 to 41.4 per 1000 live births in 2015 [2]. Though the progress was encouraging, the goal was not achieved. In addition, progress was not uniform between and within countries [2, 3]. In sub-Saharan Africa, for instance, most of the countries could not meet the target set by the MDG. The aggregated under-five mortality rate in the region was 98 deaths per 1000 live births in 2012, which was far above the MDG 2015 target of 59/1000 live births. Furthermore, in 2013 the region contributed to approximately half of the under-five deaths in the world [4, 5].

In 2013, pneumonia, diarrhoea, and malaria were the leading causes of under-five death globally with disproportionate burden on low-income countries. Furthermore, in the above-mentioned years, the number of children who died from pneumonia was nearly as high as the sum of children who died from diarrhoea and malaria combined [6]. Despite a reduction in pneumonia-related deaths by 44% between 2000 and 2013, pneumonia still accounted for 15% of the total under-five deaths in 2013 [7].

Ethiopia was one of the 15 countries that contributed to 65% of world’s total episodes of pneumonia and to 64% of severe episodes of pneumonia in 2011 [8]. Furthermore, Ethiopia had globally the fifth highest mortality rate from pneumonia and diarrhoea with 53,000 deaths in 2013 [7]. Lower respiratory infections in general, and pneumonia specifically, were the leading causes of under-five deaths [9, 10].

Vaccination has been shown to be an effective preventive intervention for pneumonia and two major versions of conjugate vaccine, 10-valent (PCV 10) and 13-valent (PCV 13) pneumococcal conjugate vaccines, have been approved and included in routine childhood immunization programs across the world [11,12,13]. Ethiopia introduced PCV 10 into the childhood immunization program in November 2011 with the support of Gavi, the Vaccine Alliance [14, 15]. In the three-dose schedule of the national vaccination program, children are given the vaccine at their 6, 10 and 14 weeks of life. However, at the time of its introduction in Ethiopia, all children below one year of age were supposed to be vaccinated as part of a catch-up campaign.

Most studies on the cost-effectiveness of PCV 10 across the world have shown this to be a cost-effective intervention [16,17,18,19,20,21,22]. However, there are substantial differences between studies in the considered comparator, outcome measures and effectiveness estimates [23,24,25]. Some studies have questioned the cost-effectiveness of PCV 10, e.g. in Thailand and Croatia [26, 27]. In Ethiopia, with the exception of some recent reports of extended cost-effectiveness analysis, which were mainly based on international estimates, there is limited evidence as to the cost-effectiveness of universal PCV 10 vaccinations [28, 29].

Ethiopia lacked a national vital registration system and population-based longitudinal demographic and health information were limited to a few university-based health and demographic surveillance systems. Thus, we used the Butajira rural health program (BHRP), which is one of the university-based health and demographic surveillance systems, as a framework to measure the cost-effectiveness of PCV 10 vaccination. Addressing the knowledge gap regarding the cost effectiveness of the vaccination will help policy makers and the health care providers to make evidence-based decisions and reliable prioritization in child health cares. Thus, this study aimed to measure the cost effectiveness of PCV 10 vaccination in the program site.

Methods

Study population and data collection

The evaluation compares a universal vaccination program (in which all age eligible children are given full entitlement of getting PCV 10 vaccination without payment) with no universal vaccination program (i.e. still may have self-selection into vaccination). The study population used to collect data on costs and health outcomes was children born in the BHRP site. The site was established in 1986 in a collaboration between Addis Ababa University, Ethiopia and Umeå University, Sweden. It comprised one urban and nine rural kebeles (the smallest administrative unit in Ethiopia) from Meskan and Mareko districts of Gurage and Silte zones [30, 31]. Geographically defined populations of individuals, households and residential units were followed as an open cohort in the selected kebeles. Demographic and health related events, mainly pregnancy (observation and outcome), death, in and out migration and marital status changes were the major units of updates that were taken in every three months in the surveillance system. Causes of death were determined by verbal autopsy (VA) method using international classification of diseases (ICD-10) codes and titles. Then the ICD-10 codes and titles subsequently converted into VA codes and titles [31]. The sites population grew from 28,000 in 1987 to over 70,000 in 2011 [32].

Children in the intervention group (i.e. within the time period of universal vaccination) were born between September 1, 2011 and August 31, 2012. Those in the historical control group (i.e. within the time period of no universal vaccination) were children born between September 1, 2009 to August 31, 2010. The control group were chosen over this period to ensure that they were not included in the catch-up programs.

Children who died or who had emigrated before the age of two months or who had immigrated to the study area after their first year of life were not included in the study. Data were collected from November 25, 2015 until January 6, 2016. Children in both the intervention and control cohorts were monitored retrospectively to an age of three years and three months of life (final data collection took place in January 2016), as this was the maximum time we could consider for children born in late 2012. list of the study participants was extracted from the HRS2 (household registration system 2- longitudinal data management software of the program) into excel and a format was prepared to track their history in relation to the study objective. Their full names, residence kebeles, sub-kebeles and dates of birth were considered as an identifier and units of integration for the HDSS data with health system data. Using the list, document number of the children were identified from the HMIS (health management information system) and/or registration book of hospitals and health centers. Vaccination data were collected by health extension workers and nurses. Morbidity data were collected by nurses. Household survey data were collected by BRHP data collectors using pretested questionnaire (Additional file 1). All data collectors were trained on procedures of the data collection and the objectives of the study.

Sample demographics

The two cohorts of children, 876 in the intervention group and 1010 in the control group, were homogenous in terms of residence and sex distribution. However, there were statistically significant differences regarding place of birth and birth attendant (see Table 1). The births of 253 (28.9%) children in the intervention group and 138 (13.7%) children in the control group were attended by health professionals. Mothers to the children in the intervention group had a lower mean pregnancy rate and parity than their counterparts in the control group, 3.8 ± 2.4 versus 4.2 ± 2.5 (p = 0.004) and 3.9 ± 2.4 versus 4.3 ± 2.5 (p = 0.001), respectively. From a total of ten kebeles identified in the program site, two were excluded due to missing data and inconsistent values in the HDSS database. A further eleven children were excluded because they had sepsis without respiratory symptoms where the focus of the infection was not possible to define.

Table 1 Background information relating to intervention (Sep, 2011 – Aug, 2012) and control (Sep, 2009 – Aug, 2010) groups at the Butajira rural health program site
Full size table

Economic costs

Costs were estimated by taking into account both the resources consumed for the vaccination and associated healthcare treatments. The former costs were estimated based on the data in the Gavi-approved proposal of the country to introduce PCV vaccination [33, 34] with an assumed wastage rate of 10% for the vaccine. Healthcare treatment estimations included medical and non-medical costs related to both outpatient and inpatient care. Non-medical costs such as costs for transportation, meals, accommodation, productivity loss for parents and caregivers, were estimated from cross-sectional household surveys. The medical cost of the infections was also determined from the cross-sectional household survey by asking interviewee about their recent medical expenses to treat their infected children. Since out-of-pocket payment covered 78.1% of the total direct medical cost for patients who get medical care from public providers, 21.9% of the estimated cost was added to determine the total mean direct medical cost [35]. Data on drug costs were extracted from public pharmacies.

The household survey sampled 134 of the 375 total households with the identified sick children in the current study. These were chosen by cluster-randomization (with the ten kebeles as the clusters) with each household head and/or mother interviewed regarding their recent expenses for treating their sick children. Then the costs were converted to 2013 US$ value. Pretested interview guide was used to interview the respondents.

We took 2013 as a base year for costs with the assumption that it is a reasonable time to capture representative mean treatment cost for both cohorts and mean vaccination cost; since the vaccination was introduced in the late 2012. Summary of the mean cost (per cost item) for three doses of PCV 10 is shown in Table 2.

Table 2 Parameter assumptions and calculated values regarding costs, health outcomes and discounting
Full size table

Health outcomes data

The primary health outcome metric used was Disability-Adjusted Life Years (DALYs). It was estimated using the excel formula suggested by Fox-Rushby and Hanson [40]. The potential illnesses considered to estimate DALYs included all-cause acute lower respiratory infections (ALRI), all-cause meningitis (AM), acute otitis media (AOM), sepsis, and death. Disability weights and duration of illnesses are shown in Table 2. Estimates on the incidence of AM, AOM, ALRI and sepsis were based on the quasi-experimental evaluation comparing the intervention group to the historical control group. Prevented incidence of ALRI/1000-person years was also an additional outcome metric in the current study. Data on morbidity were collected from medical records at hospitals and health centers in the catchment area of the surveillance site. It was done by nurses (BSc nurses), who were working at respective hospitals and health centers. Checklist was used to collect the data and categorization of the cases to the infections was done based on the diagnosis of the hospitals and the health centers. Vaccination status of the children was collected from immunization registration books of hospitals, health centers and health posts. Demographic and mortality data were extracted from the surveillance system database. To calculate Life-years lost where children died, we assumed the average life expectancy to be 65 years (year 2014).

Cost-effectiveness analysis

A decision analytic model, programmed in Microsoft excel considering previous studies [25, 41], was used to estimate the cost effectiveness of universal PCV 10 vaccination compared to no universal PCV 10 vaccination. Incremental cost-effectiveness ratios (ICERs) were estimated from a societal perspective in terms of the cost per averted DALY and the cost per prevented incidence of ALRI/1000-person years. The results were generated both with and without discounting. The discount rate was set at 3% for the costs and the outcomes, in line with recommendations (e.g. the second US panel on cost-effectiveness) [42]. The cost per averted DALY was compared to the threshold levels suggested by the Commission for Macroeconomics and Health as three times the per-capita gross domestic product (GDP) of the country, which was US$ 505 in 2013 [43, 44]. The GDP-based threshold has been criticized for its limitations and lack of empirical foundation. Nonetheless, it is the commonly-used policy-relevant comparative standard [45]. A one-way deterministic sensitivity analysis was used to determine parameter uncertainties.

Results

Vaccination history

In the intervention cohort, 626 (71.5%) children received at least one dose of PCV 10. Among them, 623 (99.5%) received 3 doses of the vaccine. Regarding the other children, 35 (4.0%) received no vaccine and the vaccination status of 215 (24.5%) children was unknown. Residentially, 483 (77.2%) of the vaccinated children were rural dwellers and 143 (22.8%) urban dwellers; the difference was statistically significant (p < 0.001). Girls and boys had similar vaccination status with respective percentages of 73.3% versus 69.9% for vaccinated status, 3.0% versus 4.7% for unvaccinated status and 23.7% versus 25.4% for unknown vaccination status (p = 0.28). The majority (54.6%) of children received PCV vaccine at health posts followed by hospitals (11.5%) and health centers (5.4%). In the subsequent sections, we focus on the intention-to-treat (ITT) results, i.e. comparing the full intervention cohort to the historical control group (irrespective of vaccination status).

Lower respiratory infections

ALRI was the leading cause of healthcare visits in the current study with a total of 204 episodes (range: 1–4 per individual) and 211 (range: 1–7 per individual) in the intervention and the control groups, respectively. The infection proportion were similar in the two groups, with 17.8%, in the intervention group compared to 16.3% in the control group, the difference not being statistically significant (p = 0.43). In the intervention cohort, ALRI was still the leading infection irrespective of vaccination status. The infection proportion in the vaccinated sub-group was 16.1% whereas, for children with a vaccination status of unknown and unvaccinated, the percentages were 22.8 and 14.5%, respectively.

In the intervention group, the infection proportion was 24.5% in urban and 14.7% in rural areas (p = 0.001). Likewise, in the control group the corresponding figure was 22.2 and 14.0% (p = 0.002). The differences in the infection among urban children in the intervention and control groups were not statistically significant.

Incidence of ALRI and the survival rates for those children not contracting the infection

In the current study, the incidence rate of ALRI decreased as the children in the intervention group grew older. For the whole period of the study, the incidence rate in the intervention group was 88.5 per 1000 person-years compared with 75.2 per 1000 person-years in the control group. Looking at the sub-set of data after the children’s first birthday, the incidence rate was 56.4 in the intervention group compared to 60.4 per 1000 person-years in the control group (Table 3).

Table 3 Incidence rate for infections per 1000 person-years and number of deaths at Butajira rural health program site during three years and three months from inclusion in the study in the intervention group, the vaccinated sub-set of the intervention group (Sep. 2011 – Aug. 2012), and control group (Sep 2009 – Aug. 2010)
Full size table

The age at which children contracted ALRI tended to be lower in the intervention group compared to the control group. The mean age for the first infection was 11.9 ± 9.0 and 15.0 ± 10.5 months for the intervention and control groups, respectively. Until the first year of life, children in the intervention group tended to have a lower ALRI free survival compared to the control group (p = 0.401) (Fig. 1). However, after their first birthday, children in the intervention group tended to have a higher ALRI free survival than their counterparts in the control group (p = 0.207). After their second year, they had statistically significant higher ALRI free survival (p = 0.01) similar with children in the vaccinated sub-group after their first birthday (p = 0.008) (Fig. 2). For meningitis, AOM and sepsis, most of the children contracted the infection after 6 months of life. Only one case of meningitis was reported from the intervention group.

Fig. 1
figure 1

Survival curves of first time acute lower respiratory infection (ALRI) at Butajira rural health program site, for three years and three months from inclusion in the study in the intervention group (Sept. 2011 – Aug. 2012) and control group (Sept. 2009 – Aug. 2010)

Full size image
Fig. 2
figure 2

Survival curves of first time acute lower respiratory infection (ALRI) at Butajira rural health program site, after one year of life in the vaccinated sub-groups (Sept. 2011 – Aug. 2012) compared to control group (Sept. 2009 – Aug. 2010)

Full size image

Hospital admission, mortality and cohort dynamics

Hospital admissions due to severe ALRI were more frequent in the intervention group compared to the control group, 10.2% vs 3.4%, (p = 0.01). The majority (82%) of admissions in the vaccinated sub-group in the intervention group were among children below the age of one year of age.

There were 13 (2.1%) and 35 (3.5%) deaths in the intervention and control groups, respectively. Among those who died, 23% in the intervention and 8% in the control groups had history of healthcare visits due to ALRI or meningitis. Furthermore, ALRI was the cause of death for two children in the vaccinated and for six children in the control group. On the other hand, 140 (14.2%) and 266 (22.7%) children left the surveillance site before the end of the observation in the intervention and control groups, respectively. Among them, 16.4% in the intervention and 16.2% in the control group got ALRI infections as shown in Table 4.

Table 4 History of infections among children who left the study areas before completion of observation period during three years and three months from inclusion in the study in the intervention group (n = 140; Sep. 2011 – Aug 2012) and control group (n = 266; Sep. 2009 – Aug. 2010) at Butajira rural health program site
Full size table

Vaccination program and treatment cost

At the introduction year of the vaccination, the total program cost was US$ 26.88 per child for the three doses of PCV 10. The vaccine, the auto-disposable syringe and the safety box together cost US$ 26.44. Other vaccine introduction activities, i.e. training, social mobilization, cold chain equipment procurement and maintenance, transportation and other items amounted to a cost of US$ 0.44 per child.

The mean cost of treating children for an episode of the considered infections in the current study was 513.7 ± 487.5 birr (local currency) or 26.9 US$. The mean direct medical cost was birr 186.4 ± 153.9 (US$ 9.8) and the mean indirect medical cost was birr 327.3 ± 333.6 (US$ 17.1). Likewise, the mean cost of lost productivity was 588.6 birr (US$ 30.8). The mean incremental cost of PCV 10 vaccination was US$ 26.6 for the children over the age of one year.

Cost-effectiveness of the intervention

The mean DALYs (per child) were 0.08 and 0.20 in the intervention and control group, respectively. This implies 0.12 averted DALYs in the intervention group. With an incremental cost of 33.3 US$, this translates to an ICER of 281.4 (discounted) and 268 (undiscounted) US$ per averted DALY in the total follow up period, Table 5.

Table 5 Incremental cost-effectiveness of 10- valent pneumococcal conjugate vaccine in terms of averted DALYs during three years follow-up from inclusion in the study in the intervention group, vaccinated sub-group (Sep. 2011 – Aug. 2012) and control group (Sep. 2009 – Aug. 2010) at Butajira rural health program site
Full size table

The mean DALYs, after the twelfth month of age, was 0.0001 for the entire intervention group (including the vaccinated, in particular) versus 0.1338 for the controls, yielding 0.14 averted DALYs. In this study, the ICER translates to 227,9 (discounted) and 219.4 (undiscounted) US$ per DALY averted, respectively (Table 5). Likewise, the ICER of averting an ALRI incidence per 1000-person years after the twelfth month and its discounted value for the intervention group were US$ 6.7 and 7.5, respectively (Table 6). For the full-time period, the intervention was dominated in terms of reduced ALRI incidence, since the intervention group had higher cost and worse health outcomes. This implies that the averted DALYs in the intervention group (as reported above) is a consequence of the fewer deaths, where (considering the young age of the children), each death increases the lost life-years.

Table 6 Incremental cost-effectiveness of 10- valent pneumococcal conjugate vaccine in terms of prevented ALRI incidence/1000-person years during three years follow-up from inclusion in the study in the intervention group, vaccinated sub-group (Sep. 2011 – Aug. 2012) and control group (Sep. 2009 – Aug. 2010) at Butajira rural health program site
Full size table

Sensitivity analysis

One-way sensitivity analysis was done by varying the costs and infection rates by ±20% to evaluate how robust the results are to changes in parameter values. The ICER (undiscounted) was most sensitive to ±20% change in vaccination cost in the intervention group with a change in ICER (undiscounted) ranging from US$ 224.7 to 311.2 per averted DALY (Table 7). ICER (undiscounted) remained within 10% of the base case after ±20% changes in most parameters for the treatment and control groups.

Table 7 One-way sensitive analysis results at Butajira rural health program site
Full size table

Discussion

This study estimated the cost-effectiveness of the PCV 10 vaccination in the Butajira rural health program site in Ethiopia. The study design was based on comparing the first cohort of children born after the general vaccination was introduced with the cohort of children born the year before the introduction of the vaccination. The children were followed retrospectively from their second month of life to an age of three years and three months by the surveillance system and using medical records to determine the incidence of all-cause acute lower respiratory infections, meningitis, otitis media, sepsis and death.

The (discounted) cost per averted DALY was 281 (2013 US$), which is lower than the Ethiopian GDP per capita of 505 US$ (2013). This indicates that the intervention was cost-effective for the whole follow-up period based on the standard threshold value for cost-effective interventions suggested by the WHO [46]. Looking at the data after the first year of age, the (undiscounted) ICER (2013 US$) per averted DALY and ALRI incidences prevented was 219.4 and 6.7, respectively. The cost-effectiveness estimates are higher compared to the estimates for GAVI eligible countries of US$ 112 per averted DALY among under five children and US$ 77 in countries with under five mortality rate of 100–149 per 1000 live births [47]. It is also higher than the estimate based on data from Kenya, which was 2010 US$ 59 per averted DALY. However, it is lower than Gambian estimates of 2005 US$ 670 per averted DALY [48].

Focusing on data during the children’s first year of age, the vaccination was not cost-effective due to the higher incidence rate of ALRI in the intervention group. The highest rate of ALRI in the full intervention and the sub-group of vaccinated children, 138.9 and 124.5 per 1000 person-year respectively, was recorded in children under the age of six months. It decreased to 56.4 and 30.6 per 1000 person-years, respectively, after the first year of age, compared to a reduction from 94.0 to 60.4 per 1000 person-year in the control cohort. The reduction was 59% in the intervention group and 75% in the vaccinated sub-group compared to 36% in the control group. This is greater than the reduction of invasive pneumococcal disease incidence in the Gambian study, in which the incidence decreased by 55% (from 253 cases per 100,000 population to 113 cases per 100,000) in children aged 2–23 months [49]. Though that study used a health and demographic surveillance system (HDSS) similar to ours, a prospective rather than a retrospective study design was used and took wider age group than ours. In addition, the considered health outcome in our case was ALRI rather than invasive pneumococcal diseases only.

During the whole follow-up period, the intervention group had a higher incidence rate (88.5 per 1000-person year) than the control group (75.2 per 1000 person-year). This was partly due to the highest incidence rate (102.5 per 1000 person-year) among the unknown vaccination status sub-group in the intervention cohort. However, the mortality rate was lower in the intervention group (2.1% vs 3.5%), which implied that the total number of DALYs was lower in the intervention group compared to the control group (0.08 vs 0.20 per child). We don’t have data on why the ALRI was much higher among the unknown vaccination status sub-group of children in the current study. But it is likely that they had lower level of vaccination and parents with lower education and lower socioeconomic conditions including more frequent cooking on open fire with indoor air pollution.

Furthermore, children in the intervention group might have been utilizing healthcare more effectively as they had a higher proportion of institutional deliveries and health professional birth attendances. The highest incidence rate in the vaccinated sub-group was during the first year of life. This could be due to several reasons, e.g. since the follow-up period started immediately after the introduction of the vaccination, there was a catch-up campaign to allow children to receive the first dose of the vaccine before their first birthday. Hence, although they belonged to the intervention group, some of them received the vaccination late and the effect of the vaccine may therefore have been delayed. Some of the children might not get age-appropriate dose despite the vaccination schedule states that the last dose should be given at 14 weeks of age. This is in line with a recent study in Sweden that also reported a higher incidence of invasive pneumococcal diseases (IPD) among younger children post-PCV introduction [50]. Another study also pointed out a higher probability of being infected by non-vaccine serotypes between 2 and 11 months of age [49]. Finally, since it was not possible to define the specific cause of infection, the higher incidence of infection might be due to viral or other bacterial causes. In this case, respiratory syncytial virus (RSV) virus might have contributed, since it is a common cause of pneumonia in the first year of life [51, 52].

However, in the current study, the incidence of ALRI in the first year of life was lower than reported from a study in South Africa, where the corresponding figures for two months to one year was 0.29 episodes per child-year after the introduction of PCV 10 [53]. Although different methods were used, we suggest the difference is due to under-reporting in our study since we used medical records from healthcare facilities, and also because of the low healthcare utilization for respiratory infections [54].

Children who were living in urban areas had a higher rate of ALRI than rural children in both the intervention and control groups. This could potentially be explained by the fact that children in urban areas usually have more frequent human contacts, thus possibly resulting in higher levels of transmission in respect of the infection [55, 56]. On the other hand, since migration is greater in urban areas, newcomers to the towns might have less access to healthcare. Furthermore, among the intervention cohort, the vaccination rate was higher in rural areas than urban areas, 79.9% versus 53.2%. This difference might be due to the implementation of the health extension program in rural parts of the country, including the rural part of the current study setting [57].

Complimenting DALYs with incidence of ALRI/1000-person years as an outcome metrics added strength to the current study by providing better illustration of the effect of the vaccination. Considering the former metrics in the framework of 65 years life expectancy might not be adequate to inform on the value of the vaccination [58, 59]. For instance, for the full follow-up period, the intervention was dominated in terms of reduced ALRI incidence but cost effective in terms of averted DALYs. That was so due to the higher contribution of lost life years in DALYs calculation resulted from fewer more deaths in the control group than in the intervention group. So, it is important to combine such measures to get a better evidence of the effect in a country like Ethiopia where how long the effect of the vaccine lasts is not yet determined.

It is worthy of note that the study has a number of limitations. Only the public healthcare part of the health system was considered in order to determine the cost-effectiveness of the vaccination. Though generally, vaccination was provided at the public healthcare institutions, it is not uncommon in Ethiopia for people to visit private healthcare providers when they fall ill. Therefore, the exclusion of the private healthcare sector might introduce bias. In addition, patients may bypass the usual referral system by attending hospitals or health centers outside the catchment area of the local healthcare institutions. This could reduce the geographic precision of healthcare costs and healthcare utilization rates and the effectiveness results. Microbiological testing was not done and in consequence specific causes of the infections were not identified. Our study design with a historical control might also introduce biases as it has a limitation in terms of identifying casual effects of vaccination in the case of infectious diseases, where there is considerable seasonal variation in the epidemiology of the infections. Recall bias might also affect our household survey results. Finally, any indirect effects of the vaccination, either the herd immunity or the serotype replacement, were not considered in the current study. Thus, further investigation with robust methodology considering serotype prevalence and drug resistance is warranted to discern the long-term impacts of the vaccination in the Ethiopian setting.

Conclusion

The 10- valent pneumococcal vaccination was a cost-effective intervention in terms of averted DALYs of acute lower respiratory infections in the intervention group at Butajira rural health program site. It is mainly due to lower acute lower respiratory infection related mortality in the intervention group than in the control group.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ALRI:

acute lower respiratory infections

AM:

all-cause meningitis

AOM:

acute otitis media

BRHP:

Butajira rural health program

BSc:

Bachelor of science

DALY:

Disability- Adjusted Life Year

Gavi:

the Vaccine Alliance

GDP:

gross domestic product

HDSS:

health and demographic surveillance system

HMIS:

health management information system

ICD:

international classification of disease

ICER:

incremental cost-effectiveness ratio

ITT:

intention-to-treat

MDGs:

millennium development goals

PCV 10:

10-valent pneumococcal conjugate vaccine

PCV 13:

13-valent pneumococcal conjugate vaccine

TBA:

traditional birth attendant

TTBA:

trained traditional birth attendant

US$:

united states dollar

VA:

verbal autopsy

WHO:

world health organization

References

  1. UN General Assembly: United Nations Millennium Declaration, Resolution Adopted by the General Assembly. In.: UN General Assembly; 2000.

  2. Liu L, Oza S, Hogan D, Chu Y, Perin J, Zhu J, Lawn JE, Cousens S, Mathers C, Black RE. Global, regional, and national causes of under-5 mortality in 2000–15: an updated systematic analysis with implications for the sustainable development goals. Lancet. 2016;388(10063):3027–35.

    Article  Google Scholar 

  3. Lassi ZS, Salam RA, Das JK, Bhutta ZA: Essential interventions for maternal, newborn and child health: background and methodology. Reprod Health 2014, 11 Suppl 1:S1.

    Article  Google Scholar 

  4. Cohen RL, Bishai DM, Alfonso YN, Kuruvilla S, Schweitzer J. Post-2015 health goals: could country-specific targets supplement global ones? Lancet Glob Health. 2014;2(7):e373–4.

    Article  Google Scholar 

  5. The Inter-agency Group for Child Mortality Estimation: Levels & Trends in Child Mortality Report 2013. 2013:34.

  6. Liu L, Oza S, Hogan D, Perin J, Rudan I, Lawn JE, Cousens S, Mathers C, Black RE. Global, regional, and national causes of child mortality in 2000–13, with projections to inform post-2015 priorities: an updated systematic analysis. Lancet. 2015;385(9966):430–40.

    Article  Google Scholar 

  7. International Vaccine Access Center: Pneumonia and diarrhea Progress report 2014. 2014.

    Google Scholar 

  8. Walker CL, Rudan I, Liu L, Nair H, Theodoratou E, Bhutta ZA, O'Brien KL, Campbell H, Black RE: Global burden of childhood pneumonia and diarrhoea. Lancet (London, England) 2013, 381(9875):1405–1416.

    Article  Google Scholar 

  9. Deribew A, Tessema GA, Deribe K, Melaku YA, Lakew Y, Amare AT, Abera SF, Mohammed M, Hiruye A, Teklay E, et al. Trends, causes, and risk factors of mortality among children under 5 in Ethiopia, 1990–2013: findings from the global burden of disease study 2013. Popul Health Metrics. 2016;14(1):42.

    Article  Google Scholar 

  10. Central Statistical Agency of Ethiopia, ORC Macro: Ethiopia Demographic and Health Survey 2011. 2012.

  11. Ordonez JE, Orozco JJ. Cost-effectiveness analysis of the available pneumococcal conjugated vaccines for children under five years in Colombia. Cost Eff Resour Alloc. 2015;13:6.

    Article  Google Scholar 

  12. Munoz-Almagro C, Navarro-Torne A, Pallares R. Epidemiologic and clinical implications of second-generation pneumococcal conjugate vaccines. Curr Infect Dis Rep. 2013;15(2):184–90.

    Article  Google Scholar 

  13. Vesikari T, Wysocki J, Chevallier B, Karvonen A, Czajka H, Arsene JP, Lommel P, Dieussaert I, Schuerman L. Immunogenicity of the 10-valent pneumococcal non-typeable Haemophilus influenzae protein D conjugate vaccine (PHiD-CV) compared to the licensed 7vCRM vaccine. Pediatr Infect Dis J. 2009;28(4 Suppl):S66–76.

    Article  Google Scholar 

  14. Burchett HED, Mounier-Jack S, Torres-Rueda S, Griffiths UK, Ongolo-Zogo P, Rulisa S, Edengue J-M, Chavez E, Kitaw Y, Molla M, et al. The impact of introducing new vaccines on the health system: case studies from six low- and middle-income countries. Vaccine. 2014;32(48):6505–12.

    Article  Google Scholar 

  15. Immunization. [http://www.moh.gov.et/ejcc/en/mch].

  16. Ayieko P, Griffiths UK, Ndiritu M, Moisi J, Mugoya IK, Kamau T, English M, Scott JA. Assessment of health benefits and cost-effectiveness of 10-valent and 13-valent pneumococcal conjugate vaccination in Kenyan children. PLoS One. 2013;8(6):e67324.

    Article  CAS  Google Scholar 

  17. Sinha A, Levine O, Knoll MD, Muhib F, Lieu TA. Cost-effectiveness of pneumococcal conjugate vaccination in the prevention of child mortality: an international economic analysis. Lancet. 2007;369(9559):389–96.

    Article  Google Scholar 

  18. Mezones-Holguin E, Canelo-Aybar C, Clark AD, Janusz CB, Jauregui B, Escobedo-Palza S, Hernandez AV, Vega-Porras D, Gonzalez M, Fiestas F, et al. Cost-effectiveness analysis of 10- and 13-valent pneumococcal conjugate vaccines in Peru. Vaccine. 2015;33(Suppl 1):A154–66.

    Article  Google Scholar 

  19. Kieninger MP, Caballero EG, Sosa AA, Amarilla CT, Jauregui B, Janusz CB, Clark AD, Castellanos RM. Cost-effectiveness analysis of pneumococcal conjugate vaccine introduction in Paraguay. Vaccine. 2015;33(Suppl 1):A143–53.

    Article  Google Scholar 

  20. Sibak M, Moussa I, El-Tantawy N, Badr S, Chaudhri I, Allam E, Baxter L, Abo Freikha S, Hoestlandt C, Lara C, et al. Cost-effectiveness analysis of the introduction of the pneumococcal conjugate vaccine (PCV-13) in the Egyptian national immunization program, 2013. Vaccine. 2015;33(Suppl 1):A182–91.

    Article  Google Scholar 

  21. Bakir M, Turel O, Topachevskyi O. Cost-effectiveness of new pneumococcal conjugate vaccines in Turkey: a decision analytical model. BMC Health Serv Res. 2012;12:386.

    Article  Google Scholar 

  22. van Hoek AJ, Choi YH, Trotter C, Miller E, Jit M. The cost-effectiveness of a 13-valent pneumococcal conjugate vaccination for infants in England. Vaccine. 2012;30(50):7205–13.

    Article  Google Scholar 

  23. Zhang X-H, Nievera MC, Carlos J, Lucero M, Bibera G, Atienza MI, Topachevskyi O, Navarro-Locsin CG. Cost-effectiveness analysis of pneumococcal vaccination with the pneumococcal polysaccharide NTHi protein D conjugate vaccine in the Philippines. Value in Health Regional Issues. 2014;3:156–66.

    Article  Google Scholar 

  24. Tyo KR, Rosen MM, Zeng W, Yap M, Pwee KH, Ang LW, Shepard DS. Cost-effectiveness of conjugate pneumococcal vaccination in Singapore: comparing estimates for 7-valent, 10-valent, and 13-valent vaccines. Vaccine. 2011;29(38):6686–94.

    Article  Google Scholar 

  25. Klok RM, Lindkvist RM, Ekelund M, Farkouh RA, Strutton DR. Cost-effectiveness of a 10- versus 13-valent pneumococcal conjugate vaccine in Denmark and Sweden. Clin Ther. 2013;35(2):119–34.

    Article  Google Scholar 

  26. Kulpeng W, Leelahavarong P, Rattanavipapong W, Sornsrivichai V, Baggett HC, Meeyai A, Punpanich W, Teerawattananon Y. Cost-utility analysis of 10- and 13-valent pneumococcal conjugate vaccines: protection at what price in the Thai context? Vaccine. 2013;31(26):2839–47.

    Article  Google Scholar 

  27. Vucina VV, Filipovic SK, Koznjak N, Stamenic V, Clark AD, Mounaud B, Blau J, Hoestlandt C, Kaic B. Cost-effectiveness of pneumococcal conjugate vaccination in Croatia. Vaccine. 2015;33(Suppl 1):A209–18.

    Article  Google Scholar 

  28. Verguet S, Olson ZD, Babigumira JB, Desalegn D, Johansson KA, Kruk ME, Levin CE, Nugent RA, Pecenka C, Shrime MG, et al. Health gains and financial risk protection afforded by public financing of selected interventions in Ethiopia: an extended cost-effectiveness analysis. Lancet Glob Health. 2015;3(5):e288–96.

    Article  Google Scholar 

  29. Johansson KA, Memirie ST, Pecenka C, Jamison DT, Verguet S. Health gains and financial protection from pneumococcal vaccination and pneumonia treatment in Ethiopia: results from an extended cost-effectiveness analysis. PLoS One. 2015;10(12):e0142691.

    Article  CAS  Google Scholar 

  30. Emmelin A. Counted - and then? : Trends in child mortality within an Ethiopian demographic surveillance site. Doctoral thesis, comprehensive summary. Folkhälsa och klinisk medicin: Umeå; 2009.

    Google Scholar 

  31. Tollman S: Butajira health project: an evaluation of a demographic survillance site. In: Sida Evaluation. Stockholm: Swedish internatinal development cooperation agency (SIDA); 2000.

  32. Profile: Butajira HDSS, Ethiopia [http://www.indepth-network.org/Profiles/butajira_hdss_2013.pdf].

  33. Inter-Agency Coordinating Committee for Immunization Ethiopia: Global Alliance for Vaccines and Immunisation (GAVI) application from for country proposal for support to: Immunisation Services, Injection Safety and New and Under-Used Vaccines (of Ethiopia). In.: GAVI; 2010.

  34. The World Bank: Ministers of Finance And Global Health Leaders Fulfill Promise to Combat World’s Greatest Vaccine-Preventable Killer of Children. In. Edited by Group tWB; 2009.

  35. Out-of-pocket health expenditure [http://data.worldbank.org/indicator/SH.XPD.OOPC.ZS].

  36. World Health Organization: The global burden of disease: 2004 update. In. Geneva: WHO; 2004.

  37. Murray CJL: The global burden of disease : a comprehensive assessment of mortality and disability from diseases, injuries, and risk factors in 1990 and projected to 2020. Geneva; Boston: World Health Organization ; Distributed by Harvard School of Public Health; 1996.

  38. Murray CJ, Acharya AK. Understanding DALYs (disability-adjusted life years). J Health Econ. 1997;16(6):703–30.

    Article  CAS  Google Scholar 

  39. World Health Organization: World health statistics 2015. In.: WHO; 2015.

  40. Fox-Rushby JA, Hanson K. Calculating and presenting disability adjusted life years (DALYs) in cost-effectiveness analysis. Health Policy Plan. 2001;16(3):326–31.

    Article  CAS  Google Scholar 

  41. Sartori AM, de Soarez PC, Novaes HM. Cost-effectiveness of introducing the 10-valent pneumococcal conjugate vaccine into the universal immunisation of infants in Brazil. J Epidemiol Community Health. 2012;66(3):210–7.

    Article  Google Scholar 

  42. Sanders GD, Neumann PJ, Basu A, Brock DW, Feeny D, Krahn M, Kuntz KM, Meltzer DO, Owens DK, Prosser LA, et al. Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: second panel on cost-effectiveness in health and medicine. JAMA. 2016;316(10):1093–103.

    Article  Google Scholar 

  43. GDP per capita (current US$) [http://data.worldbank.org/indicator/NY.GDP.PCAP.CD/countries/ET?display=graph].

  44. World health Organizaion: World health report 2002: Reducing Risks, Promoting Healthy Life. In.; 2002.

  45. Marseille E, Larson B, Kazi DS, Kahn JG, Rosen S. Thresholds for the cost-effectiveness of interventions: alternative approaches. Bull World Health Organ. 2015;93(2):118–24.

    Article  Google Scholar 

  46. World Health Organization Commission on Macroeconomics and Health: Macroeconomics and health: investing in health for economic development. Report of the Commission on Macroeconomics and Health. In. Geneva: World Health Organization; 2001.

  47. Tasslimi A, Nakamura MM, Levine O, Knoll MD, Russell LB, Sinha A. Cost effectiveness of child pneumococcal conjugate vaccination in GAVI-eligible countries. Int Health. 2011;3(4):259–69.

    Article  Google Scholar 

  48. Kim SY, Lee G, Goldie SJ. Economic evaluation of pneumococcal conjugate vaccination in the Gambia. BMC Infect Dis. 2010;10:260.

    Article  Google Scholar 

  49. Mackenzie GA, Hill PC, Jeffries DJ, Hossain I, Uchendu U, Ameh D, Ndiaye M, Adeyemi O, Pathirana J, Olatunji Y, et al. Effect of the introduction of pneumococcal conjugate vaccination on invasive pneumococcal disease in the Gambia: a population-based surveillance study. Lancet Infect Dis. 2016.

  50. Galanis I, Lindstrand A, Darenberg J, Browall S, Nannapaneni P, Sjostrom K, Morfeldt E, Naucler P, Blennow M, Ortqvist A, et al. Effects of PCV7 and PCV13 on invasive pneumococcal disease and carriage in Stockholm, Sweden. Eur Respir J. 2016;47(4):1208–18.

    Article  CAS  Google Scholar 

  51. ElBasha N, El Rifai N, Draz I, El Kholy A. Contribution of viruses to severe pneumonia in children. Egyptian Pediatric Association Gazette. 2013;61(2):73–7.

    Article  Google Scholar 

  52. Nair H, Nokes DJ, Gessner BD, Dherani M, Madhi SA, Singleton RJ, O'Brien KL, Roca A, Wright PF, Bruce N, et al. Global burden of acute lower respiratory infections due to respiratory syncytial virus in young children: a systematic review and meta-analysis. Lancet. 2010;375(9725):1545–55.

    Article  Google Scholar 

  53. le Roux DM, Myer L, Nicol MP, Zar HJ. Incidence of childhood pneumonia: facility-based surveillance estimate compared to measured incidence in a south African birth cohort study. BMJ Open. 2015;5(12):e009111.

    Article  Google Scholar 

  54. Deutscher M, Beneden CV, Burton D, Shultz A, Morgan OW, Chamany S, Jordan HT, Zhang X, Flannery B, Feikin DR, et al. Putting surveillance data into context: the role of health care utilization surveys in understanding population burden of pneumonia in developing countries. J Epidemiol Glob Health. 2012;2(2):73–81.

    Article  Google Scholar 

  55. Neiderud CJ. How urbanization affects the epidemiology of emerging infectious diseases. Infect Ecol Epidemiol. 2015;5:27060.

    PubMed  Google Scholar 

  56. Wonodi CB, Deloria-Knoll M, Feikin DR, DeLuca AN, Driscoll AJ, Moisi JC, Johnson HL, Murdoch DR, O'Brien KL, Levine OS, et al. Evaluation of risk factors for severe pneumonia in children: the pneumonia etiology research for child health study. Clin Infect Dis. 2012;54(Suppl 2):S124–31.

    Article  Google Scholar 

  57. Banteyerga H. Ethiopia's health extension program: improving health through community involvement. MEDICC review. 2011;13(3):46–9.

    Article  Google Scholar 

  58. Collins FS. Opportunities for research and NIH. Science. 2010;327(5961):36.

    Article  CAS  Google Scholar 

  59. Arnesen T, Nord E: The value of DALY life: problems with ethics and validity of disability adjusted life years. BMJ (Clinical research ed) 1999, 319(7222):1423.

    Article  CAS  Google Scholar 

Download references

Acknowledgments

We thank study participants and data collectors. We are also grateful to Addis Ababa University, Butajira rural health program coordination office and data center staff. We are grateful to The Swedish Institute for the master’s program scholarship to the lead author, Tayue.

Funding

This work was supported by The Swedish Research Link at The Swedish Research Council. The funder had no role in the design, data collection, analysis, or interpretation of data and writing the manuscript.

Author information

Authors and Affiliations

  1. Department of Public Health and Community Medicine, Institute of Medicine, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden

    Tayue Tateke Kebede

  2. Health Metrics Unit, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden

    Mikael Svensson

  3. Department of Preventive Medicine, School of Public Health, Addis Ababa University, Addis Ababa, Ethiopia

    Adamu Addissie

  4. Department of Paediatrics, Sahlgrenska University Hospital, Gothenburg, Sweden

    Birger Trollfors

  5. Department of Infectious Diseases, Institute of Biomedicine, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden

    Rune Andersson

Authors
  1. Tayue Tateke Kebede
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mikael Svensson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Adamu Addissie
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Birger Trollfors
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rune Andersson
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

TT was involved in the conception, design, data collection, analysis, interpretation, report writing and manuscript writing. RA was involved in the conception, design, interpretation and manuscript writing. MS was involved in data analysis, interpretation and manuscript writing. AA have been involved in the data collection and interpretation. BT involved in design and interpretation. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Tayue Tateke Kebede.

Ethics declarations

Ethics approval and consent to participate

The study received ethical approval from the Addis Ababa University ethical review committee and the requirements of the surveillance system data sharing policy were complied with. Permission to access and use documents was obtained from administrative bodies at the respective institutions. Regarding the data collected through questionnaire, participation in the study was based on each participant’s ability to give informed verbal consent. The consent form was reviewed by the ethics committee as part of the questionnaire and got approved- given high illiteracy in the study area. Each study participants’ agreement status was recorded in each filled out questionnaire. Information relating to individual children was anonymous and there was judged to be no associated risk with respect to the study since the information was mainly gathered from surveillance data, data from health institutions and interview.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Household survey questionnaire. (DOCX 17 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kebede, T.T., Svensson, M., Addissie, A. et al. Cost-effectiveness of childhood pneumococcal vaccination program in Ethiopia: results from a quasi-experimental evaluation. BMC Public Health 19, 1078 (2019). https://doi.org/10.1186/s12889-019-7423-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-019-7423-8

Keywords

BMC Public Health

ISSN: 1471-2458

Contact us