- Open Access
Countries’ progress for women’s and children’s health in the Millennium Development Goal era: the Countdown to 2015 experience
BMC Public Healthvolume 16, Article number: 791 (2016)
Countdown to 2015 for Maternal, Newborn and Child Survival (Countdown) began in 2003, monitoring and analysing country progress towards achieving Millennium Development Goals (MDGs) 4 (reduce child mortality) and 5 (improve maternal health), responding to The Lancet Child Survival Series . For 12 years Countdown synthesised data on coverage and its key determinants across the continuum of care for women’s and children’s health, and regularly disseminated country profiles, reports, and publications in high impact journals . Understanding global level progress to the MDGs was more recently complemented by a series of country case studies (Afghanistan, Bangladesh, China, Ethiopia, Kenya, Malawi, Niger, Pakistan, Peru, and Tanzania), many are accompanied by national review meetings to inform policy formulation and programme implementation [3–8]. This supplement collates learning from these analyses.
Through global and country level tracking efforts, Countdown provided an objective assessment of progress towards MDGs 4 and 5, advancing global accountability for women’s and children’s health, feeding into the work of the Independent Expert Review Group on Information and Accountability for Women’s and Children’s Health (iERG) for the UN Secretary General . Countdown’s “suprainstitutional” structure, including academics, governments, international agencies, professional associations, donors, and members of civil society, helped to ensure independence and credibility with wide uptake.
Countdown to 2015 closed with its final report , and re-opened as Countdown to 2030 in the spring of 2016. The process of re-designing the initiative to be responsive to the Sustainable Development Goal Framework and the new Global Strategy for Women’s, Children’s and Adolescents’ health involved reflecting on Countdown’s country orientation. The core of Countdown reporting since its inception has been the two-page country profiles for each of the 75 priority countries where more than 95 % of all maternal, newborn and child deaths occur. The profiles present demographic indicators; nutritional status and mortality statistics; coverage levels, trends and equity analyses for evidence-based reproductive, maternal, newborn and child health interventions, plus policy, health systems, and financial indicators. The profiles are a visual tool to help policy makers and development partners to identify gaps to address and work to maintain progress.
In addition to carrying out analyses for the country profiles and summary reports, Countdown’s four technical working groups (coverage, equity, health systems and policies, financing) worked together on cross-cutting research with the aim of using the global databases to systematically examine linkages between intervention coverage, its determinants and improvements in survival. Countdown experts identified limitations inherent in various surveys and databases, making causal inferences at the aggregate level very challenging. For example, the Countdown coverage database maintained by Johns Hopkins University in collaboration with UNICEF depends primarily on household survey data, principally the Demographic and Health Surveys and the Multiple Indicator Cluster Surveys. Not all Countdown countries have new household survey data in a given year, and the indicators reported by Countdown reflect information on intervention coverage over different recall periods (e.g. the recall period for skilled attendance at birth is often 3 years prior to the survey and exclusive breastfeeding is the 24 hours before). The Countdown health policy database maintained by the World Health Organisation (WHO), although it represents a major step forward in being able to track policy indicators related to Reproductive, Maternal, Newborn and Child health (RMNCH), does not include information on exactly when a policy was adopted and its roll out via programmes in each country, making it challenging to link policy adoption to trends in intervention coverage or financial flows to RMNCH. Countdown’s database on financing focuses on external resource flows, and there has been no comparable data on domestic funding linked to MDGs 4 and 5 for a large group of countries. An effort by some Countdown researchers to explain the relative contribution of different factors to MDG progress through an aggregate cross-sectional and time series analysis of all 75 Countdown countries proved to have little explanatory power, in part due to these limitations.
Countdown also recognised the importance of contextual factors (e.g., economic and social development progress, women’s social status or conversely, conflict, emergencies) in influencing progress. Variation across countries meant that ecological analyses could only go so far in explaining how change was achieved or not at national and subnational levels.
In view of these issues, Countdown embarked upon a set of country case studies that would enable an assessment of why and how countries progressed towards improving women’s and children’s health during the MDG-era, and what factors might explain the specific patterns of progress in individual countries. The first case study was undertaken in Niger and involved a close collaboration between Johns Hopkins University, the National Statistics Office, and the UNICEF country office. Its publication in 2012 in The Lancet accompanied by a comment penned by the Minister of Health of Niger generated an enthusiastic response from countries for a similar analysis . In response, Countdown developed a case study model adapted from this approach and selected nine additional countries for analysis. The full portfolio includes 10 countries at varying stages of progress towards MDGs 4 and 5. These studies involved a partnership between academic institutions well versed in Countdown’s global work and country-based teams consisting of members not directly involved in programme implementation or evaluation to safeguard the independence of the analysis. Each case study collaborative took advantage of country-specific opportunities for learning and faced unique challenges related to the different circumstances in the country (e.g. data availability, team capacity/attrition, and communication between agencies).
This journal supplement describes key lessons from the Countdown case study portfolio. It includes a combination of a summary paper  and two methodological papers synthesising findings across the case studies  and showcasing novel methods developed for the case studies , and three country specific papers that use subnational data to explore specific themes across the continuum of care (Table 1). The summary paper, by Moucheraud et al., distils key factors that detracted from and facilitated progress across the RMNCH continuum of care in the case study countries . The second paper by Singh et al. showcases results from a set of novel tools used by the case study teams to analyse country policies and health systems factors associated with change . The second methods paper by Mann et al. provides a cross-country comparison of how financial flows from domestic and external sources influence RMNCH outcomes . The Tanzania case study subnational analysis by Armstrong et al. focuses on variations in progress at the regional level in increasing coverage and improving health system readiness to deliver essential interventions around the time of birth . The Peru analysis by Huicho et al. examines national and district level trends in the neonatal mortality rate by wealth quintile and by urban/rural residence, and factors underlying these trends . Finally a paper from Afghanistan by Akseer et al. uses the Lives Saved Tool to estimate impact based on RMNCH services coverage in eight regions, showing progress despite major contextual challenges .
Some learnings from the Countdown case studies evidence and experience include:
A common framework is helpful to structure the evaluation and especially to consider links between impact with the various domains of Countdown technical work (coverage, equity, finance and health policy and systems) (Paper 1 Fig. 1) .
Comparability across countries and sub-nationally is easier to achieve for quantitative assessments of coverage and equity, and the Countdown has particularly advanced the use of equity analyses to better identify which regions or income groups or other populations are being left behind.
To date, less attention has been paid to comparability for the evaluation of inputs and process, such as finances  and health policy and systems . Countdown has made some progress in more standard tools and approaches but more work is needed for both international comparisons and subnational analyses.
The Countdown case studies mostly focused more on child health interventions than on reproductive, maternal, and newborn health, perhaps due to more time series data availability during the study period. More effort is needed to examine progress across the continuum of care including comparisons of rates of progress between different outcomes and nationally/subnationally, and neglected age groups such as adolescents and stillbirths.
Many factors contribute to progress, or lack of progress, in individual countries. We found that no one country or group of countries should be seen as a “success” or “failure”. The value of the case studies is in understanding variations and learning from successes and setbacks, not causal hypothesis testing . Richer and more standardised assessments would be valuable to consider the why and how of change, including economic, political, social and governance factors.
Progress was most evident for relatively simpler interventions delivered at the community-primary care interface and lagging or uneven for those typically found in health facilities or requiring 24h services. This highlights the importance of more systematic health system strengthening, especially with an expanded SDG agenda.
Engagement in national data analysis and accountability requires significant time commitment in multi-stakeholder processes and leadership from committed academics and researchers skills in monitoring, evaluation and policy change. Support from technical experts and organisations outside of study countries is valuable to take advantage of methods and analytical tools from elsewhere. To maximise impact and sustainability, more effort is required for strengthening capacity in national institutions, and to integrate findings into country planning and review cycles. These efforts go beyond those typical of research studies .
Dissemination and linking to accountability is not a random process and requires specific plans and local leadership, with civil society voices involved.
Building on the case study experience, Countdown to 2030 includes will be more focused on in-country work and local capacity for monitoring and evaluation. Analyses will include countries making progress as well as those where gains are slower. At global level, Countdown will expand to hitherto ignored groups such as adolescents, marginalised populations, and those affected by conflict. If Countdown could finish at the end of the SDG-era in 2030 with an empowered community of scientists and advocates in the very countries with the highest burden of maternal and child morbidity and mortality, this would be well worth the investment.
The Bellagio Study Group on Child Survival. Knowledge into action for child survival. Lancet. 2003;362(9380):323–7.
Countdown to 2015. [http://www.countdown2015mnch.org/] Accessed 1 Aug 2016.
Akseer N, Salehi AS, Hossain SM, Mashal MT, Rasooly MH, Bhatti Z, Rizvi A, Bhutta ZA. Achieving maternal and child health gains in Afghanistan: a Countdown to 2015 country case study. Lancet Glob Health. 2016;4(6):e395–413.
El Arifeen S, Hill K, Ahsan KZ, Jamil K, Nahar Q, Streatfield PK. Maternal mortality in Bangladesh: a Countdown to 2015 country case study. Lancet. 2014;384(9951):1366–74.
Kanyuka M, Ndawala J, Mleme T, Chisesa L, Makwemba M, Amouzou A, Borghi J, Daire J, Ferrabee R, Hazel E, et al. Malawi and Millennium Development Goal 4: a Countdown to 2015 country case study. Lancet Glob Health. 2016;4(3):e201–214.
Amouzou A, Habi O, Bensaid K, Niger Countdown Case Study Working G. Reduction in child mortality in Niger: a Countdown to 2015 country case study. Lancet. 2012;380(9848):1169–78.
Huicho L, Segura ER, Huayanay-Espinoza CA, de Guzman JN, Restrepo-Mendez MC, Tam Y, Barros AJ, Victora CG, Peru Countdown Country Case Study Working G. Child health and nutrition in Peru within an antipoverty political agenda: a Countdown to 2015 country case study. Lancet Glob Health. 2016;4(6):e414–426.
Afnan-Holmes H, Magoma M, John T, Levira F, Msemo G, Armstrong CE, Martinez-Alvarez M, Kerber K, Kihinga C, Makuwani A, et al. Tanzania’s Countdown to 2015: an analysis of two decades of progress and gaps for reproductive, maternal, newborn, and child health, to inform priorities for post-2015. The Lancet Global health. 2015;3(7):e396–409.
Every woman, every child, every adolescent: Achievements and prospects. [http://www.who.int/woman_child_accountability/ierg/reports/2015/en/] Accessed 1 Aug 2016.
Countdown to 2015. Countdown to 2015: A decade of tracking progress for maternal, newborn and child survival - The 2015 Report. Geneva: World Health Organization; 2015.
Moucheraud C, Owen H, Singh NS, Ng CK, Requejo J, Lawn JE, Berman P, Countdown to 2015 Case Study Collaboration G. Countdown to 2015 country case studies: What have we learned about processes and progress toward MDGs 4 and 5? BMC Public Health 2016. doi:10.1186/s12889-016-3401-6.
Mann CE, Ng CK, Akseer N, Bhutta ZA, Borghi J, Colbourn T, Hernández-Peña P, Huicho L, Malik MA, Martinez-Alvarez M et al. Countdown to 2015 country case studies: what can analysis of national health financing contribute to understanding MDG 4 and 5 progress? BMC Public Health 2016. doi:10.1186/s12889-016-3403-4.
Singh NS, Huicho L, Afnan-Holmes H, John T, Moran AC, Colbourn T, Grundy C, Matthews Z, Maliqi B, Matthews M et al. Countdown to 2015 country case studies: Systematic tools to address the “black box” of health systems and policy assessment. BMC Public Health 2016. doi:10.1186/s12889-016-3402-5.
Armstrong CE, Martinez-Alvarez M, Singh NS, John T, Afnan-Holmes H, Grundy C, Ruktanochai CW, Borghi J, Magoma M, Msemo G et al. Subnational variation for care at birth in Tanzania: Is this explained by place, people, money or drugs? BMC Public Health 2016. doi:10.1186/s12889-016-3404-3.
Huicho L, Huayanay-Espinoza CA, Herrera-Perez E, Niño de Guzman J, Rivera M, Restrepo-Méndez MC, Barros AJD. Examining national and district-level trends in neonatal health in Peru through an equity lens: a success story driven by political will and societal advocacy. BMC Public Health 2016. doi:10.1186/s12889-016-3405-2.
Akseer N, Bhatti Z, Rizvi A, Salehi AS, Mashal T, Bhutta ZA. Coverage and inequalities in maternal and child health interventions in Afghanistan. BMC Public Health 2016. doi:10.1186/s12889-016-3406-1.
Barroso C, Lichuma W, Mason E, Lehohla P, Paul VK, Pkhakadze G, Wickremarathne D, Yamin AE. Accountability for women’s, children’s and adolescents’ health in the Sustainable Development Goal era. BMC Public Health 2016. doi:10.1186/s12889-016-3399-9.
The costs for the writing and publication of this editorial were provided through a sub-grant from the U.S. Fund for UNICEF under the Countdown to 2015 for Maternal, Newborn and Child Survival grant from the Bill & Melinda Gates Foundation, and from the Government of Canada, Foreign Affairs, Trade and Development.
This article has been published as part of BMC Public Health Volume 16 Supplement 2, 2016: Countdown to 2015 country case studies: analysing progress towards maternal and child survival in the Millennium Development Goal era. The full contents of the supplement are available online at http://bmcpublichealth.biomedcentral.com/articles/supplements/volume-16-supplement-2.
PB, JR, and ZB initiatilly drafted this editorial. All authors contributed to, read, and approved its final contents.
The authors declare no competing interests. The views expressed in this editorial by the authors are in their personal capacity and do not represent the official views of their employers.