Volume 16 Supplement 2
Countries’ progress for women’s and children’s health in the Millennium Development Goal era: the Countdown to 2015 experience
© The Author(s). 2016
Published: 12 September 2016
Countdown to 2015 for Maternal, Newborn and Child Survival (Countdown) began in 2003, monitoring and analysing country progress towards achieving Millennium Development Goals (MDGs) 4 (reduce child mortality) and 5 (improve maternal health), responding to The Lancet Child Survival Series . For 12 years Countdown synthesised data on coverage and its key determinants across the continuum of care for women’s and children’s health, and regularly disseminated country profiles, reports, and publications in high impact journals . Understanding global level progress to the MDGs was more recently complemented by a series of country case studies (Afghanistan, Bangladesh, China, Ethiopia, Kenya, Malawi, Niger, Pakistan, Peru, and Tanzania), many are accompanied by national review meetings to inform policy formulation and programme implementation [3–8]. This supplement collates learning from these analyses.
Through global and country level tracking efforts, Countdown provided an objective assessment of progress towards MDGs 4 and 5, advancing global accountability for women’s and children’s health, feeding into the work of the Independent Expert Review Group on Information and Accountability for Women’s and Children’s Health (iERG) for the UN Secretary General . Countdown’s “suprainstitutional” structure, including academics, governments, international agencies, professional associations, donors, and members of civil society, helped to ensure independence and credibility with wide uptake.
Countdown to 2015 closed with its final report , and re-opened as Countdown to 2030 in the spring of 2016. The process of re-designing the initiative to be responsive to the Sustainable Development Goal Framework and the new Global Strategy for Women’s, Children’s and Adolescents’ health involved reflecting on Countdown’s country orientation. The core of Countdown reporting since its inception has been the two-page country profiles for each of the 75 priority countries where more than 95 % of all maternal, newborn and child deaths occur. The profiles present demographic indicators; nutritional status and mortality statistics; coverage levels, trends and equity analyses for evidence-based reproductive, maternal, newborn and child health interventions, plus policy, health systems, and financial indicators. The profiles are a visual tool to help policy makers and development partners to identify gaps to address and work to maintain progress.
In addition to carrying out analyses for the country profiles and summary reports, Countdown’s four technical working groups (coverage, equity, health systems and policies, financing) worked together on cross-cutting research with the aim of using the global databases to systematically examine linkages between intervention coverage, its determinants and improvements in survival. Countdown experts identified limitations inherent in various surveys and databases, making causal inferences at the aggregate level very challenging. For example, the Countdown coverage database maintained by Johns Hopkins University in collaboration with UNICEF depends primarily on household survey data, principally the Demographic and Health Surveys and the Multiple Indicator Cluster Surveys. Not all Countdown countries have new household survey data in a given year, and the indicators reported by Countdown reflect information on intervention coverage over different recall periods (e.g. the recall period for skilled attendance at birth is often 3 years prior to the survey and exclusive breastfeeding is the 24 hours before). The Countdown health policy database maintained by the World Health Organisation (WHO), although it represents a major step forward in being able to track policy indicators related to Reproductive, Maternal, Newborn and Child health (RMNCH), does not include information on exactly when a policy was adopted and its roll out via programmes in each country, making it challenging to link policy adoption to trends in intervention coverage or financial flows to RMNCH. Countdown’s database on financing focuses on external resource flows, and there has been no comparable data on domestic funding linked to MDGs 4 and 5 for a large group of countries. An effort by some Countdown researchers to explain the relative contribution of different factors to MDG progress through an aggregate cross-sectional and time series analysis of all 75 Countdown countries proved to have little explanatory power, in part due to these limitations.
Countdown also recognised the importance of contextual factors (e.g., economic and social development progress, women’s social status or conversely, conflict, emergencies) in influencing progress. Variation across countries meant that ecological analyses could only go so far in explaining how change was achieved or not at national and subnational levels.
In view of these issues, Countdown embarked upon a set of country case studies that would enable an assessment of why and how countries progressed towards improving women’s and children’s health during the MDG-era, and what factors might explain the specific patterns of progress in individual countries. The first case study was undertaken in Niger and involved a close collaboration between Johns Hopkins University, the National Statistics Office, and the UNICEF country office. Its publication in 2012 in The Lancet accompanied by a comment penned by the Minister of Health of Niger generated an enthusiastic response from countries for a similar analysis . In response, Countdown developed a case study model adapted from this approach and selected nine additional countries for analysis. The full portfolio includes 10 countries at varying stages of progress towards MDGs 4 and 5. These studies involved a partnership between academic institutions well versed in Countdown’s global work and country-based teams consisting of members not directly involved in programme implementation or evaluation to safeguard the independence of the analysis. Each case study collaborative took advantage of country-specific opportunities for learning and faced unique challenges related to the different circumstances in the country (e.g. data availability, team capacity/attrition, and communication between agencies).
Countdown to 2015: country case studies supplement objectives and overview
Overall supplement objectives
1) To use evidence from the portfolio of in-depth country case studies to describe lessons learned, focusing on how progress was achieved.
2) To showcase results from Countdown country case studies that used a set of novel health system and policy (HSP) tools designed to systematically analyse HSP factors that have contributed to change, or lack thereof, in reproductive, maternal, newborn and child health (RMNCH) in a country, how these changes occurred, and to enable cross-country comparisons.
3) To provide a cross-country comparison on the health financing component of the case studies, analysing how health financing may be related to RMNCH outcomes.
4) To present evidence on regional variation across health systems building blocks for care at birth outcomes in Tanzania, to test associations between health system inputs and outcomes, and to present each region’s implementation readiness according to key inputs and performance.
5) To describe the variations in neonatal mortality over time in Peru, to explore disaggregated trends by wealth quintiles and by urban/rural residence over time, to assess completeness of registered deaths, and to explore possible factors driving the progress achieved
6) To explore coverage and socioeconomic inequalities in key life-saving RMNCH interventions at the national level and by region in Afghanistan.
Overview of papers in the supplement
Paper 1: Multi-country analyses: Mixed method (quantitative and content analyses) evidence from the portfolio of country case studies to describe lessons learned, focusing on how progress was achieved across the RMNCH continuum of care .
Paper 2: Health policies and systems: Highlights the methods and key findings from the health systems and policies tools developed for the purpose of the case studies to understand key factors driving progress across the RMNCH continuum of care in case study countries .
Paper 3: Financing: Draws on lessons learned and overall themes from the Countdown case studies on how health financing influences RMNCH outcomes and the achievements of MDG 4 and 5 .
Paper 4: Tanzania: Evaluates subnational (at regional level) variations for care at birth outcomes, i.e. rural women giving birth in a facility and by Caesarean-section, and associations with inputs according to the health systems building blocks .
Paper 5: Peru: Describes time trends in NMR at national and district level in Peru, by wealth quintiles and by urban/rural residence and explore underlying factors .
Paper 6: Afghanistan: A ssesses levels of coverage, and the absolute and relative socioeconomic inequalities in 11 essential RMNCH interventions, including measures of composite coverage, at the national level and for the eight geographic regions of Afghanistan. To quantify the number of child deaths averted through scale up of effective community-based interventions across socioeconomic groups based on the Lives Saved Tool (LiST) .
A common framework is helpful to structure the evaluation and especially to consider links between impact with the various domains of Countdown technical work (coverage, equity, finance and health policy and systems) (Paper 1 Fig. 1) .
Comparability across countries and sub-nationally is easier to achieve for quantitative assessments of coverage and equity, and the Countdown has particularly advanced the use of equity analyses to better identify which regions or income groups or other populations are being left behind.
To date, less attention has been paid to comparability for the evaluation of inputs and process, such as finances  and health policy and systems . Countdown has made some progress in more standard tools and approaches but more work is needed for both international comparisons and subnational analyses.
The Countdown case studies mostly focused more on child health interventions than on reproductive, maternal, and newborn health, perhaps due to more time series data availability during the study period. More effort is needed to examine progress across the continuum of care including comparisons of rates of progress between different outcomes and nationally/subnationally, and neglected age groups such as adolescents and stillbirths.
Many factors contribute to progress, or lack of progress, in individual countries. We found that no one country or group of countries should be seen as a “success” or “failure”. The value of the case studies is in understanding variations and learning from successes and setbacks, not causal hypothesis testing . Richer and more standardised assessments would be valuable to consider the why and how of change, including economic, political, social and governance factors.
Progress was most evident for relatively simpler interventions delivered at the community-primary care interface and lagging or uneven for those typically found in health facilities or requiring 24h services. This highlights the importance of more systematic health system strengthening, especially with an expanded SDG agenda.
Engagement in national data analysis and accountability requires significant time commitment in multi-stakeholder processes and leadership from committed academics and researchers skills in monitoring, evaluation and policy change. Support from technical experts and organisations outside of study countries is valuable to take advantage of methods and analytical tools from elsewhere. To maximise impact and sustainability, more effort is required for strengthening capacity in national institutions, and to integrate findings into country planning and review cycles. These efforts go beyond those typical of research studies .
Dissemination and linking to accountability is not a random process and requires specific plans and local leadership, with civil society voices involved.
Building on the case study experience, Countdown to 2030 includes will be more focused on in-country work and local capacity for monitoring and evaluation. Analyses will include countries making progress as well as those where gains are slower. At global level, Countdown will expand to hitherto ignored groups such as adolescents, marginalised populations, and those affected by conflict. If Countdown could finish at the end of the SDG-era in 2030 with an empowered community of scientists and advocates in the very countries with the highest burden of maternal and child morbidity and mortality, this would be well worth the investment.
The costs for the writing and publication of this editorial were provided through a sub-grant from the U.S. Fund for UNICEF under the Countdown to 2015 for Maternal, Newborn and Child Survival grant from the Bill & Melinda Gates Foundation, and from the Government of Canada, Foreign Affairs, Trade and Development.
This article has been published as part of BMC Public Health Volume 16 Supplement 2, 2016: Countdown to 2015 country case studies: analysing progress towards maternal and child survival in the Millennium Development Goal era. The full contents of the supplement are available online at http://bmcpublichealth.biomedcentral.com/articles/supplements/volume-16-supplement-2.
PB, JR, and ZB initiatilly drafted this editorial. All authors contributed to, read, and approved its final contents.
The authors declare no competing interests. The views expressed in this editorial by the authors are in their personal capacity and do not represent the official views of their employers.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- The Bellagio Study Group on Child Survival. Knowledge into action for child survival. Lancet. 2003;362(9380):323–7.View ArticleGoogle Scholar
- Countdown to 2015. [http://www.countdown2015mnch.org/] Accessed 1 Aug 2016.
- Akseer N, Salehi AS, Hossain SM, Mashal MT, Rasooly MH, Bhatti Z, Rizvi A, Bhutta ZA. Achieving maternal and child health gains in Afghanistan: a Countdown to 2015 country case study. Lancet Glob Health. 2016;4(6):e395–413.View ArticlePubMedGoogle Scholar
- El Arifeen S, Hill K, Ahsan KZ, Jamil K, Nahar Q, Streatfield PK. Maternal mortality in Bangladesh: a Countdown to 2015 country case study. Lancet. 2014;384(9951):1366–74.View ArticlePubMedGoogle Scholar
- Kanyuka M, Ndawala J, Mleme T, Chisesa L, Makwemba M, Amouzou A, Borghi J, Daire J, Ferrabee R, Hazel E, et al. Malawi and Millennium Development Goal 4: a Countdown to 2015 country case study. Lancet Glob Health. 2016;4(3):e201–214.View ArticlePubMedGoogle Scholar
- Amouzou A, Habi O, Bensaid K, Niger Countdown Case Study Working G. Reduction in child mortality in Niger: a Countdown to 2015 country case study. Lancet. 2012;380(9848):1169–78.View ArticlePubMedGoogle Scholar
- Huicho L, Segura ER, Huayanay-Espinoza CA, de Guzman JN, Restrepo-Mendez MC, Tam Y, Barros AJ, Victora CG, Peru Countdown Country Case Study Working G. Child health and nutrition in Peru within an antipoverty political agenda: a Countdown to 2015 country case study. Lancet Glob Health. 2016;4(6):e414–426.View ArticlePubMedGoogle Scholar
- Afnan-Holmes H, Magoma M, John T, Levira F, Msemo G, Armstrong CE, Martinez-Alvarez M, Kerber K, Kihinga C, Makuwani A, et al. Tanzania’s Countdown to 2015: an analysis of two decades of progress and gaps for reproductive, maternal, newborn, and child health, to inform priorities for post-2015. The Lancet Global health. 2015;3(7):e396–409.View ArticlePubMedGoogle Scholar
- Every woman, every child, every adolescent: Achievements and prospects. [http://www.who.int/woman_child_accountability/ierg/reports/2015/en/] Accessed 1 Aug 2016.
- Countdown to 2015. Countdown to 2015: A decade of tracking progress for maternal, newborn and child survival - The 2015 Report. Geneva: World Health Organization; 2015.Google Scholar
- Moucheraud C, Owen H, Singh NS, Ng CK, Requejo J, Lawn JE, Berman P, Countdown to 2015 Case Study Collaboration G. Countdown to 2015 country case studies: What have we learned about processes and progress toward MDGs 4 and 5? BMC Public Health 2016. doi:https://doi.org/10.1186/s12889-016-3401-6.
- Mann CE, Ng CK, Akseer N, Bhutta ZA, Borghi J, Colbourn T, Hernández-Peña P, Huicho L, Malik MA, Martinez-Alvarez M et al. Countdown to 2015 country case studies: what can analysis of national health financing contribute to understanding MDG 4 and 5 progress? BMC Public Health 2016. doi:https://doi.org/10.1186/s12889-016-3403-4.
- Singh NS, Huicho L, Afnan-Holmes H, John T, Moran AC, Colbourn T, Grundy C, Matthews Z, Maliqi B, Matthews M et al. Countdown to 2015 country case studies: Systematic tools to address the “black box” of health systems and policy assessment. BMC Public Health 2016. doi:https://doi.org/10.1186/s12889-016-3402-5.
- Armstrong CE, Martinez-Alvarez M, Singh NS, John T, Afnan-Holmes H, Grundy C, Ruktanochai CW, Borghi J, Magoma M, Msemo G et al. Subnational variation for care at birth in Tanzania: Is this explained by place, people, money or drugs? BMC Public Health 2016. doi:https://doi.org/10.1186/s12889-016-3404-3.
- Huicho L, Huayanay-Espinoza CA, Herrera-Perez E, Niño de Guzman J, Rivera M, Restrepo-Méndez MC, Barros AJD. Examining national and district-level trends in neonatal health in Peru through an equity lens: a success story driven by political will and societal advocacy. BMC Public Health 2016. doi:https://doi.org/10.1186/s12889-016-3405-2.
- Akseer N, Bhatti Z, Rizvi A, Salehi AS, Mashal T, Bhutta ZA. Coverage and inequalities in maternal and child health interventions in Afghanistan. BMC Public Health 2016. doi:https://doi.org/10.1186/s12889-016-3406-1.
- Barroso C, Lichuma W, Mason E, Lehohla P, Paul VK, Pkhakadze G, Wickremarathne D, Yamin AE. Accountability for women’s, children’s and adolescents’ health in the Sustainable Development Goal era. BMC Public Health 2016. doi:https://doi.org/10.1186/s12889-016-3399-9.