- Research article
- Open Access
- Open Peer Review
Reducing routine vaccination dropout rates: evaluating two interventions in three Kenyan districts, 2014
BMC Public Healthvolume 16, Article number: 152 (2016)
Globally, vaccine preventable diseases are responsible for nearly 20 % of deaths annually among children <5 years old. Worldwide, many children dropout from the vaccination program, are vaccinated late, or incompletely vaccinated. We evaluated the impact of text messaging and sticker reminders to reduce dropouts from the vaccination program.
The evaluation was conducted in three selected districts in Kenya: Machakos, Langata and Njoro. Three health facilities were selected in each district, and randomly allocated to send text messages or provide stickers reminding parents to bring their children for second and third dose of pentavalent vaccine, or to the control group (routine reminder) with next appointment date indicated on the well-child booklet. Children aged <12 months presenting for their first dose of pentavalent vaccine were enrolled. A dropout was defined as not returning for vaccination ≥2 weeks after scheduled date for third dose of pentavalent vaccine. We calculated dropout rate as a percentage of the difference between first and third pentavalent dose.
We enrolled 1,116 children; 372 in each intervention and 372 controls between February and October 2014. Median age was 45 days old (range: 31–99 days), and 574 (51 %) were male. There were 136 (12 %) dropouts. Thirteen (4 %) children dropped out among those who received text messages, 60 (16 %) among who received sticker reminders, and 63 (17 %) among the controls. Having a caregiver with below secondary education [Odds Ratio (OR) 1.8, 95 % Confidence Interval (CI) 1.1–3.2], and residing >5 km from health facility (OR 1.6, CI 1.0–2.7) were associated with higher odds of dropping out. Those who received text messages were less likely to drop out compared to controls (OR 0.2, CI 0.04–0.8). There was no statistical difference between those who received stickers and controls (OR 0.9, CI 0.5–1.6).
Text message reminders can reduce vaccination dropout rates in Kenya. We recommend the extended implementation of text message reminders in routine vaccination services.
Globally, vaccine preventable diseases are responsible for nearly 20 % of the 8.8 million deaths annually among children under five years of age . Despite documented benefits that vaccines are efficient and cost-effective interventions for improving child survival, children in many parts of the world, particularly in Sub-Saharan Africa, are either vaccinated late or unvaccinated all together [2, 3]. In Kenya the first dose pentavalent vaccine, a combined routine childhood vaccine against diptheria, pertussis, tetanus, hepatis B and Haemophilus influenzae type b is given at six weeks of age, a second dose at ten weeks and a third dose at fourteen weeks or at first contact with four weeks apart between doses. The coverage for the third dose of pentavalent vaccine has increased at the national level from 63 % in 2000 to 84 % in 2013 . Despite improvements of national coverage, many districts in Kenya continue to report low vaccination coverage. In 2013, only 45 % of the districts attained ≥80 % coverage for the third dose of pentavalent vaccine . Additionally, vaccination dropout rates still remain high with over 27 % of Kenyan districts reporting dropout rates between 10 %–33 % for the third dose of pentavalent vaccine in 2011 . Low vaccination coverage is associated with outbreaks of vaccine preventable diseases.
Several interventions have been used to reduce dropout rates for vaccinations among children. Sticker reminders with recommended return dates for vaccination placed strategically within the home have been shown to reduce vaccination dropouts in Ethiopia . Postcards, automated telephone or mail reminders and outreach services have also been documented to improve vaccination coverage . Mobile phones are increasingly being used for health applications [8–12], such as improving vaccination coverage [13, 14], promoting adherence to drug treatments for chronic diseases [15, 16], increasing uptake of screening tests [17–20], improving clinical appointment attendance [21, 22] and providing training health workers in malaria treatment . Short message services (SMSs) through mobile phones have been successfully used to reduce dropout for vaccination services in Zimbabwe .
There has been limited research in Kenya comparing use of SMS or sticker reminders to improve vaccination coverage and reduce vaccination dropouts. One study conducted in Western Kenya with a small sample size showed significant benefits of SMS for reducing dropouts, but results may have been biased by monetary compensation of participants . Evidence is needed to corroborate the effectiveness of of SMS or sticker reminders in routine vaccination programs throughout the country. We evaluated the impact of SMS and sticker reminders to reduce dropout rates for routine childhood vaccinations, and determined factors associated with missed vaccination in selected districts in Kenya.
We conducted an evaluation study in three selected districts in Kenya. District selection was based on pentavalent vaccine coverage for 2012. Districts with more than 10 % dropout rates for the third pentavalent dose, which is considered above acceptable limits in the expanded programme on immunization, were considered for inclusion in the study. In 2012, 34 districts with dropout rates more than 10 % were identified. Among these, districts with very high coverage rates (third dose pentavalent coverage ≥90 %) were excluded, as were districts that were geographically hard-to-reach or with security concerns. Six districts with dropout rates ranging from 13-27 % with both rural and urban settings were identified, and subjected to simple random sampling to select three districts. These districts included Machakos, Langata and Njoro (Fig. 1).
Machakos District is in Machakos County, covers an area of 6,281.4 kmsq, most of which is semi-arid with a projected population of 211,404 from 2009 census  and 13,271 live births in 2012. There are 56 health facilities, on average the distance to health facilities is 5 km, in 2012 the district achieved coverage of 88 % for the first dose of pentavalent, 79 % for the third dose, and 76 % full vaccination coverage. The dropout rate among children for the third dose of pentavalent vaccine was 13 % . Langata district is one of the districts in Nairobi County, the district is an area with glaring contrast in living standards, ranging from the plush homes of Karen and Langata to the sprawling Kibera slums, which are characterized by poor living standards with a projected population of 397,238 from 2009 census , live births of 12,402 and 97 Health facilities. In 2012 the district achieved coverage of 96 % for the first dose of pentavalent, 84 % for the third dose, and 82 % full vaccination coverage. The dropout rate among children for the third dose of pentavalent vaccine was 13 %. Njoro district is in Nakuru county, had an estimated population 100,000,7,904 , live births and 37 health facilities. The main economic activity agribusiness with a large proportion of the population having to travel for more than five kilometres to access the nearest health facility. In 2012, the district achieved coverage of 86 % for the first dose of pentavalent, 75 % for the third dose, and 74 % full vaccination coverage. The dropout rate among children for the third dose of pentavalent vaccine was 13 %. Vaccination outreach services are conducted in all the three district to reach hard to reach areas and engagement of mass media to pass information to promote timely vaccination of young children.
Children <12 months of age who were brought to the selected vaccinating health facilities in the three districts for their first dose of pentavalent vaccine were recruited on a first come basis until the strategy-level target sample sizes was reached. Children whose mothers did not have a telephone number were excluded from the study. Dropout was defined as any child who failed to return for the third dose of pentavalent vaccine two weeks or more after the scheduled date.
We selected three health facilities in each district, and randomly allocated each facility to one of the two interventions to provide short text messages or stickers reminding caretakers to return for second and third dose of pentavalent vaccines, or to serve as the control group, receiving no extra reminder messages and continue providing the next appointment date in the well-child booklet. Participants were conveniently enrolled in the selected health facilities until the strategy-level target sample sizes were reached.
Caretakers of participants in the SMS intervention group received two text reminders via SMS. Reminders were dispatched from an automated web based system two days before and on the day of the scheduled vaccination due date for the second and third dose of pentavalent vaccine. The first message reminded the parent of the next due date for the vaccination and which health facility to attend for vaccination. The second message reminded the caretakers that the actual due date was that day. The text messages were sent in Kiswahili and English. The sticker intervention group received two stickers at the time of enrollment which noted the day of the scheduled vaccination due date and the name of the health facility. Caretakers were instructed to place one sticker on the child’s health booklet, and the other sticker in a visible area of the main household or within the bedroom. Placement of the sticker within the home was verified during subsequent visits by asking the parent where they placed the sticker. The control group received no reminders, but the scheduled vaccination due date was indicated on the child’s health booklet as per routine procedures. All the groups received routine health education and advice on vaccination. Any caretaker who failed to return the child for vaccinations two weeks or more after the expected completion of third pentavalent dose was contacted by the investigator to establish reasons for missed vaccinations.
Data collection and analysis
Data were collected by study nurse and principal investigator during routine working hours at the maternal child health clinic on a daily basis. Caretakers were interviewed face to face using a pretested standard questionnaire. The questionnaire collected information on socio-demographic, knowledge and source of information on vaccination, and recorded details of vaccines received during each visit.
Data were entered and analyzed using Epi info software. The primary outcome measure was receipt of scheduled vaccines at 10 and 14 weeks. The secondary outcome measures were dropout in vaccination and factors associated with missed vaccinations. We conducted data analysis using Epi Info version 7.1.4 and excel analysis software. Proportions and means were calculated for categorical and continuous variables respectively and summarized into tables and figures for univariate analysis. Bivariate and Multivariate analysis using unconditional logistic regression using facility clusters were conducted to identify independent predictors of missed vaccinations. Odds and Adjusted Odds Ratio (OR & AOR) and 95 % Confidence Interval (CI) were used to estimate the strength of association between independent variables and the dependent variable. The threshold for statistical significance was set at p < 0.05. We calculated dropout rate as a percentage of the difference between first and third pentavalent dose.
Sample size calculation was done using Casagrande et al.  formula for comparing two proportions to detect a 15 % decrease in the drop-out vaccination rate for each of the three intervention groups, assuming a dropout rate for the third dose of pentavalent of 15.6 % , study power of 80 %, and confidence level of 95 %. The minimum sample size was 372 participants per intervention arm.
Written informed consent was obtained from caregivers of eligible children before enrolment. The study protocol was reviewed and approved by Kenyatta National Hospital/University of Nairobi Ethical Review Committee (P388/07/2013). Confidentiality of records was maintained constantly under lock and key system and will be destroyed five years after data collection is completed.
We assesses 1,126 children, Ten (0.9 %) were excluded due to lack of mobile phone number by parents. One thousand one hundred and sixteen children (1,116) were enrolled; 372 in each intervention group and 372 controls between February and October 2014. The median age of children was 45 days (range: 31–99 days), and 574 (51 %) were males. The mean age of caretakers was 26 years (14–45), 856 (77 %) were unemployed, 549 (49 %) had attained up to primary level education, 959 (86 %) owned mobile phones and 157 (14 %) used family members phone. There were no statistical differences in demographic characteristics among caretakers and children enrolled in each of the three groups (Table 1).
In the SMS intervention group, at 10 weeks of age 365 (98 %) children had received their second dose of pentavalent vaccine. At 14 weeks of age, 359 (96 %) had received their third dose of pentavalent vaccine (p = 0.4). In the sticker intervention group at 10 weeks of age, 334 (90 %) children had received their second dose of pentavalent vaccine. At 14 weeks of age 312 (84 %) had received their third dose of pentavalent vaccine (p = 0.02). In the control group at 10 weeks of age, 340 (91 %) children had received their second dose of pentavalent vaccine. At 14 weeks of age, 309 (83 %) of children had received their third dose of pentavalent vaccine (p ≤ 0.001) (Fig. 2). There was a significant increase in dropouts between second and third dose of pentavalent vaccine in the control and sticker intervention groups, but no significant increase in dropouts in the SMS intervention group. At 10 weeks, the risk difference for those who received SMS reminders and the control group was seven percent (95 % CI: 0.3–14). At 14 weeks, the risk difference for those who received SMS reminders and the control group was 13 % (95 % CI: 5.6–21.26). The mean delay in receiving second dose of pentavalent vaccine on the scheduled date in the SMS intervention group was 0 days (standard deviation (SD): 1.2), in the control group the mean delay was one day (SD: 4.3), while in the sticker group, the mean delay was one day (SD: 6.3). There was a significant difference in the mean delay in days between the SMS and Control group (p < 0.001), but no significant difference in delay between the control and sticker group (p = 0.5). The mean delay in receiving the third pentavalent dose on the scheduled date in the SMS intervention group was 0 days (SD: 2), in the control group, two days (SD: 7) and in the sticker group, two days (SD 6). There was a significant difference in the mean delay in days between the SMS and Control group (p < 0.001), but no significant difference in mean delays in days between the control and sticker group (p = 1).
A total of 1,488 messages were sent to the participants in the SMS group, cost $33.1 USD, and the premium cost of scheduling messages from web for six months cost $66.7 USD giving a cost of $0.27 USD per child for the project. Overall, among those children enrolled who received the first dose of pentavalent vaccine, 136 (12 %) did not return for their third dose of pentavalent vaccine. Of these, 63 (17 %) were from the control group compared to 13 (4 %) from the SMS intervention group (OR 0.2, CI:0.04–0.8), and 60 (16 %) were from the sticker intervention group (OR: 0.94, CI: 0.53–1.6).We traced 110 (81 %) caretakers to identify reasons for missed vaccination that included: child taken to another facility 39 (35 %); travelled out of town 33 (30 %); forgot 17 (15 %); child was sick 16 (15 %); or child died 2 (2 %).
On bivariate analysis, those who received SMS reminders (OR 0.2, CI 0.04–0.8) were 20 % less likely to miss vaccinations. In contrast, an education level of primary and below (OR 1.9, CI 1.1–3.3), age of child at first pentavalent dose >56 days (OR 2.2, CI 1.3–3.1), residing a distance ≥5 km from facility (OR 1.6, CI :1.1–2.3), waiting time >30 min (OR 1.4, CI 1.0–2.1) were associated with higher odds of missed vaccinations (Table 2).
In multivariate analysis, mothers with maternal education level of primary and below (OR 1.9, CI: 1.0–2.7), and residing >5 km from a health facility (OR 1.6, CI 1.1–3.1) were more likely to dropout. In contrast, those who received SMS reminders were 10–40 % less likely to miss vaccinations in comparison to the control group (OR 0.2, CI: 0–0.8). (Table 3).
This evaluation with a large number of participants found that SMS reminders were effective in reducing dropouts for vaccinations in the selected districts in Kenya. The vaccination coverage was significantly higher amon those receiving SMS reminder than those receiving routine reminders. About 13 % of the children vaccinated in the SMS intervention group is attributed to SMS reminders who likely would not have been vaccinated if SMS reminders had not been used at 14 weeks. This finding is similar to a study conducted in Kadoma city in Zimbabwe (2013) that demonstrated high vaccination coverage among those who received SMS reminders . A systematic review of effects of all types of reminders including SMS found that patient reminder systems were effective in improving vaccination rates . Also studies conducted in low-income, minority populations in New York City found that SMS reminders improved coverage from 4 % to 17 %, depending on the vaccine . Although the mean delay of one day in receiving the second dose of pentavalent vaccine and two days in receiving the third dose of pentavalent vaccine for the control group compared to the SMS text reminder group which had no delays for the provision of these doses of pentavalent vaccine was highly statistically significant, in our opinion a delay of one or two days is clinically not significant in terms of susceptibility to disease. Thus our findings support the hypothesis that SMS is an effective reminder system for vaccination services.
We also found that there was no difference between the sticker reminders group and the control group. The vaccination coverage at 10 and 14 weeks were not statistically significant between the sticker reminder and the control group. A study done in Ethiopia in 1993 found stickers to be effective in reducing vaccination dropouts . However,, unlike our study, the control group in the Ethiopia study used a population that had been vaccinated during the previous year. Additionally, children whose mothers had below secondary level education and children residing >5 km from the health facility was associated with being a drop-out. Similar finding were detected in previously conducted studies in Kenya [28, 30–33]. These data suggest that while efforts are needed to find effective methods for vaccination reminders, the access factors (distance from health facility) remain a challenge.
This study is subject to several limitations. If a care giver took the child to another facility for second or third pentavalent dose, the system considered the child unvaccinated,leading to misclassification, however, a sensitivity analysis that assumed that these children were actually vaccinated had no effect on the general observed difference between the inteventions. The results of this study may not be generalizable for the entire population in the country.
Vaccination coverage was higher in the SMS intervention group than in the control group; this result was both statistically and clinically significant. The overall increase may be attributed to the use of SMS reminders in this study. The difference in coverage between the sticker intervention group and the control group was not statistically significant, and may be an indication of the ineffectiveness of sticker reminders.
We recommend the extended implementation of SMS reminders in routine vaccination services in Kenya.
WHO, 2010 report. Countdown to 2015, Maternal, Newborn and child survival [Internet]. WHO. 2010 [cited 2015 Mar 13]. Available from: http://www.who.int/pmnch/media/press_materials/fs/fs_mdg4_childmortality/en/. Accessed 12 Feb 2016.
Andersson N, Cockcroft A, Ansari NM, Omer K, Baloch M, Ho Foster A, et al. Evidence-based discussion increases childhood vaccination uptake: a randomised cluster controlled trial of knowledge translation in Pakistan. BMC Int Health Hum Rights. 2009;9 Suppl 1:S8.
Clark A, Sanderson C. Timing of children’s vaccinations in 45 low-income and middle-income countries: an analysis of survey data. Lancet. 2009;373(9674):1543–9.
WHO. WHO | monitoring system. 2014 global summary Immunization Country Profile [Internet]. [cited 2014 Dec 11]. Available from: http://apps.who.int/immunization_monitoring/globalsummary/countries?countrycriteria%5Bcountry%5D%5B%5D=KEN. Accessed 12 Feb 2016.
WHO. vaccine-preventable diseases: monitoring system 2012 global summary - country profile: Kenya. 2012. http://apps.who.int/immunization_monitoring/globalsummary/countries?countrycriteria%5Bcountry%5D%5B%5D=KEN. Accessed 12 Feb 2016.
Berhane Y, Pickering J. Are reminder stickers effective in reducing immunization dropout rates in Addis Ababa, Ethiopia? J Trop Med Hyg. 1993;96(3):139–45.
LeBaron CW, Starnes DM, Rask KJ. The impact of reminder-recall interventions on low vaccination coverage in an inner-city population. Arch Pediatr Adolesc Med. 2004;158(3):255–61.
Kamanga A, Moono P, Stresman G, Mharakurwa S, Shiff C. Rural health centres, communities and malaria case detection in Zambia using mobile telephones: a means to detect potential reservoirs of infection in unstable transmission conditions. Malar J. 2010;9(1):96.
Meankaew P, Kaewkungwal J, Khamsiriwatchara A, Khunthong P, Singhasivanon P, Satimai W. Application of mobile-technology for disease and treatment monitoring of malaria in the “Better Border Healthcare Programme.”. Malar J. 2010;9:237.
Pop-Eleches C, Thirumurthy H, Habyarimana JP, Zivin JG, Goldstein MP, de Walque D, et al. Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders. AIDS Lond Engl. 2011;25(6):825–34.
Tamrat T, Kachnowski S. Special delivery: an analysis of mHealth in maternal and newborn health programs and their outcomes around the world. Matern Child Health J. 2012;16(5):1092–101.
Onono M, Carraher N, Cohen R, Bukusi E, Turan J. Use of personal digital assistants for data collection in a multi-site AIDS stigma study in rural south Nyanza Kenya. Afr Health Sci. 2011;11(3):464–73.
Stockwell MS, Kharbanda EO, Martinez RA, Vargas CY, Vawdrey DK, Camargo S. Effect of a text messaging intervention on influenza vaccination in an urban, low-income pediatric and adolescent population: a randomized controlled trial. JAMA. 2012;307(16):1702–8.
Kharbanda EO, Stockwell MS, Fox HW, Andres R, Lara M, Rickert VI. Text message reminders to promote human papillomavirus vaccination. Vaccine. 2011;29(14):2537–41.
Lester RT, Ritvo P, Mills EJ, Kariri A, Karanja S, Chung MH, et al. Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): a randomised trial. Lancet. 2010;376(9755):1838–45.
Strandbygaard U, Thomsen SF, Backer V. A daily SMS reminder increases adherence to asthma treatment: a three-month follow-up study. Respir Med. 2010;104(2):166–71.
De Tolly K, Skinner D, Nembaware V, Benjamin P. Investigation into the use of short message services to expand uptake of human immunodeficiency virus testing, and whether content and dosage have impact. Telemed J E-Health Off J Am Telemed Assoc. 2012;18(1):18–23.
Dokkum NF, Koekenbier RH, van den Broek IV, van Bergen JE, Brouwers EE, Fennema JS, et al. Keeping participants on board: increasing uptake by automated respondent reminders in an Internet-based Chlamydia Screening in the Netherlands. BMC Public Health. 2012;12:176.
Khokhar A. Short text messages (SMS) as a reminder system for making working women from Delhi Breast Aware. Asian Pac J Cancer Prev APJCP. 2009;10(2):319–22.
Lakkis NA, Atfeh AMA, El-Zein YR, Mahmassani DM, Hamadeh GN. The effect of two types of sms-texts on the uptake of screening mammogram: a randomized controlled trial. Prev Med. 2011;53(4–5):325–7.
Guy R, Hocking J, Wand H, Stott S, Ali H, Kaldor J. How Effective Are Short Message Service Reminders at Increasing Clinic Attendance? A Meta-Analysis and Systematic Review. Health Serv Res. 2012;47(2):614–32.
Hasvold PE, Wootton R. Use of telephone and SMS reminders to improve attendance at hospital appointments: a systematic review. J Telemed Telecare. 2011;17(7):358–64.
Zurovac D, Sudoi RK, Akhwale WS, Ndiritu M, Hamer DH, Rowe AK, et al. The effect of mobile phone text-message reminders on Kenyan health workers’ adherence to malaria treatment guidelines: a cluster randomised trial. Lancet. 2011;378(9793):795–803.
Bangure D, Chirundu D, Gombe N, Marufu T, Mandozana G, Tshimanga M, et al. Effectiveness of short message services reminder on childhood immunization programme in Kadoma, Zimbabwe - a randomized controlled trial, 2013. BMC Public Health. 2015;15(1):137.
Wakadha H, Chandir S, Were EV, Rubin A, Obor D, Levine OS, et al. The feasibility of using mobile-phone based SMS reminders and conditional cash transfers to improve timely immunization in rural Kenya. Vaccine. 2013;31(6):987–93.
Calverton, Maryland: KNBS and ICF Macro. Kenya National Bureau of Statistics (KNBS) & ICF Macro. Kenya Demographic and Health Survey 2008–09. Calverton, Maryland: KNBS and ICF Macro; 2010.
Casagrande C, Pike, Smith. Sample Size Estimation - Compare Two Proportions [Internet]. Biometrics 34: 483–486. 1978 [cited 2014 Oct 28]. Available from: http://www2.ccrb.cuhk.edu.hk/stat/proportion/Casagrande.htm. Accessed 12 Feb 2016.
Kariuki AC. Child Immunization Coverage In Kiandutu Slums, Thika District, Kenya. Abstr Postgrad Thesis [Internet]. 2012 May 25 [cited 2014 Oct 27];0(0). Available from: http://ir.jkuat.ac.ke/handle/123456789/1502. Accessed 12 Feb 2016.
Szilagyi PG, Bordley C, Vann JC, Chelminski A, Kraus RM, Margolis PA, et al. Effect of patient reminder/recall interventions on immunization rates: A review. JAMA. 2000;284(14):1820–7.
Mutua MK, Kimani-Murage E, Ettarh RR. Childhood vaccination in informal urban settlements in Nairobi, Kenya: Who gets vaccinated? BMC Public Health. 2011;11(1):6.
Omutanyi RM, Mwanthi MA. Determinants of immunisation coverage in Butere-Mumias district. Kenya East Afr Med J. 2005;82(10):501–5.
Maina LC, Karanja S, Kombich J. Immunization coverage and its determinants among children aged 12–23 months in a peri-urban area of Kenya. Pan Afr Med J. 2013;14:3.
Ndiritu M, Cowgill KD, Ismail A, Chiphatsi S, Kamau T, Fegan G, et al. Immunization coverage and risk factors for failure to immunize within the Expanded Programme on Immunization in Kenya after introduction of new Haemophilus influenzae type b and hepatitis b virus antigens. BMC Public Health. 2006;6:132.
We wish to acknowledge and extend our sincere gratitude to the U.S. Center for Disease Control and Prevention (CDC) for sponsoring the study, the Administration and staff of FELTP Kenya, the Institute of Tropical Medicine and Infectious Diseases at the Jomo Kenyatta University of Agriculture and Technology, county and sub-county health teams of Machakos, Nakuru and Nairobi for their support during the study and finally Alfred Musekiwa for statistical support and Dorothy L Southern for providing guidance in scientific writing.
The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.
The authors declare that they have no competing interests.
AH developed the concept, conducted the study, performed the analysis, interpreted the results and drafted the manuscript. AW, ZN, ZG, SL, HS and CT participated in revising the manuscript and providing important intellectual content. All authors have provided approval of the final manuscript.