- Research article
- Open Access
Effectiveness of educational outreach in infectious diseases management: a cluster randomized trial in Uganda
BMC Public Health volume 16, Article number: 714 (2016)
Integrated Infectious Diseases Capacity Building Evaluation (IDCAP) teams designed and implemented two health worker in-service training approaches: 1) an off-site classroom-based integrated management of infectious diseases (IMID) course with distance learning aspects, and 2) on-site support (OSS), an educational outreach intervention. We tested the effects of OSS on workload and 12 facility performance indicators for emergency triage assessment and treatment, HIV testing, and malaria and pneumonia case management among outpatients by two subgroups: 1) mid-level practitioners (MLP) who attended IMID training (IMID-MLP) and 2) health workers who did not (No-IMID).
Thirty-six health facilities participated in the IDCAP trial, with 18 randomly assigned to Arm A and 18 to Arm B. Two MLP in both arms received IMID. All providers at Arm A facilities received nine monthly OSS visits from April to December 2010 while Arm B did not. From November 2009 to December 2010, 777,667 outpatient visits occurred. We analyzed 669,580 (86.1 %) outpatient visits, where provider cadre was reported. Treatment was provided by 64 IMID-MLP and 1,515 No-IMID providers. The effect of OSS was measured by the difference in pre/post changes across arms after controlling for covariates (adjusted ratio of relative risks = a RRR).
The effect of OSS on patients-per-provider-per-day (workload) among IMID-MLP (aRRR = 1.21; p = 0.48) and No-IMID (aRRR = 0.90; p = 0.44) was not statistically significant. Among IMID-MLP, OSS was effective for three indicators: malaria cases receiving an appropriate antimalarial (aRRR = 1.26, 99 % CI = 1.02-1.56), patients with negative malaria test result prescribed an antimalarial (aRRR = 0.49, 99 % CI = 0.26-0.92), and patients with acid-fast bacilli smear negative result receiving empiric treatment for acute respiratory infection (aRRR = 2.04, 99 % CI = 1.06-3.94). Among No-IMID, OSS was effective for two indicators: emergency and priority patients admitted, detained or referred (aRRR = 2.12, 99 % CI = 1.05-4.28) and emergency patients receiving at least one appropriate treatment (aRRR = 1.98, 99 % CI = 1.21-3.24).
Effects of OSS on workload were not statistically significant. Significant OSS effects on facility performance across subgroups were heterogeneous. OSS supported MLP who diagnosed and treated patients to apply IMID knowledge. For other providers, OSS supported team work to manage emergency patients. This evidence on OSS effectiveness could inform interventions to improve health workers’ capacity to deliver better quality infectious diseases care.
Sub Saharan Africa experiences 37 % of the total deaths attributable to infectious diseases globally , but contains only 3 % of the world’s health workers . The shortage of physicians in sub Saharan Africa is at critical levels, with only 2 physicians per 10,000 population compared to 28 in high-income regions . This shortage of physicians has led to many physician roles, such as initiation of antiretroviral therapy shifting to mid-level practitioners (MLP) with fewer years of medical training , formally [5–7] and informally [8, 9]. Yet as reported in one Ugandan study, many of these MLP have not been trained to take on these tasks . They therefore require capacity building to meet the demands of changing health policies and guidelines . Some studies have shown that with additional training MLP can competently execute physicians’ roles and, in some instances, match their performance [12–14]. However, most trainings for MLP are classroom-based, often taking them away from their workstations [15, 16], disrupting workflows and limiting patients’ access to care. Several systematic reviews show that classroom-based training may not equip the attendants with sufficient skills to ensure adherence to clinical guidelines [17–19].
There is increasing interest from experts and donors in favor of educational outreach and continuous quality improvement (CQI) approaches [20–24] that integrate across diseases [25–28]. Facility-based educational outreach trainings increase opportunities for team-based interactions during MLP learning [20, 29] and reduces MLP time away from health facilities. Several studies have shown that educational outreach both with and without CQI activities can improve the quality of patient care [5, 30–35]. It may also build capacity in patient care for almost all providers, without increasing workload on the MLP who do not attend trainings.
Between 2009 and 2010, the curriculum development and mobile teams of the Integrated Infectious Diseases Capacity Building Evaluation (IDCAP) developed and delivered two novel interventions to build capacity for treatment and prevention of infectious diseases: 1) the Integrated Management of Infectious Disease (IMID) course with distance learning aspects, taught at the Infectious Diseases Institute in Kampala, Uganda, and 2) facility-based on-site support (OSS) visits, an educational outreach intervention with CQI activities . Implemented as a mixed design with pre/post and cluster randomized trial components, IDCAP tested the effect of IMID training and OSS on individual clinician competence , practice , mortality among children less than five years of age [20, 38], and facility performance [33, 39]. IMID was associated with a statistically significant 9.8 % absolute increase in clinical competence, whereas OSS was not associated with an incremental improvement in the same outcomes. . For clinical practice, IMID was associated with statistically significant improvements in taking a patient’s history and physical examination, and OSS was associated with an incremental improvement in these tasks . Child mortality increased in both arms, but the incremental effect of OSS delayed the increase during the intervention .
In the main trial analysis of facility performance,  Weaver et al. reported the effects of IDCAP’s IMID and OSS on 23 facility performance indicators. Facility performance refers to the process of care, and may reflect the contributions of more than one provider at a facility. For example, the proportion of malaria suspects with a malaria test result recorded (Indicator 4), reflects whether or not the clinician ordered the test, and the laboratory professional performed the test and recorded the result. Of the 23 indicators, 12 were based on a data surveillance system with data on each outpatient visit. The other 11 indicators were based on Ministry of Health Registers for HIV care, maternal, child and newborn health and tuberculosis. The 12 indicators based on the data surveillance system are presented in Table 1, and include three indicators for emergency triage assessment and treatment, four indicators for malaria case management, four indicators for case management of respiratory illness, and one indicator for HIV testing.
Among those 12 indicators, Weaver et al.’s reported that IMID alone was associated with statistically significant pre/post improvements in three indicators: outpatients triaged (Indicator 1), emergency and priority patients who were admitted, detained or referred (Indicator 2), and pneumonia suspects under age five assessed for pneumonia (Indicator 8). A combination of IMID and OSS was associated with statistically significant improvements in four indicators: outpatients triaged (Indicator 1), emergency and priority patients who were admitted, detained or referred (Indicator 2), 3) estimated malaria cases who received appropriate antimalarial treatment (Indicator 5), and patients with a negative malaria test result who were prescribed an antimalarial (Indicator 6), for which a decrease was an improvement. The incremental effect of OSS was not statistically significant for any of the 12 indicators, but many of the effect sizes were large.
We hypothesized that OSS improved facility performance more among the providers who attended IMID training (IMID-MLP) compared to the ones who did not (No-IMID). Weaver et al.’s analysis included all patients, and we suspected that the No-IMID subgroup could have diluted the effects of OSS in the IMID-MLP subgroup. We therefore sought to test the effect of OSS on the 12 indicators based on the data surveillance system in the two subgroups of health providers: IMID-MLP and No-IMID. The analysis was limited to only outpatient visits with data to identify provider cadres, and whether or not the provider attended IMID training. In this article, the term “indicator” refers to the facility performance indicators.
Also, during the ethical review of the IDCAP protocol, the School of Medicine Ethics and Research Committee of Makerere University expressed concern that the interventions would affect the distribution of the workload. The data surveillance system data provided an opportunity to examine whether workload increased among the IMID-MLP with OSS, and among the No-IMID health workers with OSS. We therefore tested the effect of OSS on changes in workload in each subgroup of providers.
We conducted a secondary analysis of IDCAP data. As noted above, IDCAP was a mixed design study consisting of pre/post and cluster randomized trial components. It was implemented at 36 health center IVs (HCIV) or comparable health facilities across Uganda. Eighteen of the 36 health facilities were randomized to Arm A and the other 18 to Arm B. In both arms, two MLP from each of the 36 health facilities received IMID training. From April to December 2010, all providers at Arm A facilities received nine monthly OSS visits while Arm B did not. The pre/post component measured the effects of the combination of IMID training and OSS in Arm A, and IMID training alone in Arm B. The cluster randomized trial component measured the incremental effect of OSS as the difference between the pre/post effects in the two arms. Figure 1a presents the design of the main test of facility performance indicators, which is reported as the overall result below. Note that the overall results presented in Table 5 differ from the results of Weaver et al.’s analysis, because only outpatient records with data on provider cadre and whether or not the provider attended IMID training were analyzed. Figure 1b presents the design of the subgroup analysis.
The process of randomization, blinding, sample size calculation, and recruitment for the cluster-randomized trial were previously reported in Weaver et al. . A The IDCAP protocol is summarized by Naikoba et al. . The full protocol can also be accessed as supplementary file in both Mbonye et al. , Weaver et al.  and is available as supporting information to this paper in Protocol 1. The CONSORT checklist for this subgroup analysis is available as Additional file 1.
Sites, participants, and inclusion criteria
The 36 study health facilities included 31 health center IV (HCIV) and five small hospitals comparable in size to HCIV. A HCIV serves a population of about 100,000 people providing basic preventive and curative care, and is at the highest referral point for a health sub-district . Two MLP, defined as clinical officers, registered nurses or midwives, from each health facility participated in the IMID training. Inclusion criteria for facilities and IMID participants have been described elsewhere [20, 29]. Briefly, the key inclusion criteria for selecting IMID participants was involvement in daily management of patients in the outpatient clinics, and spending over 80 % of the time seeing patients at the participating health facilities . All health workers including IMID participants were invited to participate in the OSS sessions. All outpatients participated as part of the routine healthcare seeking process. For the subgroup analyses, as noted above, only records of outpatient visits with data on the health provider’s cadre and whether or not the health provider attended IMID training were included.
IMID was a three-week core course followed by two one-week booster courses at 12 and 24 weeks after the core course and distance learning . The core course was taught in four sessions at the Infectious Diseases Institute in Kampala, Uganda with two sessions for Arm A in March and April 2010 and two sessions for Arm B in May and June 2010.
OSS was a two-day visit to the health facilities in Arm A delivered by mobile teams for nine consecutive months from April to December 2010 [20, 29]. Each mobile team consisted of four members: a medical officer with CQI experience, a clinical officer, a laboratory technologist, and a registered nurse. Each visit focused on one OSS topic as well as follow-up from the previous sessions and was characterized by four distinct activities: the multidisciplinary team training, one-on-one mentorship, breakout sessions, and CQI activities.
The outcomes were patients per provider used to measure changes in workload, and 12 facility performance indicators based on the data surveillance system whose definitions by numerator and denominator are reported in Table 1, as well as sources of the indicators. Indicator 16, proportion of patients with an HIV test recorded, differs from the earlier report , because it excludes registry data from antenatal and tuberculosis clinics.
The data source was the revised Uganda Ministry of Health outpatient medical form (MF5) . Using the MF5, health workers prospectively collected data on every outpatient visit from November 2009 to December 2010. From March 2010, data entry assistants were stationed at each health facility to capture these data electronically in an Epi Info® Version 3.2 (U.S. Centers for Disease Control and Prevention, Atlanta, GA) database. At the end of each month, the data entry assistants transmitted electronic data to the Infectious Diseases Institute where data for all health facilities were merged using Microsoft Excel® 2010 (Microsoft Corporation, Redmond, WA, USA), and further cleaned.
We used frequencies to describe provider, patients, and outcomes across arms, subgroups, and time periods. The effect of OSS was estimated as a difference in pre/post (Time 0/Time 1) changes between Arm A and Arm B. In Arm A, Time 0 was from November 2009 to March 2010 and Time 1 started after the first IMID training in Arm A and was from April to December 2010. In Arm B, Time 0 was from November 2009 to May 2010 and Time 1 started after the first IMID training in Arm B and was from June to December 2010. During Time 1, nine OSS visits were implemented in Arm A.
Using a generalized linear latent and mixed model , data on the number of patients per provider were analyzed as continuous dependent variables with main effects for arm, subgroup, time period and their interaction to estimate pre/post differences within each subgroup in each arm and ratios of relative risk (RRR) for the effect of OSS within each subgroup. The unit of analysis was a subgroup-facility-month, and regressions were estimated with clusters for provider and facility with robust standard errors.
The RRR for a given performance indicator was estimated with main effects for arm, time period and their interaction, using data for the total sample and for each subgroup and the generalized linear model with a Poisson family and log link as described earlier [33, 39]. The unit of analysis was facility month, and all regression analyses were clustered on the health facility. To adjust for over dispersion and using Poisson rather than binomial family, the regressions were estimated with robust standard errors. Multiple comparisons were addressed by basing the statistical tests on α = 0.01 and all results were presented with 99 % confidence intervals (CI).
All regression analyses were adjusted for facility type (public or private not-for-profit), facility level (HCIV or small hospital), data entry assistant on-site, Baylor and previous participation in the national HIV CQI program (see description of strata in [33, 39]). Indicators 1–7 and 10–11 were also adjusted for staffing and patient age (<5, > = 5 years), indicators 8–9 for staffing, and indicator 16 for staffing, TB suspect and patient age group (2–14 months, 18 months – 13 years and ≥14 years) to reflect HIV testing guidelines. All data analyses were conducted using Stata® version 12 (StataCorp, College Station, Texas, USA).
The School of Medicine Research and Ethics Committee of Makerere University Kampala (reference number 2009–175) and the Uganda National Council for Science and Technology (reference number HS-722) approved the IDCAP protocol. The University of Washington Human Subjects Division determined that IDCAP did not meet the regulatory definition of research under 45 CFR 46.102 (d). This subgroup analysis was exempt from review by the University of Antwerp ethical review board.
The flow of the participating health facilities, and IMID training and OSS participants is presented in Fig. 2 . All health facilities participated up to the end of the study. Of the 36 individuals who participated in IMID training, one person in Arm A and two in Arm B did not attend one or more boost courses. Attendance of OSS sessions was also not consistent. Out of 513 clinical staff expected to attend multi-disciplinary team sessions, only 440 (86 %) attended at least once; out of 499 clinical staff expected to attend the breakout session, only 344 (69 %) attended at least once; and out of 351 clinical staff expected to attend the clinical mentoring and coaching session, only 186 (53 %) attended at least once. Among those who attended at least one OSS session, the mean number of sessions attended per clinical staff was 4.93 for multi-disciplinary team sessions, 3.64 for breakout sessions and 4.01 for clinical mentoring and coaching sessions.
A total of 777,667 outpatients visited the 36 health facilities during the study period. Of these visits, 669,580 (86.1 %) had data on the provider’s name and cadre, which allowed us to determine whether or not the provider attended IMID training, and were included in this analysis (Table 2). During these visits, patients were seen by 64 IMID-MLP and 1,515 No-IMID providers. Data on 108,087 (13.9 %) visits with missing (91,006), unknown (14,686) or indeterminate (2,395) data on the provider were omitted from the analysis.
In Table 3, baseline data for the number of providers, the number of patients seen, and the estimated number of patients per provider per calendar day is reported by time period, arm and subgroup. The number of patients per provider per calendar day was higher in Arm B with more hospitals than in Arm A in the IMID-MLP subgroup (4.3 vs. 3.7) and similar across arms in the No-IMID subgroup (1.1 vs. 1.1).
In Table 4, baseline data for each indicator are reported by both arm and subgroup. Performance in Arm B was generally higher than in Arm A within both IMID-MLP and No-IMID subgroups for eight out of the 12 indicators. For indicators 6 (Proportion of patients with a negative malaria test result who were prescribed an antimalarial), and 7 (Proportion of patients with a positive malaria test result who were prescribed an antibiotic) a lower percentage indicated better performance, and Arm A had lower percentages than Arm B for both indicators. Performance was highest for indicator 5 (estimated proportion of malaria cases who received an appropriate antimalarial). For the remaining indicators, performance was generally low, did not exceed 64 % in both arms and subgroups, and was as low as 3.1 % for indicator 8 (Proportion of pneumonia suspects aged under 5 years assessed for pneumonia) in the IMID-MLP subgroup of Arm A.
As shown in Table 3, pre/post change in the number of patients per provider per month from Time 0 to Time 1 among the IMID-MLP subgroup was higher in the Arm A (adjusted relative risk (aRR) = 1.15, 99 % CI = 0.72-1.85, p = 0.437) than in Arm B (aRR = 0.96, 99 % CI = 0.57-1.62, p = 0.828), and the effect of OSS in this subgroup was not statistically significant (adjusted RRR (aRRR) = 1.21; 99 % CI = 0.61-2.38, p = 0.478). In the No-IMID subgroup however, pre/post change was lower in Arm A (aRR = 0.99, 99 % CI = 0.76-1.30, p = 0.922) than Arm B (aRR = 0.1.10, 99 % CI = 0.88-1.37, p = 0.264), and the effect of OSS was also not statistically significant (aRR = 0.90; 99 % CI = 0.63-1.28, p = 0.443).
The effect of OSS on 12 facility performance indicators is reported in Table 5. Overall, the incremental effect of OSS was statistically significant for three indicators; increases in the estimated proportion of emergency patients who received at least one appropriate treatment (Indicator 3, aRRR = 2.00; 99 % CI = 1.11-3.79, p = 0.003), and estimated proportion of malaria cases who received an appropriate antimalarial (Indicator 5, aRRR = 1.15, 99 % CI = 1.01-1.32, p = 0.006), and decrease in proportion of patients with a negative malaria test result prescribed an antimalarial (Indicator 6, aRRR = 0.65, 99 % CI = 0.44-0.98, p = 0.006). Within the IMID-MLP, the incremental effect of OSS was statistically significant for three indicators; increases in estimated proportion of malaria cases who received an appropriate antimalarial (Indicator 5, aRRR = 1.26, 99 % CI = 1.02-1.56, p = 0.005) and estimated proportion of patients with acid-fast bacilli (AFB) smear negative results who received empiric treatment for acute respiratory infection (indicator 11, aRRR = 2.04, 99 % CI = 1.06-3.94, p = 0.005) and decrease in proportion of patients with a negative malaria test result prescribed an antimalarial (Indicator 6, aRRR = 0.49, 99 % CI = 0.26-0.92, p = 0.004). Within the No-IMID subgroup, the incremental effect of OSS was statistically significant for only two indicators; increases in the proportion of emergency and priority patients admitted, detained or referred (Indicator 2, aRRR = 2.12, 99 % CI = 1.05-4.28, p = 0.006), and estimated proportion of emergency patients who received at least one appropriate treatment (Indicator 3, aRRR = 1.98, 99 % CI = 1.21-3.24, p < 0.001). Compared to the No-IMID subgroup, the effect sizes were larger in the IMID-MLP subgroup in seven (3, 5, 6, 8, 10, 11 and 16) of the 12 indicators measured.
There have been limited rigorous randomized education trials that demonstrate the effects of health worker training approaches on patient care outcomes in the resource constrained world. In this study, we have evaluated the effect of an educational outreach intervention involving nine monthly on-site support (OSS) sessions on health facility performance in two groups of trainees – those who were provided with five weeks of off-site classroom education and those who did not have this opportunity.
The OSS intervention did not significantly increase patient load within the subgroup of health providers who did not participate in the IMID training. Among the mid-level practitioners (MLP) who received both IMID training and OSS, the number of patients per provider per calendar day increased; but the changes in workload attributable to OSS were not statistically significant. The effects of OSS on facility performance indicators were heterogeneous. Patients treated by health providers who attended the IMID training benefited from improved case management of malaria and respiratory infections. Patients treated by providers without the IMID training benefited from improvements in emergency triage, assessment and treatment.
The number of patients per provider per calendar day was much lower than we expected. On average, the health providers with IMID training saw 4.64 patients per calendar day, and the other providers 0.83 indicating that the MLP saw 5 times more patients than other providers. This was expected since MLP involved in daily management of patients in the outpatient clinics and spent over 80 % of their time at the health facility seeing patients were prioritized during the selection process . These results for the MLP with IMID training are consistent with those of the Institute for Health Metrics and Evaluation’s report that showed health providers saw an average of three to five patients per day . These results also indicate that health workers in Uganda treat very few patients per day, but this finding contrasts with other reports in which complaints of heavy workload have been cited among health workers in Uganda  and other sub-Saharan Africa countries [45, 46]. The reported number of patients seen per provider is an average across the estimated working days for each of the study time periods. It is possible that providers did not work on all estimated days and thus treated a higher number of patients on days when they worked . In a review of studies in six countries including Uganda, it was found that 35 % of the health care providers were absent during their assigned shifts . Among many factors, the absence usually arises because health workers are on leave, attending trainings off-site, tending to their gardens, or doing work in private clinics to supplement their income . If health workers are only on duty an average of 65 % of the time, then the average number of patients per provider per day would increase by one-third. It is also possible that the number of patients’ visits per day was higher on some days than others. Adding in the fluctuations in patient visits and it possible that some clinicians would manage much higher number of patients on some days. Further analysis is required to determine how the number of patients per day seen by clinicians varies by day and across facilities.
Among the health workers without the IMID training, this analysis showed no statistically significant effect of OSS on changes in the volume of patients they managed. In fact, the number of patients seen per provider per calendar day among these health providers remained the same before and during the OSS. Yet a slight increase in volume of patients seen per provider per calendar day among the MLP with IMID training was observed during OSS, although this increase was not statistically significant. This increase in patient load among IMID trainees coupled with no increase among providers who did not attend IMID training, shows a general increase in patient volume overall during OSS, perhaps pointing to an appreciation of better quality services being offered at the health facilities. Rather than shift tasks and workload among cadres, OSS sought to improve facility performance within each cadre’s scope of practice. This could explain why there was no significant increase in patient volume among health workers without IMID training and decrease among health workers without the IMID training.
Overall, OSS was effective for three of the 12 facility performance indicators in this subgroup analysis, compared to none in the main IDCAP trial results . In this subgroup analysis, only records with complete data on the provider’s cadre and IMID attendance were analyzed unlike in Weaver et al.’s  analysis that included all patient records. It is plausible that providers with incomplete data also attended fewer OSS or benefited less from them and diluted the effects. We saw evidence of the no-IMID subgroup diluting the OSS effects of the MLP with IMID especially for indicators 11 (patients with AFB smear negative results who received empiric treatment for acute respiratory infection) and 16 (patients with an HIV test result recorded). On the other hand, evidence of the MLP with IMID diluting the effects of the no-IMID subgroup was observed for indicator 2 (emergency and priority patients who were admitted, detained or referred).
The effects of OSS among the MLP with IMID tended to be statistically significant for indicators that reflected clinical decision-making, such as prescribing antimalarials and antibiotics. In contrast, the effects of OSS among the no-IMID subgroup were for emergency, triage and assessment indicators that required a broader team effort to identify and manage patients appropriately. Although OSS did not seek to change a cadre’s scope of practice, it did seek to empower all providers to triage patients and organize immediate care for emergency and priority patients.
The effects of OSS observed in this analysis were heterogeneous across indicators as well as across subgroups. In the overall sample, the average effect size was 34 % and higher than estimates elsewhere. For instance, reviews of continuous medical education and effect of educational outreach visits on health workers’ training reported median improvements ranging from 6.9 to 13.9 %  and from 5.6 to 21 %  respectively. The effect sizes for the emergency, triage and assessment and malaria case management indicators were generally larger than the effect sizes for case management of respiratory infections and HIV testing. The indicators for the first two coincide with the first two OSS. The OSS sessions for the latter two were delivered later in the intervention, an indication that perhaps, the expectation of immediate improvements over a shorter period of time may have been unrealistic. There is need for monitoring these indicators over more months to observe whether facility performance will improve over time.
Also future researchers should consider designing their trials for a subgroup analysis. Within resource-limited settings in many sub-Saharan African countries, clinicians and other higher level cadres are the ones usually selected to attend continuous medical education trainings to support them improve the quality of diagnosis and treatment. Allied health workers, nurses and other lower level providers often miss out on such opportunities since they mainly play supporting roles to clinicians in providing patient care. OSS would therefore be a great opportunity to improve capacity of these non-clinician health workers to dispense better quality patient care in the entire patient care process. For clinicians and higher level cadres, OSS would be important in supporting them to apply knowledge and skills in diagnosis and treatment acquired from classroom training.
To our knowledge, the IDCAP trial is one of the first randomized trials that evaluated the effects of an integrated educational outreach and quality improvement intervention in sub-Saharan Africa. The results of this study therefore provide important evidence that could inform capacity building interventions and policies for health workers in resource limited settings.
As noted in Weaver et al.  sample size calculations for the IDCAP trial were based on comparison across arms and an α = 0.05. Consequently, this subgroup analysis may have been underpowered to detect difference-in-difference at α = 0.01 when comparing effect of OSS on facility performance between arms. OSS sessions were delivered gradually for nine months, and its effect may have been underestimated by measuring it during its implementation rather than after.
This study was conducted in a sample of sub-district level referral HCIVs or comparable small hospitals that met the inclusion criteria. These results can thus be generalized for similar health facilities in Uganda and other countries, and for indicators for which OSS was effective.
The MLP with IMID training managed thrice as many patients per day compared to other providers. Out of the 12 facility performance indicators, OSS improved three indicators across all patients and among patients managed by MLP with IMID training, but only two indicators among patients managed by providers without IMID training. These results show that OSS supported MLP who diagnosed and treated patients to apply knowledge from IMID. For other providers, OSS supported team work to manage emergency patients. Since provision of patient care is a team effort with clear roles for every health worker, health workers engaged in clinical diagnosis and treatment may need OSS in addition to classroom training, while the nurses and other providers who play a supporting role to the clinicians will need OSS to effectively contribute more to patient care.
WHO. Global health estimates, Deaths by cause, age, sex and country, 2000–2012. 7th ed. Geneva: WHO; 2014.
WHO. Working together for health, The World Health Report 2006. Geneva: World Health Organization; 2006.
Naicker S, Plange-Rhule J, Tutt RC, Eastwood JB. Shortage of healthcare workers in developing countries--Africa. Ethn Dis. 2009;19 Suppl 1:S1-60-4. Epub 2009/06/02.
Mullan F, Frehywot S. Non-physician clinicians in 47 sub-Saharan African countries. Lancet. 2007;370(9605):2158–63. doi:10.1016/s0140-6736(07)60785-5. Epub 2007/06/19.
Fairall L, Bachmann MO, Lombard C, Timmerman V, Uebel K, Zwarenstein M, et al. Task shifting of antiretroviral treatment from doctors to primary-care nurses in South Africa (STRETCH): a pragmatic, parallel, cluster-randomised trial. Lancet. 2012;380(9845):889–98.
Georgeu D, Colvin CJ, Lewin S, Fairall L, Bachmann MO, Uebel K, et al. mplementing nurse-initiated and managed antiretroviral treatment (NIMART) in South Africa: a qualitative process evaluation of the STRETCH trial. Implementation Sci. 2012;7:66. doi:10.1186/1748-5908-7-66. pub 2012/07/18. PubMed PMID: 22800379; PubMed Central PMCID: PMCPmc3464669.
Callaghan M, Ford N, Schneider H. A systematic review of task- shifting for HIV treatment and care in Africa. Hum Resour Health. 2010;8:8. doi:10.1186/1478-4491-8-8. Epub 2010/04/02. PubMed PMID: 20356363; PubMed Central PMCID: PMCPmc2873343.
Wendo C. Uganda leads way in innovative HIV/AIDS treatment. Bull World Health Organ. 2005;83(4):244–5. Epub 2005/05/04. doi: /S0042-96862005000400004. PubMed PMID: 15868011; PubMed Central PMCID: PMCPmc2626211.
Amolo OF, Aceng E, Madraa E, Namagala E, Serutoke J. Scaling up antiretroviral therapy: experience in Uganda. Perspectives and practice in antiretroviral treatment. Geneva: World Health Organization; 2003.
Lutalo IM, Schneider G, Weaver MR, Oyugi JH, Sebuyira LM, Kaye R, et al. Training needs assessment for clinicians at antiretroviral therapy clinics: evidence from a national survey in Uganda. Hum Resour Health. 2009;7:76. doi:10.1186/1478-4491-7-76. Epub 2009/08/25. PubMed PMID: 19698146; PubMed Central PMCID: PMCPmc2752450.
Soucat A, Scheffler R, Ghebreyesus T. The labor market for health workers in Africa: a new look at the crisis: World Bank Publications. 2013.
Vasan A, Kenya-Mugisha N, Seung KJ, Achieng M, Banura P, Lule F, et al. Agreement between physicians and non-physician clinicians in starting antiretroviral therapy in rural Uganda. Hum Resour Health. 2009;7:75. doi:10.1186/1478-4491-7-75. Epub 2009/08/22. PubMed PMID: 19695083; PubMed Central PMCID: PMCPmc2738652.
Iwu EN, Holzemer WL. Task shifting of HIV management from doctors to nurses in Africa: clinical outcomes and evidence on nurse self-efficacy and job satisfaction. AIDS Care. 2014;26(1):42–52. doi:10.1080/09540121.2013.793278. Epub 2013/05/25.
Emdin CA, Chong NJ, Millson PE. Non-physician clinician provided HIV treatment results in equivalent outcomes as physician-provided care: a meta-analysis. J Int AIDS Soc. 2013;16:18445. doi:10.7448/ias.16.1.18445. Epub 2013/07/06. PubMed PMID: 23827470; PubMed Central PMCID: PMCPmc3702014.
OGAC. PEPfAR report on workforce capacity and HIV/AIDS. Washington DC: United States Office of the Global AIDS Coordinator; 2006.
Wane W, Martin G. Service delivery indicators, Education and health services in Uganda: data for results and accountability. Washington, DC: World Bank; 2013.
Bloom BS. Effects of continuing medical education on improving physician clinical care and patient health: a review of systematic reviews. Int J Technol Assess Health Care. 2005;21(3):380–5. Epub 2005/08/23.
Davis D, O’Brien MAT, Freemantle N, Wolf FM, Mazmanian P, Taylor-Vaisey A. Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes? JAMA. 1999;282(9):867–74.
Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, et al. Continuing education meetings and workshops: effects on professional practice and health care outcomes. The Cochrane database of systematic reviews. 2009;(2):Cd003030. Epub 2009/04/17. doi:10.1002/14651858.CD003030.pub2.
Naikoba S, Colebunders R, Van Geertruyden J-P, Willis KS, Kinoti SN, Kulubya MN, et al. Design of a cluster randomized trial assessing integrated infectious diseases training and on-site support for midlevel practitioners in Uganda. Int J Care Pathw. 2012;16(4):152–9.
PEPFAR. Quality strategy phase I: institutionalization of Countrie’s ability to improve HIV clinical programs. Washington DC: The President’s Emergency Plan for AIDS Relief; 2014.
PEPFAR. Five-Year Strategy. Washington DC: The President’s Emergency Plan for AIDS Relief; 2009.
Burlew R, Puckett A, Bailey R, Caffrey M, Brantley S. Assessing the relevance, efficiency, and sustainability of HIV/AIDS in-service training in Nigeria. Hum Resour Health. 2014;12:20. doi:10.1186/1478-4491-12-20. Epub 2014/04/18. PubMed PMID: 24739511; PubMed Central PMCID: PMCPmc4022275.
Lawn JE, Rohde J, Rifkin S, Were M, Paul VK, Chopra M. Alma-Ata 30 years on: revolutionary, relevant, and time to revitalise. Lancet. 2008;372(9642):917–27. doi:10.1016/s0140-6736(08)61402-6. Epub 2008/09/16.
Kim JY, Farmer P, Porter ME. Redefining global health-care delivery. Lancet. 2013;382(9897):1060–9.
Government US. Global Health Initiative: Strategy Document: United States Government. 2011.
UNAIDS U. Global plan towards the elimination of New HIV infections among children by 2015. 2011.
Duncombe C, Ball A, Passarelli C, Hirnschall G. Treatment 2.0: catalyzing the next phase of treatment, care and support. Curr Opin HIV AIDS. 2013;8(1):4–11.
Miceli A, Sebuyira LM, Crozier I, Cooke M, Naikoba S, Omwangangye AP, et al. Advances in clinical education: a model for infectious disease training for mid-level practitioners in Uganda. Int J Infect Dis. 2012;16(10):e708–13. doi:10.1016/j.ijid.2012.07.003. Epub 2012/08/22.
Fairall LR, Zwarenstein M, Bateman ED, Bachmann M, Lombard C, Majara BP, et al. Effect of educational outreach to nurses on tuberculosis case detection and primary care of respiratory illness: pragmatic cluster randomised controlled trial. BMJ (Clin Res Ed). 2005;331(7519):750–4. doi:10.1136/bmj.331.7519.750. Epub 2005/10/01. PubMed PMID: 16195293; PubMed Central PMCID: PMCPmc1239979.
Engels Y, van den Hombergh P, Mokkink H, van den Hoogen H, van den Bosch W, Grol R. The effects of a team-based continuous quality improvement intervention on the management of primary care: a randomised controlled trial. Br J Gen Pract. 2006;56(531):781–7. Epub 2006/09/30. PubMed PMID: 17007709; PubMed Central PMCID: PMCPmc1920719.
Ferguson Jr TB, Peterson ED, Coombs LP, Eiken MC, Carey ML, Grover FL, et al. Use of continuous quality improvement to increase use of process measures in patients undergoing coronary artery bypass graft surgery: a randomized controlled trial. JAMA. 2003;290(1):49–56. doi:10.1001/jama.290.1.49. Epub 2003/07/03.
Weaver MR, Burnett SM, Crozier I, Kinoti SN, Kirunda I, Mbonye MK, et al. Improving facility performance in infectious disease care in Uganda: a mixed design study with pre/post and cluster randomized trial components. PLoS One. 2014;9(8):e103017. doi:10.1371/journal.pone.0103017. Epub 2014/08/19. PubMed PMID: 25133799; PubMed Central PMCID: PMCPmc4136733.
Namagembe A, Ssekabira U, Weaver MR, Blum N, Burnett S, Dorsey G, et al. Improved clinical and laboratory skills after team-based, malaria case management training of health care professionals in Uganda. Malar J. 2012;11:44. doi:10.1186/1475-2875-11-44. Epub 2012/02/15. PubMed PMID: 22330281; PubMed Central PMCID: PMCPmc3342908.
Zwarenstein M, Fairall LR, Lombard C, Mayers P, Bheekie A, English RG, et al. Outreach education for integration of HIV/AIDS care, antiretroviral treatment, and tuberculosis care in primary care clinics in South Africa: PALSA PLUS pragmatic cluster randomised trial. BMJ (Clin Res Ed). 2011;342:d2022. doi:10.1136/bmj.d2022. Epub 2011/04/23. PubMed PMID: 21511783; PubMed Central PMCID: PMCPmc3080737.
Weaver MR, Crozier I, Eleku S, Makanga G, Mpanga Sebuyira L, Nyakake J, et al. Capacity-building and clinical competence in infectious disease in Uganda: a mixed-design study with pre/post and cluster-randomized trial components. PLoS One. 2012;7(12):e51319. doi:10.1371/journal.pone.0051319. Epub 2012/12/29. PubMed PMID: 23272097; PubMed Central PMCID: PMCPmc3522731.
Imani P, Jakech B, Kirunda I, Mbonye MK, Naikoba S, Weaver MR. Effect of integrated infectious disease training and on-site support on the management of childhood illnesses in Uganda: a cluster randomized trial. BMC Pediatr. 2015;15:103. doi:10.1186/s12887-015-0410-z. Epub 2015/09/01. PubMed PMID: 26315284; PubMed Central PMCID: PMCPmc4551363.
Weaver MR, Rajaratnam JK, Thompson ML, Mbonye MK, Wun J, Willis KS. Effect of capacity-building in infectious disease on mortality among children under-5: a cluster randomised trial. Lancet. 2013;381:S146.
Mbonye MK, Burnett SM, Burua A, Colebunders R, Crozier I, Kinoti SN, et al. Effect of integrated capacity-building interventions on malaria case management by health professionals in Uganda: a mixed design study with pre/post and cluster randomized trial components. PLoS One. 2014;9(1):e84945. doi:10.1371/journal.pone.0084945. Epub 2014/01/15. PubMed PMID: 24416316; PubMed Central PMCID: PMCPMC3885656.
Uganda Go. Health Sector Strategic Plan II, 2004/05-2009/10, Ministry of Health. 2004.
Mbonye MK, Burnett SM, Colebunders R, Naikoba S, Van Geertruyden JP, Weaver MR, et al. Disease diagnosis in primary care in Uganda. BMC Fam Pract. 2014;15(1):165. doi:10.1186/1471-2296-15-165. Epub 2014/10/10.
Rabe-Hesketh S, Skrondal A, Pickles A. GLLAMM manual. 2004.
IHME. Health service provision in Uganda: assessing facility capacity, costs of care, and patient perspectives. Seattle: Institute for Health Metrics and Evaluation; 2014.
Buwembo W, Munabi IG, Galukande M, Kituuka O, Luboga SA. A qualitative analysis of health professionals’ job descriptions for surgical service delivery in Uganda. Hum Resour Health. 2014;12 Suppl 1:S5. doi:10.1186/1478-4491-12-s1-s5. Epub 2015/04/11. PubMed PMID: 25859744; PubMed Central PMCID: PMCPmc4108889.
Chipeta JB. Factors that affect staff morale in tertiary hospitals in Malawi: a case study of kamuzu central hospital. J Hum Resour Sustainability Stud. 2014;2(04):230.
Koto MV, Maharaj P. Difficulties facing healthcare workers in the era of AIDS treatment in Lesotho. SAHARA J. 2016;13:53–9. doi:10.1080/17290376.2016.1179588. Epub 2016/04/30.
Belita A, Mbindyo P, English M. Absenteeism amongst health workers--developing a typology to support empiric work in low-income countries and characterizing reported associations. Hum Resour Health. 2013;11:34. doi:10.1186/1478-4491-11-34. Epub 2013/07/23. PubMed PMID: 23866770; PubMed Central PMCID: PMCPmc3721994.
Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Rev Peru Med Exp Salud Publica. 2011;28(2):337–41. Epub 2011/08/17.
O’Brien MA, Rogers S, Jamtvedt G, Oxman AD, Odgaard-Jensen J, Kristoffersen DT, et al. Educational outreach visits: effects on professional practice and health care outcomes. The Cochrane database of systematic reviews. 2007;(4):Cd000409. Epub 2007/10/19. doi:10.1002/14651858.CD000409.pub2.
Molyneux E, Ahmad S, Robertson A. Improved triage and emergency care for children reduces inpatient mortality in a resource-constrained setting. Bull World Health Organ. 2006;84(4):314–9. Epub 2006/04/22. doi: /S0042-96862006000400016. PubMed PMID: 16628305; PubMed Central PMCID: PMCPmc2627321.
WHO. Integrated management of childhood illness: field test of the WHO/UNICEF training course in Arusha, United Republic of Tanzania. WHO Division of Child Health and Development & WHO Regional Office for Africa. Bull World Health Organ. 1997;75 Suppl 1:55–64. Epub 1997/01/01. PubMed PMID: 9529718; PubMed Central PMCID: PMCPMC2486999.
Uganda Go. Indicators for monitoring comprehensive HIV/AIDS care services and antiretroviral therapy in Uganda, Quality assurance program. Kampala: Ministry of Health; 2007.
Ssekabira U, Bukirwa H, Hopkins H, Namagembe A, Weaver MR, Sebuyira LM, et al. Improved malaria case management after integrated team-based training of health care workers in Uganda. Am J Trop Med Hyg. 2008;79(6):826–33. Epub 2008/12/05.
Ayieko P, English M. Case management of childhood pneumonia in developing countries. Pediatr Infect Dis J. 2007;26(5):432–40. doi:10.1097/01.inf.0000260107.79355.7d. Epub 2007/05/01. PubMed PMID: 17468655; PubMed Central PMCID: PMCPMC2654069.
WHO. Treatment of tuberculosis: guidelines for national programmes. Thirdth ed. Geneva: World Health Organization; 2003.
WHO, PEPFAR, UNAIDS. A guide to monitoring and evaluation for collaborative TB/HIV activities. Geneva: 2009.
Dye C, Maher D, Weil D, Espinal M, Raviglione M. Targets for global tuberculosis control. Int J Tuberc Lung Dis. 2006;10(4):460–2. Epub 2006/04/11.
UNAIDS. United Nations general assembly special session on HIV/AIDS: monitoring the declaration of commitment on HIV/AIDS: guidelines on construction of core indicators. Geneva: UNAIDS; 2002.
IDCAP was implemented by a partnership of Accordia Global Health Foundation, the Ugandan Ministry of Health, Infectious Diseases Institute, International Training and Education Center for Health, and University Research Co. LLC. The authors wish to thank the IDCAP Steering Committee, including: Drs. Geoffrey Bisoborwa, Alex Coutinho, Beatrice Crahay, Warner Greene, King Holmes, Stephen Kinoti, Nigel Livesley, Fred Wabwire-Mangen, M. Rachad Massoud, Alex Opio, W. Michael Scheld, and Gisela Schneider for guidance. The authors also thank the Ugandan Ministry of Health, the IDCAP curriculum, training and mobile teams, the IDCAP trainees for their enthusiastic participation, and the IDCAP evaluation and data management team for ensuring availability of the data used for this article.
IDCAP was supported through grant number 94298 to Accordia Global Health Foundation from the Bill & Melinda Gates Foundation. Preparation of this manuscript was supported by VLIR-UOS via the HEFS Platform Harvest Call (ZIUS2013VOA0902). The content expressed within this article is that of the authors and does not necessarily reflect positions or policies of the Bill & Melinda Gates Foundation and VLIR-UOS. Funders did not influence the study design, data collection, analysis and interpretation, writing of this manuscript, or the decision to submit the manuscript for publication.
Conceived and designed the experiments: MKM SN MRW. Performed the experiments: SN. Designed the analysis plan: MKM. Reviewed and approved the analysis plan: MKM SMB RC JPVG MRW. Analyzed the data: MKM SMB. Wrote the first draft of the manuscript: MKM. Reviewed and approved the final version of the manuscript: MKM SMB SN AR RC JPVG MRW.
All authors declare they have no competing interests.
Data sharing statement
The extra data is publicly available on the Global Health Exchange website http://ghdx.healthdata.org/series/uganda-integrated-infectious-disease-capacity-building-evaluation-idcap.
About this article
Cite this article
Mbonye, M.K., Burnett, S.M., Naikoba, S. et al. Effectiveness of educational outreach in infectious diseases management: a cluster randomized trial in Uganda. BMC Public Health 16, 714 (2016). https://doi.org/10.1186/s12889-016-3375-4
- Educational outreach
- Classroom training
- Mid-level health providers