Skip to main content

Combining national survey with facility-based HIV testing data to obtain more accurate estimate of HIV prevalence in districts in Uganda

Abstract

Background

National or regional population-based HIV prevalence surveys have small sample sizes at district or sub-district levels; this leads to wide confidence intervals when estimating HIV prevalence at district level for programme monitoring and decision making. Health facility programme data, collected during service delivery is widely available, but since people self-select for HIV testing, HIV prevalence estimates based on it, is subject to selection bias. We present a statistical annealing technique, Hybrid Prevalence Estimation (HPE), that combines a small population-based survey sample with a facility-based sample to generate district level HIV prevalence estimates with associated confidence intervals.

Methods

We apply the HPE methodology to combine the 2011 Uganda AIDS indicator survey with the 2011 health facility HIV testing data to obtain HIV prevalence estimates for districts in Uganda. Multilevel logistic regression was used to obtain the propensity of testing for HIV in a health facility, and the propensity to test was used to combine the population survey and health facility HIV testing data to obtain the HPEs. We assessed comparability of the HPEs and survey-based estimates using Bland Altman analysis.

Results

The estimates ranged from 0.012 to 0.178 and had narrower confidence intervals compared to survey-based estimates. The average difference between HPEs and population survey estimates was 0.00 (95% CI: − 0.04, 0.04). The HPE standard errors were 28.9% (95% CI: 23.4–34.4) reduced, compared to survey-based standard errors. Overall reduction in HPE standard errors compared survey-based standard errors ranged from 5.4 to 95%.

Conclusions

Facility data can be combined with population survey data to obtain more accurate HIV prevalence estimates for geographical areas with small population survey sample sizes. We recommend use of the methodology by district level managers to obtain more accurate HIV prevalence estimates to guide decision making without incurring additional data collection costs.

Peer Review reports

Background

Accurate data are needed for monitoring health programmes and interventions and for appropriate allocation of resources. In most of sub-Saharan Africa (SSA), where the HIV/AIDS epidemic is generalized, national population surveys, such as AIDS Indicator Surveys (AIS), are preferred to provide reliable health indicator estimates for programme monitoring [1]. The surveys are however designed to provide estimates at national and regional levels, but small sample sizes at district or sub-district levels lead to less reliable indicator estimates, that have wider confidence intervals [1,2,3,4].

Health Information Systems such as the District Health Information System (DHIS2) provide another source of information that can be used for monitoring the HIV/AIDS epidemic. This data is collected more regularly, available at more decentralized levels, e.g. districts and costs less to collect. WHO, UNAIDS and other development partners recommend use of routine facility data in addition to other data sources to monitor programme performance, assess intervention coverage and measure levels of disease in a population [5]. Use of routine health facility data informed the adjustments in HIV prevalence estimates in many countries in Eastern and Southern Africa [6]. Several other studies highlight the utility of data from routine service delivery in informing service delivery decisions [7, 8]. Routine service delivery data, however, are collected only on individuals who attend/access health facilities and thus provide potentially biased estimates of population indicators.

In addition, development partners and ministries of health in middle and low-income countries have invested in electronic health information systems including the DHIS2, to improve the quality and timeliness of data from the systems. In Uganda, Ministry of Health (MoH) with support from development partners conduct quarterly reviews to validate data reported into DHIS2 [9]. With this investment, there is a need to find ways to utilize this source of information to inform service delivery decisions. Combining routine data with a relatively small sample of respondents from population survey data has been found to produce more accurate indicator estimates [10, 11].

Statistical models in packages such as SPECTRUM or THEMBISA attempt to use both routine and population survey data to calculate HIV/AIDS indicators. Model inputs such as ANC prevalence, mortality, number of individuals on ART and recent HIV prevalence when not available, complicate their use [12]. A simpler and more robust method may be easier to use and give good results.

Larmarange and Bendaud obtained district level estimates from population survey data from 17 countries using a kernel density approach implemented in PrevR [13]. In districts with inadequate number of observations in the survey sample, estimates were obtained based on observations from neighboring districts or administrative units and were categorized as “uncertain” estimates [13]. Using a similar approached, PrevR, UNAIDS found “uncertain” estimates in up to 86% of the districts in Mozambique and in 79% of the districts in Uganda [13, 14].

In this study, we explore use of the readily available health facility service delivery data in combination with population survey data to obtain more accurate HIV prevalence estimates at district level for monitoring interventions and disease impact in the general population. We implement the Hybrid Prevalence Estimation (HPE) methodology to obtain HIV prevalence estimate and 95% confidence interval for districts in Uganda. The estimation process accounts for sample size limitations associated with population survey data at district level and self-selection bias associated with health facility testers, a limitation that many researchers have not been able to address adequately [2,3,4, 15,16,17,18].

Methods

Data sources

We analyzed data from the 2011 Uganda AIDS Indicator Survey (UAIS) and health facility HIV testing data from the national DHIS2 collected during 2011. UAIS data was downloaded from the Measure DHS website www.measuredhs.com after obtaining consent from ICF/Macro international, while health facility testing data was extracted from the DHIS2 hosted at MoH after obtaining written permission from MoH. Ethical clearance to conduct this study was obtained from the University of Witwatersrand Human Research Ethics Committee (HREC) and Uganda National Council for Science and Technology (UNCST).

Uganda AIDS Indicator survey

The UAIS is a nationally representative, population-based, HIV serological survey, designed to provide HIV prevalence estimates at national and regional levels [19]. The survey used a two-stage cluster sampling design. For the 2011 survey, Uganda was divided into 10 geographical regions each consisting of 8–15 neighboring districts. Clusters were randomly selected from each region with probability proportional to number of households in the cluster. The estimated number of households per cluster were projections from the 2002 National Population and Housing Census (NPHC) [20]. Clusters were enumeration areas from the 2002 NPHC. Sample sizes were allocated equally across the 10 geographical regions. A systematic sample of 25 households were then selected from each cluster using the 2002 NPHC sampling frame. All adults present in the selected household and who consented to participate in the survey were interviewed [19]. More details about the survey are available from www.measuredhs.com.

For this study, a total of 19,475 individuals (8532 men and 10,943 women) aged 15–49 years and tested for HIV during the survey were considered. Variables included in the analysis were (i) at cluster level: area of residence (urban/rural) and region of the country and at (ii) individual level: respondents’ gender, marital status, education level attained, number of sexual partners including husband/wife in the 12 months preceding the survey, employment status and distance to nearest health facility.

A multilevel logistic regression model was fitted to the UAIS data to obtain the respondents’ probability of testing for HIV in a health facility. The model was fitted using a total of 470 clusters. The average number of observations per cluster were 45(min = 11 and max = 64). Unequal sample selection probabilities were accounted for by incorporating scaled sampling weights. Carle’s methodology was applied to adjust/scale the sampling weights [21]. The models were fitted using maximum likelihood method in Stata statistical software, release 15 [22].

Survey respondents were considered to have tested for HIV at a health facility if they reported that they tested for HIV in health facility and received their test results in the 12 months preceding the survey. Pregnant or breastfeeding women who tested for HIV during antenatal care attendance and individuals who tested at an HIV care centre such as The AIDS Support Organization (TASO) and AIDS Information Centre (AIC) were included in the analysis. Health facilities included facilities owned and managed by government (public) and private organizations that reported HIV testing data to the national DHIS2.

Health facility data

Health facility HIV testing data comprised of data reported to the national DHIS2. The system was developed to provide accurate, timely and quality routine data for monitoring and planning for the health sector in Uganda [9, 23]. Training and technical support from development partners and MoH has led to improvement in the quality and reliability of data in the system [9]. Aggregated HIV testing data is reported by health facilities to the DHIS2 on a monthly basis. The data includes HIV testing at all inpatient and outpatient departments in health facilities. For 2011 reporting period, data was disaggregated by age (i.e. 0–14, 15–49 and 50+ years) and gender (male and female). For this study, we considered males and females aged 15–49 years.

Indicators considered for this analysis were: number of individuals who were tested and received their HIV test results (A) and number of individuals who tested HIV positive (B). For ANC data, we considered number of pregnant women counseled, tested and received their HIV test results (C) at first antenatal visit and the number who tested HIV positive (D). HIV counseling and testing algorithm in Uganda recommends HIV testing for any individual whose most recent negative HIV test result was conducted more than 3 months prior to the current visit to the health facility [24]. Some individuals may test multiple times within a year but may not disclose to health workers resulting in double counting, a key limitation for this study. Furthermore, some pregnant women may test for HIV before seeking antenatal care and test again during antenatal attendance leading to double counting in the data reported to the national DHIS2.

Variables based on DHIS2 data were defined as follows;

  • Total number of individuals tested for HIV = (A + C)

  • Number HIV positive = (B + D)

  • Total number of males tested for HIV = males in A

  • Number of males tested HIV positive = males in B

  • Total number of females tested for HIV = (females in A) + C

  • Number of female tested HIV positive = (females in B) + D

Addressing possible bias in health facility data

Routine facility data collected as part of service delivery consists of individuals who self-select, limiting its’ use for general population health indicator monitoring. To obtain general population indicator estimates, some researchers have used census projections as denominators, however this approach often results in coverage estimates that are greater than 100% [25]. Population surveys are preferred to obtain health indicator denominators since their design takes into account population distribution in the country [25,26,27,28]. The UAIS comprise two subpopulations, namely individuals who tested for HIV in a health facility in the 12 months preceding the survey (the facility testers) and those who did not test for HIV in a health facility (the non-facility testers) for the same period. We assume that the UAIS estimates of HIV prevalence for those who tested for HIV in a health facility and for those who did not test for HIV in a health facility are accurate at regional levels, since estimates of domain proportions from a multistage survey are unbiased. We apply this assumption to adjust the denominators of the DHIS2 data so that at the regional level, DHIS2 HIV prevalence estimates are similar to UAIS prevalence estimates. The adjustment process was carried out as follows:

  1. 1.

    We obtained the HIVs prevalence \( {\hat{k}}_f \) among health facility testers in each region in the UAIS data.

  2. 2.

    We adjusted denominators in the DHIS2 data for each region using \( {n}_{ajdusted}^r=\frac{n_{pos}}{{\hat{k}}_f} \), where npos is the observed number of individuals who tested HIV positive in each region in the DHIS2 data.

  3. 3.

    Calculated an adjustment factor (δf) for each region, using \( {\delta}_f=\frac{n_{ajdusted}^r}{n_r} \), where nr is the observed number of individuals who tested for HIV in each region from the DHIS2 data.

  4. 4.

    We applied the adjustment factor (δf), to obtain \( {n}_{ajdusted}^d \), the adjusted number of individuals who tested for HIV in a health facility at district level using, \( {n}_{ajdusted}^d={\delta}_f\ast {n}_d \), where nd is the observed number of individuals tested for HIV at district level.

  5. 5.

    HIV prevalence (Pf) based on DHIS2 adjusted data in the district was then obtained as a ratio of npos, the total observed positives and nadjusted the adjusted number of individuals who tested for HIV in the district, i.e. \( {P}_f=\frac{n_{pos}}{n_{ajdusted}^d} \)

Hybrid prevalence estimation methodology

We consider n individuals in the UAIS to include nc individuals who tested for HIV at a health facility during the 12 months preceding the survey and know their test result and \( {n}_{\underset{\_}{c}} \) individuals who did not test for HIV at a health facility and therefore do not know their HIV status. i.e. \( n={n}_c+{n}_{\underset{\_}{c}} \). Using health facility prevalence computed in step 5 above, we computed district HIV prevalence as a weighted average of prevalence from DHIS2 data, Pf and prevalence among individuals who did not test for HIV in a health facility, \( {\hat{P}}_{\underset{\_}{s}} \) estimated from the UAIS data.

$$ \hat{P}={\hat{\pi}}_c{P}_f+\left(1-{\hat{\pi}}_c\right){\hat{P}}_{\underset{\_}{s}} $$
(1)

where;

\( \hat{P} \) – HPE/combined estimate, \( {\hat{\pi}}_c \) – the estimated probability of testing for HIV in a health facility, Pf− Adjusted HIV prevalence for individuals tested at a health facility and \( {\hat{P}}_{\underset{\_}{s}} \) – HIV prevalence for individuals tested during the survey and had not tested for HIV in a health facility in the 12 months preceding the survey. We estimated \( {\hat{\pi}}_c \) from UAIS data using multilevel logistic regression adjusting for both individual and cluster level factors. Applying this model, we account for clustering at cluster level [25]. Although the probability of testing for HIV in a health facility was obtained at individual level, we used average district level probability of testing to combine the estimates. Since average probability of HIV testing is obtained from a survey sample containing both facility and non-facility testers, we estimate the variance and standard errors (SE) for the HPE respectively as follows;

$$ {\displaystyle \begin{array}{l} Var\left(\hat{P}\right)=\frac{1}{n}\left\{{\hat{P}}_{\underset{\_}{s}}\left(1-{\hat{P}}_{\underset{\_}{s}}\right)\left(1-{\hat{\pi}}_c\right)+\left(1-{\hat{\pi}}_c\right)\ {\left({P}_f-{\hat{P}}_{\underset{\_}{s}}\right)}^2\right\}\\ {}\mathrm{and}\kern0.37em SE=\sqrt{\mathit{\operatorname{var}}\left(\hat{P}\right)}\end{array}} $$
(2)

We assess accuracy of the HPEs compared to survey-based prevalence estimates by computing the percentage change in standard errors. We further assessed agreement of the estimates obtained using the HPE methodology with those from population survey method (Direct population survey estimate) using a Bland Altman analysis [26, 27].

All analysis was carried out in Stata statistical analysis software, Release 15 [22] and R version 3.5.0 [28].

Results

Of the 19,475 individuals, 6729 (34.6%) tested for HIV in a health facility in the 12 months preceding the survey. HIV prevalence among those who tested in a health facility was 0.084 compared to 0.068 among those who did not test in a health facility (Table 1).

Table 1 Regional level HIV prevalence estimates

From health facility data, national (unadjusted) HIV prevalence was 0.058 (Male: 0.057 Female: 0.059). A total of 4,758,991 (female: 73.7%) individuals were tested for HIV in a health facility. (Table 1). DHIS2 HIV positivity by gender is presented Additional file 1: Appendix 1.

Weighting/annealing factor

Overall (national) average propensity to test in a health facility was 0.35 (male: 0.27, female:0.41). It ranged from 0.001 to 0.95 (Fig. 1). Mid Northern region had the highest average propensity to test for HIV in health facility, 0.44 (male: 0.40 and female: 0.49) while Mid-Eastern region had the lowest, 0.25 (male: 0.16, female: 0.32) (Fig. 1).

Fig. 1
figure1

Propensity to test for HIV in a health facility

Hybrid prevalence estimates

HIV prevalence was highest in Central 1 region (0.11) and lowest in Mid-Western and Mid-Eastern regions (0.04 in each region). District level HPEs ranged from 0.01 to 0.18. Average HIV prevalence by region were; Central 1: 0.11 (min; 0.06, max; 0.18), Central 2: 0.10 (0.08, 0.17), East Central: 0.05 (0.02, 0.09), Mid-Eastern: 0.04 (0.01, 0.09), Mid Northern: 0.09 (0.05, 0.14), Mid-Western: 0.08 (0.03,0.16), North East:0.04 (0.04, 0.10), South West: 0.08 (0.04, 0.13) and West Nile: 0.04 (0.03, 0.07) (Table 2). Table 2 also presents HPE, survey and DHIS2 based district HIV prevalence estimates by district.

Table 2 HPE HIV prevalence estimates, (HPE, Survey and unadjusted DHIS2)

Figure 2 presents HIV prevalence maps in; both sexes (map a); in males (map b); and in females (map c). HPEs had similar patterns for both sexes, males and females consistent with the regional level prevalence estimates from population survey in Table 1. Districts in Central 1 region, Mid northern region, Island, and those along lake shores had higher overall, male and female HIV prevalence estimates (Fig. 2, and Additional file 1: Appendix 2) while districts in mid-eastern and West Nile region had lower HIV prevalence estimates. HPEs were not calculated for two districts (Bukwo in mid-eastern region and Ntoroko in mid-western region) because UAIS data points was not available for those districts.

Fig. 2
figure2

District Hybrid Prevalence Estimates. Maps created based on study data using Stata Statistical Software: Release 15. User licence was acquired before using the software

Figure 3 compares district HIV prevalence estimates from population survey and HPE while in Fig. 4, we compare HPE and the adjusted DHIS2 data for selected districts. Prevalence comparison between HPE and survey for all districts is presented in Additional file 1: Appendix 3. The figures show that HPEs had narrower confidence intervals compared to direct survey estimates indicating an improvement in the precision of the estimates.

Fig. 3
figure3

District prevalence estimates from combined and population survey data. P_survey- survey based prevalence estimate while P_HPE is HIV prevalence based on the HPE methodology

Fig. 4
figure4

District prevalence estimates from combined and DHIS2 data. P_HIS- Health facility-based prevalence estimate while P_HPE is HIV prevalence based on the HPE methodology

Of the 110 districts, 51 (46.4%) had lower HPEs (point estimates) and 59 (53.6%) had higher HPE compared to the survey-based district prevalence estimates (Fig. 3, Additional file 1: Appendix 3).

HPEs were however lower than the DHIS2 prevalence estimates in 74 (67.3%) and higher in 36 (32.7%) of the districts in Uganda (Fig. 4, Additional file 1: Appendix 4).

A joint comparison of the HP estimates with both survey-based and health facility-based prevalence estimates show that 33 (30.0%) of the districts had lower HPEs while 18 (16.4%) had higher estimates compared to both the survey and health facility-based prevalence estimates.

Precision of HPE and population survey estimates

Standard errors of the HPEs were generally lower compared to SEs from survey-based estimates (Fig. 5). Of the districts, 105 (95.5%) had lower HPE SEs compared to SEs from survey-based estimates. Overall, the HPE standard errors were decreased by 28.9% (95% CI: 23.4–34.4) compared to survey-based standard errors.

Fig. 5
figure5

Standard errors of estimates from survey and the HPE

Similarity of HPE and survey-based estimates

On average, there is no difference between survey and HPE estimates, 0.0 (95% CI: − 0.04,0.04) (Fig. 6a). Average difference for males was − 0.01 (95% CI: − 0.05,0.03) while for females was 0.00 (95% CI: − 0.06,0.06). Although there seems to be a bias (0.01) when assessing the agreement between HP and survey-based estimates for males (Fig. 6b), the 95% confidence interval of the difference between the estimates are narrow. Additionally, there was no systematic pattern of the points as the average of the estimates increases.

Fig. 6
figure6

Difference plot comparing HPE and Direct survey estimates. PREV_HIS- HIV Prevalence based on health facility data, PREV_hp-HIV prevalence based on the HPE methodology while PREV_dom- HIV prevalence based on survey data only

The mean difference between the HPE and DHIS2 estimates was 0.01 (95% CI: − 0.05,0.06) (Fig. 7a). Average difference for males was − 0.01 (95% CI: − 0.07, 0.06) while for females was 0.02 (95% CI: − 0.05, 0.09), (Fig. 7b and c respectively). The size of the difference increased with increase in the mean of the estimates. This is seen from the wider variability of the points about the no-difference (zero) line as the values of the average of the estimates increase (Fig. 7a-c). The average difference was 0.02 and confidence intervals were wider when comparing HPEs and survey-based estimates for females (Fig. 7c).

Fig. 7
figure7

Difference plot comparing HPE and DHIS2 estimates. PREV_HIS- HIV Prevalence based on health facility data, PREV_hp-HIV prevalence based on the HPE methodology while PREV_dom- HIV prevalence based on survey data only

Discussion

In this study, we implement a novel approach, the Hybrid Prevalence Estimation methodology to obtain HIV prevalence estimates for districts in Uganda. We combined DHIS2 HIV testing data with information of non-facility testers from the 2011 UAIS data to obtain district level HIV prevalence estimates.

Although national population surveys are the gold standard for calculating population level health indicators, district level estimates from these surveys are less accurate due to the reduced sample sizes at district or lower administrative levels. The demand for accurate indicator estimates at district or lower administrative levels for programme monitoring motivates use of innovative approaches to provide the estimates. We obtained district level HIV prevalence estimates by combining population survey information with DHIS2 data using a Hybrid Prevalence Estimation methodology. Our estimates had narrower confidence intervals compared to estimates from the population survey at the district level, consistent with findings elsewhere [10, 11]. The HPE was calculated from three parameters; 1) Prevalence in the health facility sample, 2) prevalence among non-facility testers from the population survey sample and 3) the propensity to test for HIV in a health facility from the population survey sample. We also observed that HIV prevalence estimate obtained using the HPE methodology was similar to the population survey HIV prevalence estimates for male and females combined, and for males only while it was lower for females. Additionally, UAIS based prevalence estimates were generally higher while DHIS2 prevalence estimates were lower than the consistent with findings elsewhere [29].

In the UAIS, the population can be divided into two domains: 1) those that have access to health facilities, get tested for HIV, and are linked to appropriate care if found HIV positive, and 2) those that do not access health facilities and may remain unknown in the health care system. Barriers to health care access for the latter subpopulation may include factors such as low/no education and not being in stable sexual relationship that also increase the risk of HIV transmission [30, 31]. Combining survey with DHIS2 data therefore generates more precise indicator estimates that can be used to improve planning and service delivery for the general population at district levels where service delivery decision are implemented.

Facility level data has known limitations including selection bias, as it is not a random sample from the population for measuring general population level prevalence [15, 16, 18, 32]. Studies in Uganda [33, 34], Tanzania [35] and Zambia [36, 37], have also found facility-based antenatal HIV testing data has biased estimates of HIV prevalence’ and therefore not appropriate for calculating HIV/AIDS indicators including HIV prevalence in the general population. The HPE methodology requires use of a small population survey sample [10, 11] to correct for bias in indicator estimates from health facility testing data. We used Uganda AIDS indicator survey data to correct for the bias in DHIS2 so as to obtain the HIV prevalence estimates for districts in Uganda. Other population surveys such as the demographic and health surveys can be similarly combined with facility-based data to obtain general population indicator estimates for planning and decision making, especially in low resourced environments where resource constraint limits collection of large sample sizes.

We applied a weighting factor, propensity to test in a health facility, calculated using multilevel logistic regression to combine the two data sources. Individuals and cluster level predictors of testing for HIV were included in the model. Predictors of access to testing or health care system may also impact HIV disease risk as noted elsewhere [10]. Multilevel logistic regression is also appropriate for the UAIS design and enables inclusion of both individual and cluster level risk factors in the modelling process. The model also accounts for clustering [21, 25, 38].

There was no difference in prevalence estimates from the HPE and Survey based approaches but confidence intervals of the HPEs were narrower, demonstrating efficiency of the HPE methodology in obtaining population level estimates as observed elsewhere [11, 18, 39].

Strengths and limitations

We applied multilevel modeling which has multiple advantages over classical models including use of HIV risk factors at individual and cluster levels. We used data from the 2011 UAIS, a more recent survey, the Population HIV Impact Assessment (PHIA), completed in 2017 was not publicly available at the time of this study. DHS data are prone to refusal to participate, this may have bias on the results of this study as those who refuse to participate may have characteristics different from those who participated in the study. Furthermore, this study was limited to complete case analysis thus reducing the effective sample size used for the analysis. DHIS2 data includes individuals who may have tested multiple times which can lead to the use of wrong or unrepresentative denominators for individuals tested at health facilities. Studies elsewhere report repeat testing ranging from 3 to 13% [40, 41]. We further note that some health facilities, especially privately owned, do not report their data to the national DHIS2 further lowering the representativeness of health facility HIV testing data.

Conclusions

The growing demand for accurate information for programme management and policy formulation will require strategies that use all the available information efficiently with little or no additional resource investments. Countries and development partners continue to build and strengthen DHIS2 through capacity building and regular data quality assessments. We applied a simple tool, HPE methodology, to support efficient use of DHIS data in combination with small survey samples to obtain more accurate indicator estimates at district or lower administrative levels. HPE obtained in this study had reduced standard errors (by 28.8%) compared to survey-based estimates demonstrating improved accuracy and reliability of the estimates. We therefore recommend use of the methodology to combine DHIS2 data with population survey data to obtain population level indicator estimates for lower administrative levels where the survey samples are small for accurate indicator estimation.

Availability of data and materials

The 2011 AIDS indicator survey datasets analyzed during the current study are available from https://dhsprogram.com/what-we-do/survey/survey-display-373.cfm. Health facility HIV testing dataset can be accessed from Ministry of Health, Uganda following a reasonable request. Ethics clearance from Uganda National Council for Science and Technology (UNCST) is required to access the data. All data used in this study were identified by participant unique IDs, no additional identifying information was included in the data.

Abbreviations

AIC:

AIDS Information Centre

AIDS:

Acquired Immune Deficiency Syndrome

AIS:

Aids Indicator Survey

CI:

Confidence Interval

DHIS2:

District Health Information System Version 2

DHS:

Demographic Health Survey

HIV:

Human Immunodeficiency Virus

HPE:

Hybrid Prevalence Estimate

HREC:

Human Research Ethics Committee

MOH:

Ministry of Health

NPHC:

National Population and Housing Census

PHIA:

Population HIV Impact Assessment

SE:

Standard error

SSA:

Sub-Saharan Africa

TASO:

The AIDS Support Organization

UAIS:

Uganda AIDS Indicator Survey

UNAIDS:

The Joint United Nations Program on HIV/AIDS

UNCST:

Uganda National Council for Science and Technology

WHO:

World Health Organization

References

  1. 1.

    UNAIDS/WHO Working Group on Global HIV/AIDS and STI Surveillance. Monitoring HIV impact using Population-Based Surveys. 2015.

    Google Scholar 

  2. 2.

    McGovern ME, Marra G, Radice R, Canning D, Newell M-L, Barnighausen T. Adjusting HIV prevalence estimates for non-participation: an application to demographic surveillance. J Int AIDS Soc. 2015;18(1):19954.

    Article  Google Scholar 

  3. 3.

    Marston M, Harriss K, Slaymaker E. Non-response bias in estimates of HIV prevalence due to the mobility of absentees in national population-based surveys: a study of nine national surveys. Sex Transm Infect. 2008;84(Suppl 1):71–8.

    Article  Google Scholar 

  4. 4.

    Vinod M, Hong R, Khan S, Gu Y. Evaluating HIV Estimates from National Population-Based Surveys for Bias resulting from non-Reponse. DHS analytical studies no. 12. Calverton, Maryland: Macro International Inc.; 2008.

    Google Scholar 

  5. 5.

    Chan M, Kazatchkine M, Lob-levyt J, Obaid T, Schweizer J, Veneman A, et al. Meeting the demand for results and accountability : a call for action on health data from eight Global Health agencies. PLoS Med. 2010;7(1):5–8.

    Article  Google Scholar 

  6. 6.

    UNAIDS. ENDING AIDS: Progress Towards the 90–90-90 Targets. Global Aids Update. 2017. Available from: http://www.unaids.org/sites/default/files/media_asset/Global_AIDS_update_2017_en.pdf.

  7. 7.

    Rice B, Boulle A, Baral S, Egger M, Mee P, Fearon E, et al. Strengthening Routine Data Systems to Track the HIV Epidemic and Guide the Response in Sub-Saharan Africa. JMIR Public Heal Surveill. 2018;4(2):e36.

    Article  Google Scholar 

  8. 8.

    Sheng B, Marsh K, Slavkovic AB, Gregson S, Eaton JW, Bao L. Statistical models for incorporating data from routine HIV testing of pregnant women at antenatal clinics into HIV/AIDS epidemic estimates. AIDS. 2017;31(Suppl 1):S87–94.

    Article  Google Scholar 

  9. 9.

    Kiberu VM, Matovu JK, Makumbi F, Kyozira C, Mukooyo E, Wanyenze RK. Strengthening district-based health reporting through the district health management information software system: the Ugandan experience. BMC Med Inform Decis Mak. 2014;14(1):40.

    Article  Google Scholar 

  10. 10.

    Hedt BL, Pagano M. Health indicators: eliminating bias from convenience sampling estimators. Stat Med. 2011;30(5):560–8.

    PubMed  PubMed Central  Google Scholar 

  11. 11.

    Jeffery C, Pagano M, Hemingway J, Valadez JJ. Hybrid prevalence estimation : method to improve intervention coverage estimations. PNAS. 2018;115(51):13063–8.

    Article  Google Scholar 

  12. 12.

    Avenir Health. Spectrum Manual: Spectrum System of Policy Models. Available from: https://www.avenirhealth.org/Download/Spectrum/Manuals/AIMManualEnglish.pdf.

  13. 13.

    Larmarange J, Bendaud V. HIV estimates at second subnational level from national population-based surveys. AIDS. 2014;28(Suppl 4):S469–2476.

    Article  Google Scholar 

  14. 14.

    UNAIDS. Developing Subnational Estimates of HIV Prevalence and the Number of People Living with HIV. 2014.

    Google Scholar 

  15. 15.

    Wilson KC, Mhangara M, Dzangare J, Eaton JW, Hallett TB, Mugurungi O, et al. Does nonlocal women’s attendance at antenatal clinics distort HIV prevalence surveillance estimates in pregnant women in Zimbabwe? AIDS. 2017;31(Suppl 1):S95–102.

    Article  Google Scholar 

  16. 16.

    Zaba BW, Carpenter LM, Boerma JT, Gregson S, Nakiyingi J, Urassa M. Adjusting ante-natal clinic data for improved estimates of HIV prevalence among women in sub-Saharan Africa. AIDS. 2000;14(17):2741–50.

    CAS  Article  Google Scholar 

  17. 17.

    Manda S, Masenyetse L, Cai B, Meyer R. Mapping HIV prevalence using population and antenatal sentinel-based HIV surveys: a multi-stage approach. Popul Health Metrics. 2015;13:22.

    Article  Google Scholar 

  18. 18.

    Gregson S, Terceiria N, Kakowa M, Mason PR, Anderson RM, Chandiwana SKCM. Study of bias in antenatal clinic HIV-1 surveillance data in a high contraceptive prevalence population in sub-Saharan Africa. AIDS. 2002;16(4):643–52.

    Article  Google Scholar 

  19. 19.

    Ministry of Heath and ICF international. Uganda AIDS Indicator Survey (AIS) 2011. Kampala Uganda and Rockville, Maryland, USA; 2012. Available from: http://health.go.ug/docs/UAIS_2011_REPORT.pdf.

  20. 20.

    Uganda Bureau of Statistics. 2002 Uganda Population and Housing Census Administrative Report 2007.

  21. 21.

    Carle AC. Fitting multilevel models in complex survey data with design weights: recommendations. BMC Med Res Methodol. 2009;9(1):1–13.

    Article  Google Scholar 

  22. 22.

    StataCorp. Stata Statistical Software: Release 15. College Station, TX: StataCorp LLC; 2017. Available from: https://www.stata.com/.

  23. 23.

    Ministry of Health Kampala Uganda. No Title. Electronic Health Management Information System. Available from: http://www.health.go.ug/oldsite/node/76.

  24. 24.

    World Health Organization. Consolidated guidelines on person-centred HIV patient monitoring and case surveillance. AIDS. 2017;31(Suppl 1):S87–94 Available from: http://www.differentiatedcare.org/Portals/0/adam/Content/Y1Jnet-yCkO4DGu8XS9VMg/File/9789241512633-eng.pdf.

    Google Scholar 

  25. 25.

    Rabe-Hesketh S, Skrondal A. Multilevel modelling of complex survey data. J R Stat Soc Ser A Stat Soc. 2006;169(4):805–27.

    Article  Google Scholar 

  26. 26.

    Bland U, Giavarina D. Lessons in biostatistics Biochemia Medica. 2015;25(2):141–51.

  27. 27.

    Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307-10.

  28. 28.

    Core Team R. R: a language and environment for statistical computing [internet]. Vienna: The R Foundation; 2013. Available from: http://www.r-project.org.

    Google Scholar 

  29. 29.

    Gouws E, Mishra V, Fowler TB. Comparison of adult HIV prevalence from national population-based surveys and antenatal clinic surveillance in countries with generalised epidemics: Implications for calibrating surveillance data. Sex Transm Infect. 2008;84(Suppl I):i17–i23.

  30. 30.

    Muyunda B, Musonda P, Mee P, Todd J, Michelo C. Educational attainment as a predictor of HIV testing uptake among women of child-bearing age: analysis of 2014 demographic and health survey in Zambia. Front Public Heal. 2018;6:192.

    Article  Google Scholar 

  31. 31.

    Kiros G, Workagegn F, Gebretsadik LA. Predictors of HIV-test utilization in PMTCT among antenatal care attendees in government health centers: institution-based cross-sectional study using health belief model in Addis Ababa, Ethiopia, 2013. HIV/AIDS - Res Palliat Care. 2015;215–22.

  32. 32.

    Gregson S, Dharmayat K, Pereboom M, Takaruza A, Mugurungi O, Schur N, Nyamukapa CA. Do HIV prevalence trends in antenatal clinic surveillance represent trends in the general population in the antiretroviral therapy era? The case of Manicaland, East Zimbabwe. AIDS. 2015;29(14):1845–53.

    Article  Google Scholar 

  33. 33.

    Fabiani M, Fylkesnes K, Nattabi B, Ayella EO, Declich S. Evaluating two adjustment methods to extrapolate HIV prevalence from pregnant women to the general female population in sub-Saharan Africa. AIDS. 2003;17(3):399–405.

    Article  Google Scholar 

  34. 34.

    Musinguzi J, Kirungi W, Opio A, Montana L, Mishra V, Madraa E, et al. Comparison of HIV prevalence estimates from sentinel surveillance and a National Population-Based Survey in Uganda, 2004-2005. JAIDS J Acquir Immune Defic Syndr. 2009;51(1):78–84.

    Article  Google Scholar 

  35. 35.

    Kwesigabo G, Killewo JZ, Urassa W, Mbena E, Mhalu F, Lugalla JL, et al. Monitoring of HIV-1 infection prevalence and trends in the general population using pregnant women as a sentinel population: 9 years experience from the Kagera region of Tanzania. J Acquir Immune Defic Syndr. 2000;23(5):410–7.

    CAS  Article  Google Scholar 

  36. 36.

    Fylkesnes K, Musonda RM, Sichone M, Ndhlovu Z, Tembo F, Monze M. Declining HIV prevalence and risk behaviours in Zambia: evidence from surveillance and population-based surveys. AIDS. 2001;15(7):907–16.

    CAS  Article  Google Scholar 

  37. 37.

    Fylkesnes K, Ndhlovu Z, Kasumba K, Musonda RM, Sichone M. Studying dynamics of the HIV epidemic. AIDS. 1998;12(10):1227–42.

    CAS  Article  Google Scholar 

  38. 38.

    Wong GY, Mason WM. The hierarchical logistic regression model for multilevel analysis. J Am Stat Assoc. 1985;80(391):513–24.

    Article  Google Scholar 

  39. 39.

    Judith RG, Anne B, Michel C, Rosemary MM, Maina K, Isaac M, Francis TLZ. Factors influencing the difference in HIV prevalence between antenatal clinic and general population in sub- Saharan Africa. AIDS. 2001;15:1717–25.

    Article  Google Scholar 

  40. 40.

    Kulkarni S, Tymejczyk O, Gadisa T, Lahuerta M, Remien RH, Melaku Z, et al. “Testing, testing”: multiple HIV-positive tests among patients initiating antiretroviral therapy in Ethiopia. J Int Assoc Provid AIDS Care. 2017;16(6):546–54.

    Article  Google Scholar 

  41. 41.

    Maina I, Wanjala P, Soti D, Kipruto H, Boerma T. Using health-facility data to assess subnational coverage of maternal and child health indicators, Kenya. Bull World Health Organ. 2017;95:683–94.

    Article  Google Scholar 

Download references

Acknowledgements

We acknowledge the Ugandan Ministry of Health and its partners in conducting the Uganda AIDS Indicator Survey, and for the permission to use both DHIS2 and UAIS datasets.

Funding

This study was supported through the Wellcome Trust, grant 107754/Z/15/Z-DELTAS Africa via Sub-Saharan Africa Consortium for Advanced Biostatistics (SSACAB). The DELTAS Africa Initiative is an independent funding scheme of the African Academy of Sciences (AAS) Alliance for Accelerating Excellence in Science in Africa (AESA) and is supported by the New Partnership for Africa’s Development Planning and Coordinating Agency (NEPAD Agency) with funding from the Wellcome Trust (Grant No. 107754/Z/15/Z) and the UK government. The views expressed in this publication are those of the authors and not necessarily those of the AAS, NEPAD Agency, Wellcome Trust or the UK government.

Author information

Affiliations

Authors

Contributions

JO, JJV and JL designed the research. JO compiled and analysed the data and wrote the first manuscript draft. JL, CJ, JT, RKW provided critical content analysis, helped draft and review the manuscript. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Joseph Ouma.

Ethics declarations

Ethics approval and consent to participate

Ethical clearance to conduct this study was obtained from the University of Witwatersrand Human Research Ethics Committee (HREC), clearance Certificate number M171053. Further clearance was obtained from the Uganda National Council for Science and Technology (UNCST) with registration number HS2366. Data for the study was obtained from surveys conducted in Uganda. The study was a secondary analysis of data and therefore consent to participate is not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Appendix 1.

Population survey and DHIS2 prevalence estimates. Appendix 2. HPE HIV prevalence estimates and associated 95% CI. Appendix 3. Comparison of district prevalence estimates for the HP and survey-based estimates. Appendix 4. Comparison of district prevalence estimates for the HPE and DHIS2-based estimates.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ouma, J., Jeffery, C., Valadez, J.J. et al. Combining national survey with facility-based HIV testing data to obtain more accurate estimate of HIV prevalence in districts in Uganda. BMC Public Health 20, 379 (2020). https://doi.org/10.1186/s12889-020-8436-z

Download citation

Keywords

  • Combining
  • Bias
  • Population survey
  • Health Information System
  • Hybrid Prevalence Estimate
  • District Health Information System