This article has Open Peer Review reports available.
Risk factors for mortality in TB patients: a 10-year electronic record review in a South African province
© The Author(s). 2017
Received: 29 November 2015
Accepted: 20 December 2016
Published: 6 January 2017
Since 1990, reduction of tuberculosis (TB) mortality has been lower in South Africa than in other high-burden countries in Africa. This research investigated the influence of routinely captured demographic and clinical or programme variables on death in TB patients in the Free State Province.
A retrospective review of case information captured in the Electronic TB register (ETR.net) over the years 2003 to 2012 was conducted. Extracted data were subjected to descriptive and logistic regression analyses. The outcome variable was defined as all registered TB cases with ‘died’ as the recorded outcome. The variables associated with increased or decreased odds of dying in TB patients were established. The univariate and adjusted odds ratios (OR and AOR) together with their corresponding 95% confidence intervals (CI) were estimated, taking the clustering effect of the districts into account.
Of the 190,472 TB cases included in the analysis, 30,991 (16.3%) had ‘died’ as the recorded treatment outcome. The proportion of TB patients that died increased from 15.1% in 2003 to 17.8% in 2009, before declining to 15.4% in 2012. The odds of dying was incrementally higher in the older age groups: 8–17 years (AOR: 2.0; CI: 1.5–2.7), 18–49 years (AOR: 5.8; CI: 4.0–8.4), 50–64 years (AOR: 7.7; CI: 4.6–12.7), and ≥65 years (AOR: 14.4; CI: 10.3–20.2). Other factors associated with increased odds of mortality included: HIV co-infection (males – AOR: 2.4; CI: 2.1–2.8; females – AOR: 1.9; CI: 1.7–2.1) or unknown HIV status (males – AOR: 2.8; CI: 2.5–3.1; females – AOR: 2.4; CI: 2.2–2.6), having a negative (AOR: 1.4; CI: 1.3–1.6) or a missing (AOR: 2.1; CI: 1.4–3.2) pre-treatment sputum smear result, and being a retreatment case (AOR: 1.3; CI: 1.2–1.4).
Although mortality in TB patients in the Free State has been falling since 2009, it remained high at more than 15% in 2012. Appropriately targeted treatment and care for the identified high-risk groups could be considered.
Numbers of deaths and concomitant mortality rates represent traditional measures of the burden and impact of diseases and the state of public health . Tuberculosis (TB) ranks among the ten principal causes of death and disability worldwide . South Africa has one of the world’s most serious TB epidemics that in recent decades has been driven by the human immunodeficiency virus (HIV) epidemic . In 2015, among the 22 countries with the highest burden of TB, the country had the fourth highest estimated incidence of TB and the highest number of HIV-infected TB cases and deaths .
While South Africa has made notable progress in reducing TB prevalence and deaths and improving treatment outcomes for new smear-positive TB cases , overall reduction of TB mortality of only 6% over the years 1990 to 2013 is substandard considering that over the same period TB deaths declined by 45% globally and 40% in the African region . The World Health Organization’s (WHO) ‘End TB Strategy’ has set the target to reduce TB deaths by 95% by the year 2035. In order to reach this target, the proportion of people with TB who die from the disease should decline from a projected 15% in 2015 to 6.5% by 2025 .
TB and HIV control efforts in South Africa are mainly driven by the public health sector following a district-based primary health care (PHC) approach and provision of free treatment and care services. Located in the centre of South Africa bordering on Lesotho, the Free State has an estimated population of 2.8 million . TB was the leading underlying cause of death in the province in 2013 . In 2012, of the nine provinces it reported the fifth highest TB incidence at 709 cases per 100,000 population, the second highest TB death rate at 142 cases per 100,000 population, and the third highest prevalence of antenatal HIV infection at 32.1% .
Understanding the factors leading to death following TB diagnosis is important for prognostic purposes, but also for programme planning and appropriate targeting of care to high-risk groups. The study set out to establish the influence of routinely captured demographic and clinical or programme variables on mortality in TB patients in the Free State over the years, 2003–2012.
Setting and design
A retrospective record review of individual case information captured in the Electronic TB register (ETR.net) was conducted. Based on the WHO and International Union Against Tuberculosis and Lung Disease (IUTLD) format of recording and reporting, the electronic format of TB case information collection and collation is widely recognised as a valuable tool to gather and analyse TB and TB-HIV surveillance data in order to monitor and evaluate programme performance. The ETR.net was implemented in South Africa in 2003. In the Free State, TB case information is processed as follows: firstly, at the primary healthcare facility level, data are recorded in a paper-based treatment register; secondly, at the subdistrict level, captured on the ETR.net; and, finally, at the provincial level, aggregated for the province as a whole .
Population, data management and measurements
Risk factors for death in TB patients
N = 30 991 n (%)
Univariate results OR (95% CI)
Full adjusted model – died and default/LTFU AOR (95% CI)
Full adjusted model – died only AOR (95% CI)
Males AOR (95% CI)
Females AOR (95% CI)
13 834 (44.64)
17 157 (55.30)
23 266 (75.07)
5 094 (16.44)
1 216 (3.92)
1 787 (5.77)
10 748 (34.68)
18 456 (59.55)
Pre-treatment sputum smear result
Smear + (Ref)
12 047 (38.87)
7 375 (23.80)
11 569 (37.33)
24 587 (79.34)
6 404 (20.66)
23 210 (74.89)
7 005 (22.60)
≤14 days (Ref)
12 820 (41.37)
3 244 (10.47)
14 927 (48.17)
HIV status x gendera
Male x HIV positive
Male x HIV unknown
Two demographic variables were included in the analysis: 1) age (≤7 or 8–17 or 18–49 or 50–64 or ≥65 years) and 2) gender (male or female). Five clinical or programme variables that were significantly related to the study outcome in univariate analysis were included in the multivariate models: 1) HIV status (negative or positive or unknown), 2) pre-treatment sputum smear result (positive or negative or no result), 3) treatment category (new or retreatment), 4) disease classification (pulmonary TB [PTB] or extrapulmonary [EPTB] or both), and 5) treatment delay (≤14 days or >14 days after notification).
All data were analysed using STATA 12 . Percentage was used to describe the mortality trend over the study period. Association between the independent variables and treatment outcome was established using the Pearson’s χ 2 test. Logistic regression analysis was conducted to ascertain factors associated with death in TB patients taking into account the clustering effect of the districts. The univariate and multivariate adjusted odds ratios (OR and AOR) together with their corresponding 95% confidence intervals (CI) were estimated. The assumed significance level was 0.05. During the development of the adjusted model an assessment was carried out to determine if gender was significantly involved in interactions with any of the other independent variables. There was a significant interaction between gender and HIV status which was taken into consideration in presenting results for the adjusted model (Table 1).
Ethical clearance was granted by the Ethics Committee of the Faculty of Health Sciences, University of the Free State (ECUFS 186/2014). Given that the case information was aggregated and anonymised at the provincial level before analysis, a waiver for individual patient consent was granted.
A total of 190,472 cases were included in the study with 16.3% recorded as ‘died’ (Fig. 1). Mortality among TB patients increased from 15.1% in 2003 to 17.8% in 2009 before declining to 15.4% in 2012 (Fig. 2).
Table 1 depicts the demographic and clinical or programme risk factors for death in TB patients.
More than half (55.3%) of the patients who died were males. Gender was not independently associated with mortality (OR: 1.0; CI: 0.9–1.2), however, after adjusting for other variables in the model, the risk of dying among males was significantly lower compared to females (AOR: 0.8; CI: 0.7–0.9). The large majority (n = 23,266; 75.1%) of TB patients that died were aged 18–49 years. Advancing age was independently associated with death in TB patients and the strength of this association increased after adjusting for other variables in the model. Compared to those in the 0–7 years age group, the odds of death increased from 2.0 (CI: 1.5–2.7) in the 8–17 year old group to 14.4 (CI: 10.3–20.2) in the ≥65 year old group. Table 1 shows that the odds of mortality was higher for males compared to females in the age group 18–49 years – males (AOR: 6.4; CI: 4.5–9.0) and females (AOR: 5.3; CI: 3.6–7.9) and in the age group 50–64 years – males (AOR: 9.0; CI: 6.0–13.4) and females (AOR: 6.8; CI: 3.9–12.1). The odds of death was higher for females (AOR: 14.4: CI 9.9–21.0) in the age group >65 years than for males (AOR: 13.8: CI 10.1–18.9).
Clinical or programme variables
HIV co-infection (OR: 2.2; CI: 2.0–2.5) and unknown HIV status (OR: 2.8; CI: 2.6–3.0) were independently associated with increased likelihood of death while on TB treatment. HIV status significantly interacted with gender and stratified results indicate that the risk of death was higher among both male (AOR: 2.4; CI: 2.1–2.8) and female (AOR: 1.9; CI: 1.7–2.1) HIV-infected cases compared to their respective HIV-uninfected counterparts. Likewise, both male (AOR: 2.8; CI: 2.5–3.1) and female (AOR: 2.4; CI: 2.2–2.6) TB cases with unknown HIV status had higher risk of dying compared to their HIV-uninfected counterparts. Having a negative (AOR: 1.4; CI: 1.3–1.6) or a missing (AOR: 2.1; CI: 1.4–3.2) pre-treatment sputum smear result was significantly associated with increased risk for death in univariate analysis, with the risk increasing after controlling for other factors included in the model. Patients categorised as retreatment cases had significantly higher risk of death in univariate analysis (OR: 1.4; CI: 1.3–1.5) and only slightly lesser so in multivariate analysis (AOR: 1.3; CI: 1.2–1.4). Independently, EPTB disease classification (OR: 0.8; CI: 0.6–0.9), as compared to having both PTB and EPTB, was significantly protective against death, but the association became insignificant after adjusting for other factors in the model.
The record review in the Free State showed that mortality in TB patients increased from 15.1% in 2003 to 17.8% in 2009, before declining to 15.4% in 2012, thus a net 10-year increase of 0.3%. The steady rise in mortality in TB patients over the years 2003 to 2009 is variously attributed to migration  and high levels of HIV co-infected multidrug-resistant TB . The marked decline in the mortality trend after 2009 can possibly be attributed to the progressive evolving of clinical eligibility requirements for HIV co-infected TB cases to access antiretroviral treatment (ART) , as well as heightened political attention and international support and civil society mobilisation around TB and HIV, including the launch of a national HIV/TB campaign in 2011 [4, 18].
The record review in the Free State showed that TB cases in older age groups had significantly increased odds of death. Among the variables included in the unadjusted and adjusted regression models, advancing age was the strongest risk factor for mortality in TB patients. Compared to cases aged 0–7 years, risk for death was incrementally higher in each older age group. The greatest proportion of deaths occurred among those aged 18–49 years. This corresponds to research in Limpopo  and Western Cape  (South Africa) that associated higher mortality in TB patients with advancing age. An international study observed that although TB age distributions in Africa have been severely skewed by the HIV epidemic, disease burdens among older people are increasing . According to this study, older adults are more likely to develop extrapulmonary and atypical forms of TB that are often hard to diagnose. Older patients’ treatment and care is also complicated by more frequent drug-related adverse events and increased co-morbidity.
When adjusting for other factors, male gender was significantly protective against death in TB patients in the current study. This corresponds with the findings of research in Western Cape that associated female gender with increased risk of death in HIV-infected TB cases . The WHO reports that although globally the numbers of HIV-associated TB deaths were similar among men and women in 2011, more deaths were estimated to have occurred among women than men in the African region, whilst in other regions more deaths were estimated to have occurred in men . The same source states that TB in pregnant women living with HIV increases the risk of maternal mortality by almost 300% and that in Africa TB rates are about ten times higher among pregnant women living with HIV than in their HIV uninfected counterparts. A systematic review of qualitative studies to identify gender-related barriers in accessing TB diagnostic and treatment services showed that women experience financial dependence, lower general literacy and household stigma as barriers .
After advancing age, being co-infected with HIV or having unknown HIV status was the strongest risk factor for increased mortality in TB patients. However, for the period under study, 2003 to 2012, the HIV status of the majority (59.6%) of cases that died while on TB treatment was unknown. Since integrated TB-HIV data gathering in the ETR.net in the Free State started only in 2009, it was not possible to measure the effect of ART and varying CD4 count levels on mortality in TB cases for the whole study period. Recent research in Swaziland revealed that high mortality in TB-HIV patients has persisted despite increasing ART coverage in TB patients . A separate study is in process to measure the effect of ART in TB-HIV co-infected cases in the Free State for the years 2009 to 2012.
Not having a pre-treatment sputum smear result was the third strongest risk factor for death in TB patients. In KwaZulu-Natal (South Africa), research found that over one-third of registered TB cases could not be confirmed based on laboratory results . Many cases did not have a laboratory record, lending to uncertainty about the validity of the smear results and treatment outcomes recorded in the ETR.net.
Having a negative pre-treatment sputum smear result was the fourth strongest risk factor for death in TB patients. Research in Malawi  and Zimbabwe  established that smear-negative PTB patients presenting with signs of concurrent HIV infection were at particularly high risk of death. A systematic review has explained that in regions of high HIV prevalence poor outcomes of smear-negative TB is a feature of advancing immunosuppression and therefore higher risk of death from other AIDS-related disease when compared to the more robust immunological profile in patients with smear-positive TB .
Being a retreatment case was the fifth strongest risk factor for dying while on TB treatment. This is corroborated by similar research findings related to patients with previous episodes of TB in Limpopo (South Africa) , Uganda  and Malaysia . In 2014, 6.7% of retreatment as opposed to 1.8% of new cases in South Africa had multidrug-resistant TB . During most of the study period, 2003–2012, culture was the main tool for drug-susceptibility testing which implied a need for trained personnel and expensive laboratory equipment and long lengths of time to receive results while in the interim patients were commonly commenced on drug-sensitive TB regimens. The number of Xpert MTB/RIF tests that were conducted in the province has since increased from 1,199 in 2012 to 6,734 in 2013 and 8,062 in 2014 . Expansion of the use of Xpert MTB/RIF is expected to have a substantial overall TB mortality reduction effect in Africa if wide population coverage can be achieved . Further research may be necessary to understand its influence on the outcomes of retreatment cases specifically. Xpert MTB/RIF is also an effective method to diagnose smear-negative TB .
Most surveillance and notification systems are affected by a degree of underestimation and therefore uncertainty surrounds the 'true’ incidence of disease affecting morbidity and mortality rates . Electronic reviews are also limited in the range of variables that can be included for purposes of explaining risk for mortality among TB patients. The register reflects only all-cause mortality; it does not specify whether the death was actually TB-related. Another limitation of study is that since integrated TB-HIV data gathering in the ETR.net in the Free State started only in 2009, it was not possible to measure the protective effect of HIV-related clinical interventions in TB-HIV co-infected patients for the study period, 2003–2012.
Although the mortality among TB patients decreased over the years 2009–2012, it remained high at more than 15%. The factors increasing the odds of death in TB patients included advancing age, female gender, HIV co-infection or unknown HIV status, having a negative or a missing pre-treatment sputum smear result, and being a retreatment patient. Appropriate targeting of care to these high-risk groups could be considered.
The authors thank the Free State Department of Health for authorising the research.
Availability of data and material
The data that support the findings of this study are available from Free State Department of Health but restrictions apply to the availability of these data, which were used were permission of Free State Department of Health for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of Free State Department of Health.
JCH drafted the initial and revised subsequent manuscripts. NGK contributed the initial idea and input towards revision of the drafts of the article. PC conducted data analysis and contributed to interpretation of the findings. SB managed computerisation of data and contributed to the analysis. HCJvR participated in the initial design, analysis and revision of the manuscript. All authors read and approved the final manuscript.
JCH, NGK and HCJvR declare they have no competing interests. PC and SB were provincial health managers at the time of the study.
Consent for publication
Ethics approval and consent to participate
The study was approved by and a waiver of individual consent granted by the Ethics Committee of the Faculty of Health Sciences, University of the Free State (ECUFS NR 186/2014).
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Thacker SB, Stroup DF, Carande-Kulis V, Marks JS, Roy K, Gerberding JL. Measuring the public’s health. Public Health Rep. 2006;121:14–22.PubMedPubMed CentralGoogle Scholar
- Korenromp EL, Bierrenbach AL, Williams BG, Dye C. The measurement and estimation of tuberculosis mortality. Int J Tuberc Lung Dis. 2009;13:283–303.PubMedGoogle Scholar
- Chaisson RE, Martinson NA. Tuberculosis in Africa – Combating an HIV-driven crisis. N Eng J Med. 2008;358(11):1089–92.View ArticleGoogle Scholar
- World Health Organization. Global Tuberculosis Report 2015. Geneva: WHO; 2015.Google Scholar
- Churchyard GJ, Mametja LD, Mvusi L, Ndjeka N, Hesseling AC, Reid A, et al. Tuberculosis control in South Africa: successes, challenges and recommendations. S Afr Med J. 2014;104:244–8.View ArticlePubMedGoogle Scholar
- World Health Organization. Global Tuberculosis Report 2014. Geneva: WHO; 2014.Google Scholar
- World Health Organization. The End TB Strategy. http://www.who.int/tb/strategy/End_TB_Strategy.pdf?ua=1 (2015). Accessed 29 Jun 2015.
- Statistics South Africa. Mid-year population estimates 2015, Statistical release P0302. Pretoria: Stats SA; 2016.Google Scholar
- Statistics South Africa. Mortality and causes of death in South Africa 2011, Findings from death notification. Statistical release P0309.3. Pretoria: Stats SA; 2014.Google Scholar
- Day C, Gay A. Health and related indicators. In: Padarath A, English R, editors. South African Health Review 2013/14. Durban: Health Systems Trust; 2014. p. 201–346.Google Scholar
- Heunis C, Wouters E, Kigozi G, Engelbrecht M, Tsibolane Y, van der Merwe S, et al. Accuracy of tuberculosis routine data and nurses’ views of the TB-HIV information system in the Free State, South Africa. J Assoc Nurses AIDS Care. 2009;22:67–73.View ArticleGoogle Scholar
- Marcy O, Laureillard D, Madec Y, Chan S, Mayaud C, Borand L, et al. Causes and determinants of mortality in HIV-infected adults with tuberculosis: an analysis from the CAMELIA ANRS 1295-CIPRA KH001 Randomized Trial. Clin Infect Dis. 2014;59(3):435–45.View ArticlePubMedPubMed CentralGoogle Scholar
- Van Cutsem G, Ford N, Hildebrand K, Goemaere E, Mathee S, Abrahams M, et al. Correcting for mortality among patients lost to follow up on antiretroviral therapy in South Africa: a cohort analysis. PLoS ONE. 2011;6(2):e14684.View ArticlePubMedPubMed CentralGoogle Scholar
- StataCorp. Stata: Release 12. Statistical Software. College Station, TX: StataCorp; 2011.Google Scholar
- Bocquier P, Collinson M, Clark S, Gerritsen A, Kahn K, TollMan S. Ubiquitous burden: the contribution of migration to AIDS and tuberculosis mortality in rural South Africa. African Population Studies. 2014;28(1) Suppl on Population Issues in South Africa:691–701.Google Scholar
- Manda SOM, Masenyetse LJ, Lancaster JL, van der Walt ML. Risk of death among HIV co-infected multidrug resistant tuberculosis patients, compared to mortality in the general population of South Africa. J AIDS Clinic Res. 2003;3:7.Google Scholar
- Fox MP, Sannec IM, Conradie F, Zeinecker J, Orrell C, Ive P. Initiating patients on antiretroviral therapy at CD4 cell counts above 200 cells/μl is associated with improved treatment outcomes in South Africa. AIDS. 2010;24:2041–50.View ArticlePubMedPubMed CentralGoogle Scholar
- US President's Emergency Plan for AIDS Relief. Partnership to Fight HIV/AIDS in South Africa: PEPFAR in Free State. 2014. http://photos.state.gov/libraries/southafrica/917455/nevhulaudzirk/FS%20Fact%20Sheet_Jan2014.pdf. Accessed 23 Dec 2016.
- Mabunda TE, Ramalivhana NJ, Dambisya YM. Mortality associated with tuberculosis/HIV co-infection among patients on TB treatment in the Limpopo province, South Africa. Afr Health Sci. 2014;14:849–54.View ArticlePubMedPubMed CentralGoogle Scholar
- Pepper DJ, Schomaker M, Wilkinson RJ, de Azevedo V, Maartens G. Independent predictors of tuberculosis in a high HIV prevalence setting: a retrospective cohort study. AIDS Res Ther. 2015;12:35.View ArticlePubMedPubMed CentralGoogle Scholar
- Negin J, Abimbola S, Marais BJ. Tuberculosis among older adults – time to take notice. Int J Infect Dis. 2015;32:135–7.View ArticlePubMedGoogle Scholar
- World Health Organization. Tuberculosis in women. http://www.who.int/tb/publications/tb_women_factsheet_251013.pdf (2015). Accessed 21 Jun 2016.
- Krishnan L, Akande T, Shankar AV, McIntyre KN, Gounder CR, Yang W-T. Gender-related barriers and delays in accessing tuberculosis diagnostic and treatment services: a systematic review of qualitative studies. Tuber Res Treat. 2014;2014:215059.Google Scholar
- Mchunu G, van Griensven J, Hinderaker SG, Kizito W, Sikhondze W, Manzi M, et al. High mortality in tuberculosis patients despite HIV interventions in Swaziland. Public Health Action. 2016;6(2):105–10.View ArticlePubMedPubMed CentralGoogle Scholar
- Dilraj A, Bristow CC, Connolly C, Margot B, Dlamini S, Podewils LJ. Validation of sputum smear results in the Electronic TB Register for the management of tuberculosis, South Africa. Int J Tuberc Lung Dis. 2013;17:1317–21.View ArticlePubMedPubMed CentralGoogle Scholar
- Hargreaves NJ, Kadzakumanja O, Whitty CJM, Salaniponi FML, Harries AD, Squire SB. ‘Smear-negative’ pulmonary tuberculosis in a DOTS programme: poor outcomes in an area of high HIV seroprevalence. Int J Tuberc Lung Dis. 2001;5(9):847–54.PubMedGoogle Scholar
- MacPherson P, Dimairo M, Bandason T, Zezai A, Munyati SS, Butterworth AE, et al. Risk factors for mortality in smear-negative tuberculosis suspects: a cohort study in Harare, Zimbabwe. Int J Lung Tuberc Dis. 2011;15(10):1390–96.View ArticleGoogle Scholar
- Waitt CJ, Squire SB. A systematic review of risk factors for death in adults during and after tuberculosis treatment. Int J Tuberc Lung Dis. 2011;15(7):871–85.View ArticlePubMedGoogle Scholar
- Acuña-Villaorduña C, Ayakaka I, Dryden-Peterson S, Nakubulwa S, Worodria W, Reilly N, et al. High mortality associated with retreatment of tuberculosis in a clinic in Kampala, Uganda: A retrospective study. Am J Trop Med Hyg. 2015;93(1):73–5.View ArticlePubMedPubMed CentralGoogle Scholar
- Liew SM, Khoo EM, Ho BK, Lee YK, Mimi O, Fazlina MY, et al. Tuberculosis in Malaysia: predictors of treatment outcomes in a national registry. Int J Tuberc Lung Dis. 2015;19(7):764–71.View ArticlePubMedGoogle Scholar
- National Health Laboratory Service. Implementation of GeneXpert in South Africa. Update June 2014. http://www.health-e.org.za/wp-content/uploads/2014/06/NHLS-GeneXpert-update-June-2014.pdf (2014). Accessed 19 Jul 2015.
- Dowdy DW, Davis JL, den Boon S, Walter ND, Katamba A, Cattamanchi A. Population-level impact of same-day microscopy and Xpert MTB/RIF for tuberculosis diagnosis in Africa. PLoS ONE. 2013;8:e70485.View ArticlePubMedPubMed CentralGoogle Scholar
- Van Rie A, Page-Shipp L, Hanrahan CF, Schnippel K, Dansey H, Bassett J, et al. Point-of-care Xpert® MTB/RIF for smear-negative tuberculosis suspects at a primary care clinic in South Africa. Int J Tuberc Lung Dis. 2013;17(3):368–72.View ArticlePubMedPubMed CentralGoogle Scholar
- Gibbons CL, Mangen MJ, Plass D, Havelaar AH, Brooke RJ, Kramarz P, et al. Measuring underreporting and under-ascertainment in infectious disease datasets: a comparison of methods. BMC Public Health. 2014;14:147.View ArticlePubMedPubMed CentralGoogle Scholar