Effectiveness of control measures to prevent occupational tuberculosis infection in health care workers: a systematic review

Abstract

Background

A number of guideline documents have been published over the past decades on preventing occupational transmission of tuberculosis (TB) infection in health care workers (HCWs). However, direct evidence for the effectiveness of these controls is limited particularly in low-and middle-income (LMIC) countries. Thus, we sought to evaluate whether recommended administrative, environmental and personal protective measures are effective in preventing tuberculin skin test conversion among HCWs, and whether there has been recent research appropriate to LMIC needs.

Methods

Using inclusion criteria that included tuberculin skin test (TST) conversion as the outcome and longitudinal study design, we searched a number of electronic databases, complemented by hand-searching of reference lists and contacting experts. Reviewers independently selected studies, extracted data and assessed study quality using recommended criteria and overall evidence quality using GRADE criteria.

Results

Ten before-after studies were found, including two from upper middle income countries. All reported a decline in TST conversion frequency after the intervention. Among five studies that provided rates, the size of the decline varied, ranging from 35 to 100%. Since all were observational studies assessed as having high or unclear risk of bias on at least some criteria, the overall quality of evidence was rated as low using GRADE criteria.

Conclusion

We found consistent but low quality of evidence for the effectiveness of combined control measures in reducing TB infection transmission in HCWs in both high-income and upper-middle income country settings. However, research is needed in low-income high TB burden, including non-hospital, settings, and on contextual factors determining implementation of recommended control measures. Explicit attention to the reporting of methodological quality is recommended.

Trial registration

This systematic review was registered with PROSPERO in 2014 and its registration number is CRD42014009087.

Background

Reviews in the past decade have concluded that health care workers (HCWS) in most countries have a higher tuberculosis (TB) disease incidence than the general population [1, 2], and further that HCWs in low-and middle-income countries (LMICs) have a higher prevalence and incidence of latent TB infection than their counterparts in high-income countries [2,3,4]. This gap is consistent with the occurrence of 80% of the global burden of TB in 22 LMICs, where overcrowded and under-resourced health care facilities are important sites of TB transmission, including multi-drug resistant TB [4, 5].

Since 1982 the US Centers for Disease Control and Prevention (CDC), and later the World Health Organisation (WHO), have published a number of TB transmission control guidelines for health care settings [6,7,8,9,10]. These guidelines classified protective practices under the now well-established headings of administrative, environmental and personal levels of protection. A fourth overarching category, “managerial activities”, at both national level and facility level, was elaborated in the WHO 2009 guideline [9].

Implementation of these guidelines in combination is credited with the control of nosocomial outbreaks of TB and particularly multidrug resistant TB in high-income countries such as the US (described below) and Italy [11], as well as an outbreak of extremely drug resistant TB in South Africa [12]. However, questions about the practicality of these guidelines in low resource health care settings was expressed as early as 1997 [13] and given expression in a WHO 1999 guideline [7]. A 2006 review deemed the evidence for a reduction in the risk of TB transmission after implementation of these measures to be “limited and weak” in LMIC settings, in contrast with stronger evidence from high-income countries [1]. Of ten control measures reviewed in the WHO 2009 Guideline (pp. 23–33) [9], nine were judged as having “low quality” evidence, the exception being a package of HIV-testing, isoniazid preventive therapy and access to anti-retroviral treatment for HCWs, which was supported by “high quality” evidence.

The need to identify more appropriate protective practices, i.e. fewer and less resource demanding, but nevertheless effective in these settings, has thus been frequently identified [4, 7, 13,14,15]. A 2007 systematic review [2] concluded that there was “limited evidence based on uncontrolled observations…that administrative controls are the most important component.” More recently, Nardell and others have argued for a refocusing of clinical administrative measures, namely FAST (“Find cases Actively, Separate temporarily and Treat effectively”) in health care settings where undiagnosed tuberculosis is likely to be main source of nosocomial infection for both staff and patients [13, 16].

Given the passage of a decade and the evolution of the methods of systematic review, we sought to update the evidence on the effectiveness of measures to control TB transmission in health care settings from the 2006 [1] and 2007 [2] reviews. We aimed to sharpen our understanding of the quality of evidence by using up to date methods of systematic review, including a detailed assessment of the risk of bias and overall quality of evidence.

The question we asked was as follows. Do tuberculosis transmission prevention practices in the categories of administrative, environmental and/or respiratory protection, collectively or individually, reduce the transmission of tuberculosis infection to HCWs? We sought to limit heterogeneity by concentrating on studies which used tuberculin skin test (TST) conversion as the most direct outcome indicator of transmission. A particular interest was LMIC settings, but the review was not limited to such studies. We restricted the review to longitudinal studies able to compare the same setting before and after implementation of an intervention so as to establish temporality and limit confounding.

Methods

Search strategy and study design

We considered all studies, observational or experimental in design, comprising HCWs, among whom TST conversion rates in both the “before” and “after” phases of implementation of control measures in the same facility could be measured. HCWs include nurses, doctors, laboratory staff, allied professionals and support staff. Studies were sought which compared either a single preventive measure, or multiple measures at one or different levels, against controls. A control was defined as non-use, less complete or less frequent use of TB transmission prevention measures. We excluded workplace studies of the effectiveness of disease screening for TB, or of screening for and treatment of latent TB infection in preventing disease.

The electronic searches were conducted to the end of July 2017. We developed a search strategy comprising relevant medical subject headings (MeSH) and keywords relating to tuberculosis, HCWs, and tuberculosis control measures in Medline, shown in Appendix. The search strategy included a combination of the following keywords: TB, tuberculosis, mycobacterium, health personnel, hospital personnel, respiratory protective device, mass screening, education, triage, patient isolation, early diagnosis, risk assessment, guideline, policy and controlled environment.

We translated the Medline search strategy into Scopus, Trip, LILACS, Cochrane Central Register of Controlled Trials, World Health Organisation International Clinical Trials Registry Platform, and ClinicalTrials.gov, while making the necessary vocabulary adjustments. We placed no limitations on date or language. Both published and unpublished studies were considered. We looked over the reference lists of identified studies for additional studies. Authors and experts in the field were contacted for unpublished and published work. A manual internet search, using Google, was performed at the end of the systematic search to identify grey literature.

Data extraction and analysis

BS and ME verified whether the relevant articles met the inclusion criteria. This was checked by a third reviewer, RE, and any disagreements resolved through discussion. BS extracted relevant data items using a standardised form, which was checked by ME and RE.

Assessment of risk of bias and quality of evidence.

Risk of bias in the included studies was assessed using criteria from the Cochrane Effective Practice and Organisation of Care (EPOC) Group [17]. These criteria are designed to assess the risk of bias in research focused on the delivery, practice and organisation of health care services. The criteria are relevant to controlled trials and controlled before-after studies. The quality of the evidence was assessed using GRADE criteria [18].

Results

Study selection

Figure 1 shows a flow diagram of the search results. We screened 1573 references, i.e. titles and abstracts, from which 31 full text articles were deemed potentially eligible. We did not find non -English titles. After scrutiny of the full text, ten articles met our inclusion criteria. Of the 21 excluded articles, only eight [19,20,21,22,23,24,25,26] were studies of TST conversion or incident TB cases in a health care worker sample following transmission control measures. These eight excluded studies are listed in Table 1, with reasons for exclusion and findings. Three were from LMICs, namely Brazil, South Africa and Malawi. Malawi was the only study found from a low income country, but was not included in the review because it compared TB disease rates, rather than of TB infection, our primary outcome. This study found a slight but non-significant decrease in TB disease incidence after introduction, but incomplete implementation, of infection control guidelines.

Fig. 1

Selection of studies for review

Table 1 Excluded studies of tuberculin skin test (TST) conversion rates or TB disease in HCWs and TB transmission control measures (n = 8)

All ten included studies were observational [15, 27,28,29,30,31,32,33,34,35], comparing the risk of TST conversion among HCWs during periods before and after control measures were implemented. Descriptions of the included studies are presented in Table 2. The ten studies had sample sizes (before/after) ranging from 25/27 to 3579/5153 participants. Five of the studies [15, 31, 32, 34, 35] reported TST conversion rates (per person-time), of which two [15, 35] did not provide count data. The remaining five studies [27,28,29,30, 33] provided proportions of staff converting during the before and after stages. Only one study investigated the effect of a single level of intervention (engineering controls); control measures at more than one level were studied in the rest [33].

Table 2 TB transmission control measures and tuberculin skin test (TST) conversion: study details (n = 10)

Summary of results

Results are presented in Table 3. All the studies found a substantial decline in the rate of TB conversion per 100 person-years of observation or in the proportion of HCWs showing conversion. Among those which provided rates [15, 31, 32, 34, 35], the size of the reduction varied, with the smallest effect (comparing the last to the first period when there were multiple periods) being 35% [15]. In three of the five studies in which proportions were compared [28,29,30] the before and after periods differed in length [29, 30] or were not specified [28]. With this qualification, the proportion of staff converting in these studies was substantially lower in the after period, consistent with the rate reductions reported above. One study from the USA which provided counts [18] did not specify the before and after periods of observation; the reported conversion proportions fell from 24.1 to 0% and 12.2 to 3.3% in the two intervention hospitals.

Table 3 TB transmission control measures and tuberculin skin test (TST) conversion: Risk of bias assessment and results (n = 10)

Only two of the ten studies were conducted in LMICs [15, 35], Thailand and Brazil, which are classified as upper middle within this category, while the remaining eight were conducted in one high-income country, the USA [27,28,29,30,31,32,33,34]. The Thai study showed a reduction from 9.3 to 2.2 per 100 person-years [35]. It was also the only study among the ten to control confounding with multivariate analysis, which resulted in an even larger reduction. The Brazilian study [15] recorded a decline from 4.8 to 3.1 per 100 person-years. However, the TB incidence rate in HCWs almost doubled over the course of the study, despite the fall in incident TB infection rates [15].

Assessment of risk of bias

The risk of bias of the three studies with “control” participants [28, 29, 33] was assessed using all seven EPOC criteria as detailed in Table 3. Risk of bias was scored low for blinding/objective assessment of outcome and selective outcome reporting. There were large differences in the baseline outcome measure between the intervention and control groups in all three, reflecting different baseline facility TB exposure risks. In only one study [33] was the comparability of intervention and control groups clearly stated. The other two [28, 29] were classified as having high risk of confounding or selection bias.

Only the five criteria applicable to studies lacking control groups could be used to assess the risk of bias for the remaining seven studies [15, 27, 30,31,32, 34, 35] (Table 3). Uncontrolled studies are particularly vulnerable to confounding, i.e. a change in TB conversion rates over time due to factors unrelated to the control measures introduced, such as a decline in the case load of patients with tuberculosis seen at the facility. All seven were scored as having low risk of bias for blinding/objective assessment of outcome and selective outcome reporting, and six [15, 27, 30,31,32, 34] with high risk for selection and confounding bias. Only one study [35] adjusted for potential confounders of the difference between before and after intervention phases and could be scored as having low risk of confounding bias.

There were other sources of unmeasured variation. In only one study [32] was it reasonably clear that the same individuals were studied across the before and after periods. The remaining studies reported different numbers of participants (allowing for exclusion of baseline period converters) in the before and after periods, with no information about what proportion of individuals were the same at follow up. This may introduce potential confounding across periods if, for example, susceptibility to conversion is highest in the first year of exposure [35]. Finally, the method of conducting the TST varied across studies (and within some studies), with different tuberculin products and definitions of conversion and the use of a two-step test procedure in some but not others. These sources of variability may have introduced further heterogeneity between studies and even within some studies.

Quality of the evidence

There were a number of features of the evidence in favour of effectiveness: a) consistency of findings (b) large effect sizes (c) sustained decline in conversion in studies which included multiple “after” periods (Table 3) and (d) even greater risk reduction in the studies scored as low risk for confounding [35]. However, given that only observational studies were included in this review and the high or unclear risk of bias on at least some EPOC criteria in all ten studies, the overall quality of the studies reviewed was classified as “low” on GRADE criteria.

Discussion

Overall findings

There is consistent but low-quality evidence that combined control measures at the various levels in line with CDC recommendations are effective in preventing transmission of TB in HCWs. Eight of the ten studies were conducted in the USA, a low TB burden high-income country, in the 1990s in response to the rise of nosocomial TB and the appearance of multidrug resistant tuberculosis. All of these studies were conducted between 1989 and 1997 (Table 2).

Only two studies done in LMICs were found which met the inclusion criteria of the review - one in Thailand [35] and one in Brazil [15], both high TB burden, upper-middle-income countries. These showed a strong preventive effect of the intervention, no different from those in the high- income country studies. The Brazilian study of 2009 is the only study found from the last decade. Research on the effectiveness of TB control measures in high TB burden countries, many at lower resource levels than Thailand and Brazil, thus remains scarce, a conclusion unchanged over the course of a decade [1, 2].

Introduction of the CDC “package” of control measures was the norm. Only one study could be found which assessed the effectiveness of a single level of TB intervention, i.e. environmental, which was found to be protective [33]. In a number of the studies [27, 28, 30, 31] the authors suggested that administrative controls were primarily responsible for the decline in conversion risk, particularly as they were introduced earlier than other levels. Only one study [15] explicitly targeted administrative measures although in combination with personal respiratory protection. Only one study [29] explicitly listed all the elements that make up the current FAST package including drug sensitivity testing, although most of the studies included respiratory isolation as an administrative control with rapid diagnosis being part of a number of others (Table 2). All of the studies were conducted in hospitals, a bias which might be appropriate to the USA but not to LMICs, where district level services, including primary care facilities, are the first contact with patients and provide a large share of TB care [8].

Quality of review and of evidence

We aimed to minimise review bias by conducting comprehensive searches without date or language restrictions. In our protocol, we made provision for various study designs suitable for assessing the effect of TB control measures on risk of TB infection in HCWs. None of the studies found were randomised controlled trials, which is understandable given that randomisation of a hospital or wards is impractical, logistically challenging and/or costly. Thus, all included studies appeared to be “naturalistic” in that the research was conducted in parallel with operational implementation of TB interventions. Although five of the ten studies [15, 28,29,30, 34] made some reference to implementation, it was not possible to judge the degree of implementation. However, inadequate implementation would be more likely to produce negative studies than the consistently positive studies found. Unlike the previous reviews, we excluded cross-sectional studies comparing different facilities [25] because of the high risk of confounding, as well as efficacy studies in highly controlled settings, e.g. Dharmadhikari et al. [36], and modelling studies, e.g. Basu et al. [37].

Taking the EPOC criteria as our starting point, the risk of bias in almost all of the studies was assessed overall as high or at best unclear. We concluded with the GRADE definition of “low quality evidence”, namely, that “further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate” (Table 4).

Table 4 Summary of findings on the quality of evidence

Recommendations

There is a pressing need for further research on the prevention of transmission of TB infection in high TB burden low income settings, taking into account the evolution of thinking since the influential CDC 1994 guidelines, and specifically prioritisation of elements appropriate to the resources and capabilities of the health systems with high MDR TB and HIV burdens. Administrative measures such as FAST [16] are the current focus in this regard, particularly given the pressures for decentralised care to manage MDR TB [38]. Ventilation solutions appropriate to building design and climate in high patient throughput settings are also under-researched [39]. Research settings should include both hospitals and district or primary health care services as well as special locations such as laboratories. Missing from the literature are studies of “upstream” or health system factors which may determine the successful application of facility level control measures, such as political commitment, leadership, funding, or information systems [40].

To strengthen the quality and presentation of such research, studies with more explicit methodological quality than those reviewed are needed. Although randomised controlled trials are desirable for reducing selection bias and confounding, controlled before and after studies may have to be relied upon, but with greater attention to the comparability of before and after intervention groups, the time periods being compared and intervention and control groups where relevant. An alternative approach is the study of quality improvement interventions for intermediate processes, such as the steps that make up FAST [41]. However, ultimately the effectiveness in preventing TB infection in HCWS needs be tested directly [42]. The outcome indicator used in the current review, namely TST conversion, remains the most practical measure for studies in LMICs. There is as yet insufficient evidence of the reliability of repeated interferon gamma release assays as an indicator of interval infection in these settings [43]. Use of incident tuberculosis as the outcome is constrained by variability in susceptibility to progress to active disease, which might dilute a short-term association between transmission control measures and incident TB.

Assessment of bias should be explicit, using an accepted schema. However, even before-after studies are logistically demanding, requiring establishment of an accurate baseline rate of conversion, proper implementation of the intervention, and subsequent follow up periods of measurement. Sustained and accurate record-keeping [44], consistency of testing practice, assessment of co-intervention and confounding over this period all increase the resource and staffing requirements of such research.

Conclusion

This review has found very little progress over the past decade in updating the evidence, specifically in high TB burden low income settings, on the effectiveness of recommended practices to prevent nosocomial transmission of TB infection in health care workers. The reasons for this lack of progress were not investigated, but barriers are likely to include the many practical difficulties in conducting such research.

In the face of the continuing TB epidemic in many countries, such studies deserve a higher priority in funding programmes than has been the case over recent decades. Such funding should encourage research in a breadth of settings, inclusion of systems or contextual elements in the intervention, and management and reporting of quality issues inherent in different study designs.

Appendix

Table 5 Search strategy developed in PubMed database