Skip to main content
Download PDF

How to establishing an indicators framework for evaluating the performances in primary TB control institutions under the new TB control model? Based on a Delphi study conducted in Guangxi, China

BMC Public Health volume 22, Article number: 2431 (2022) Cite this article

Abstract

Background

In China, the new TB control model of trinity form had been implemented in all parts, and the comprehensively evaluation to the performances in primary TB control institutions were closely related to the working capacity and quality of TB service, but there was still no an unified evaluation indicators framework in practice and few relevant studies. The purpose of this study was to establish an indicators framework for comprehensively evaluating the performances in primary TB control institutions under the new TB control model of trinity form in Guangxi, China.

Methods

The Delphi method was used to establish an indicators framework for comprehensively evaluating the performances in primary TB control institutions under the new TB control model of trinity form, and the analytic hierarchy process(AHP) was used to determine the weights of all levels of indicators, from September 2021 to December 2021 in Guangxi, China.

Results

A total of 14 experts who had at least 10 years working experience and engaged in TB prevention and control and public health management from health committee, CDC, TB designated hospitals and university of Guangxi were consulted in two rounds. The average age of the experts were (43.3 ± 7.549) years old, and the effective recovery rate of the questionnaire was 100.0%. The average value of authority coefficient of experts (Cr) in the two rounds of consultation was above 0.800. The Kendall’s harmony coefficient (W) of experts’ opinions on the first-level indicators, the second-level indicators and the third-level indicators were 0.786, 0.201 and 0.169, respectively, which were statistically significant (P < 0.05). Finally, an indicators framework was established, which included 2 first-level indicators, 10 second-level indicators and 37 third-level indicators. The results of analytic hierarchy process (AHP) showed that the consistency test of all levels of indicators were CI < 0.10, which indicating that the weight of each indicator was acceptable.

Conclusion

The indicators framework established in this study was in line with the reality, had reasonable weights, and could provide a scientific evaluation tool for comprehensively evaluating the performances in primary TB control institutions under the new TB control model of trinity form in Guangxi, China.

Peer Review reports

Introduction

Tuberculosis (TB) was a major public health problem in the world [1, 2]. In order to deal with the challenge of TB, governments of all countries had established TB control model in line with their national conditions, and actively carried out actions around the work objectives of each stage to achieve the goal of “End TB”. China was one of the 30 countries with high TB burden in the world, and the situation of TB control was severe. Implementing anti-TB institutions cooperation was the basic strategy for TB control in China. Since 2010, the new TB control model of trinity form had been implemented gradually in all regions [3]. In the new TB control model, the Centers for Disease Control and Prevention (CDC) was responsible for planning and management, the designated hospitals was responsible for diagnosis and treatment of patients, and the primary health care institutions was responsible for tracking and management of patients, that combine into the trinity form of “the anti-TB institutions cooperation which responsible for TB prevention, treatment and management together”. See the Fig. 1. The new TB control model of trinity form was expanded from the previously model that TB control being undertook by CDC alone. Under the new TB control model, the primary TB control institutions (including CDC in county-level and the designated hospitals in county-level and the primary health care institutions) undertook specific work that discovery, report, diagnosis, treatment and management of TB patients, and played an important role. The work in the primary TB control institutions involved multiple departments and interests, and was an organic whole. So the comprehensive evaluation should be carried out based on an indicators framework, in order to improve the working capacity of the primary TB control institutions. Especially after the COVID-19 pandemic [4,5,6], it was of great practical significance to carry out comprehensive evaluation of the performances in primary TB control institutions in the process of restoring the service supply of TB control and accelerating to realization the global goal of “End TB”. However, there was no an unified indicators framework for carrying out the comprehensively evaluation to the performances in primary TB control institutions, and there were few relevant studies in China.

Therefore, in this study, Delphi method and analytic Hierarchy Process (AHP) were used to establish an indicators framework for comprehensively evaluating the performances in primary TB control institutions under the new TB control model of trinity form, in order to provide theoretical and evidence-based basis for carrying out the comprehensive and effective evaluation of TB control in various in Guangxi and the other regions of China.

Fig. 1
figure 1

The new TB control model of trinity form in Guangxi, China

Full size image

Materials and methods

Study site

The Guangxi Zhuang Autonomous Region (Guangxi), with a population of 50 million, was an underdeveloped southwestern region where the TB epidemic was relatively serious in China [7,8,9]. At present, the new TB control model of trinity form had been implemented in all areas of the region in Guangxi. Previous studies had shown that there were many problems and difficulties in TB control of Guangxi, such as insufficient financial investment, weak ability in primary TB control institutions, common delay in treatment of patients, heavy disease economic burden and so on. After the impact of the epidemic of COVID-19, TB control would face more severe challenges. There was an urgent need to comprehensively evaluate the performance in primary TB control institutions based on a scientific indicators framework, so as to provide reference for the continuous improvement the quality of TB control. Our study was conducted in Guangxi with the period from September 2021 to December 2021.

Selection of experts

Using objective sampling method, 14 experts who had at least 10 years working experience and engaged in TB prevention and control and public health management were selected from health committee, CDC, TB designated hospitals and university of Guangxi, China.

Establishing of the initial indicators framework

Taking “tuberculosis (TB)”, “indicators framework”, “evaluation” as the key word, the relevant literature were searched online in PubMed, Embase, Cochrane Lirary databases, China national knowledge infrastructure(CNKI), Wanfang Database and so on. The relevant policy and regulation and reports from the year 2011 to 2021 were consulted on the official websites of national and local health commissions and CDC. And then, an initial indicators framework including 2 first-level indicators,10 second-level indicators and 69 third-level indicators were established after discussing by the research group.

Screening indicators by Delphi method

Delphi method, also known as expert survey method, was initiated and implemented by the RAND Corporation in 1946 [10, 11]. Later, the method was widely used in business, military, education, health care and other fields, and showed its superiority and applicability in the process of use [12]. The Delphi method was essentially a feedback anonymous letter inquiry method. Its general process was: after obtaining the opinions of experts on the problem to be predicted, the result would be sorted out, summarized and made statistics, and then gave anonymous feedback to the experts, asked for opinions again, concentrated and gave feedback again, until a consensus was got. Delphi method had three characteristics, that were anonymity, multiple feedback, group statistical response [10,11,12,13]. The characteristics of Delphi method made it the most effective judgment and prediction method, and the results were widely representative and reliable.

Two rounds of questionnaires consultation through email were carried out in the study. In the first round of consultation, the contents of the questionnaire included: the purpose of consultation, the basic information of the experts, the explanation of the indicators, and the opinion column for the modification or deletion were setting to collect the opinions from the experts. The second round of consultation was designed basing on the statistical summary of the first round of consultation results. After two rounds of consultation, the consensus was got in this study.

Quantitative assignment of options

The degree of importance, degree of familiarity and judgment basis of indicators were quantitative assignment separately by the following standards. ① Degree of importance: “Unimportant” was set as 1, “not too important” as 2, “moderately important” as 3, “Relatively important” as 4, and “Very important” as 5. ② Degree of familiarity: “unfamiliar” was set as 0.2, “not very familiar” as 0.6, “relatively familiar” as 0.8, and “very familiar” as 1.③ Judgment basis: it was divided into “theoretical analysis”, “practical experience”, “reference to domestic and foreign materials” and “intuition” according to the conventional; and the degree of influence for those above were divided into large, medium and small, respectively, and being given different quantitative values. See the Table 1.

Table 1 Quantitative assignment of the judgment basis and the degree of influence
Full size table

Evaluation parameters of the results

There were four parameters. ①Coefficient of active participation of experts: it was expressed by the recovery rate of questionnaire to evaluate the experts’ concern for the study. ②Authority coefficient of experts(Cr) : it was calculated according to the score of expert’s judgment (Ca) and the score of expert’s familiarity (Cs) to evaluate the value of experts’ advice, the calculation formula was Cr=(Ca + Cs)/2. ③Degree of concentration of experts’ opinions: It was expressed by the mean of quantitative assignment of the degree of importance and the full score ratio to evaluate the importance of indicators. ④Degree of coordination of experts’ opinions: It was expressed by the coefficient of variation (CV) and Kendall’s harmony coefficient (W) to evaluate the consistency of experts’ opinions.

Selection criteria of indicators

Three criteria were formulated for selecting indicators.①The mean of importance was above 4.30; ②The authority coefficient was above 0.800; ③The coefficient of variation(CV) was less than 0.200; Besides, it was combined with the expert’s opinion and the working practice at the same time, then to determine the choice of indicators.

Data analysis

The software Microsoft Excel was used to input data of consultation, and the software IBM SPSS Statistics for Windows, Version 25.0 was used to conduct statistical analysis on the results, the methods including descriptive statistic and Kendall’s W test, etc. A p-value < 0.05 was considered significant. The software Yaahp10.3 was used for Analytic Hierarchy Process (AHP), the processes including drawing the hierarchical structure model diagram, determining the scale of Saaty according to the mean of importance of indicators in the second round results, establishing a judgment matrix, using group decision-making, conducting consistency test, and finally determining the combination weights of indicators at all levels.

Results

Basic information of experts

A total of 14 experts were included in this study, with an average age of (43.3 ± 7.549) years old, the distribution of gender, organization, professional title, and degree of education of experts were showed in the Table 2.

Table 2 Basic information of experts (n = 14)
Full size table

Coefficient of active participation of experts

In each round of consultation, 14 questionnaires were distributed and 14 valid questionnaires were recovered, with the effective rate of 100.0% in both rounds.

Authority coefficient of experts (cr)

The results of the first round of consultation showed that the values of Cr of the 2 first-level indicators were 0.921 and 0.904, respectively; the values of Cr among 10 s-level indicators range from 0.803 to 0.914, with an average value of (0.877 ± 0.034); the values of Cr among 69 indicators of third-level range from 0.796 to 0.907, with an average of(0.848 ± 0.285); The results of the second round of consultation showed that the values of Cr among 39 indicators of third-level range from 0.802 to 0.900, with an average value of (0.860 ± 0.244).

Degree of concentration of experts’ opinions

The results of the first round of consultation showed that the mean of importance of the 2 first-level indicators were 5.00 and 4.21, the standard deviation were 0.000 and 0.426, and the full score ratio were 100.0% and 21.4%, respectively; The mean of importance among 10 s-level indicators range from 4.29 to 5.00, the standard deviation was 0.000 to 0.726, and the full score ratio was 42.9–100.0%; The mean of importance among 69 indicators of third-level range from 3.86 to 4.93, the standard deviation was 0.267 to 1.167, and the full score ratio was 21.4–92.9%, and the mean of importance among 23 indicators were less than 4.30. The results of the second round of consultation showed that the mean of importance among 39 indicators of third-level range from 3.93 to 5.00, the standard deviation was 0.000 to 1.072, and the full score ratio was 35.7–100.0%, and the mean of importance among 3 indicators were less than 4.30.

Degree of coordination of experts’ opinions

The results of the first round of consultation showed that the coefficient variation (CV) of the 2 first-level indicators were 0.000 and 0.101, respectively, and Kendall’s harmony coefficient (W) was 0.786 (x2 = 11.000, P = 0.001); The variable coefficient (CV) among 10 s-level indicators range from 0.000 to 0.169, Kendall’s harmony coefficient (W) was 0.201 (x2 = 25.323, P = 0.003); The variable coefficient (CV) among 69 indicators of third-level range from 0.054 to 0.303, Kendall’s harmony coefficient (W) was 0.161 (x2 = 152.869, P = 0.000), and the value of CV among 30 indicators were above 0.200. The results of the second round of consultation show that the variable coefficient (CV) among 39 indicators of third-level range from 0.000 to 0.273, Kendall’s harmony coefficient (W) is 0.169 (x2 = 89.928, P = 0.000), and the value of CV among 2 indicators were above 0.200.

Results of selection of indicators

According to the selection criterion of indicators which had been formulated, after the consultation of the first round, there are 30 third-level indicators were deleted; After the consultation of the second round, there were 2 third-level indicators are deleted; At last, an indicators framework was established, which included 2 first-level indicators, 10 second-level indicators and 37 third-level indicators. See the Table 3.

Result of weights of indicators

The results of analytic hierarchy process(AHP) showed that the consistency test of all levels of indicators are CI < 0.10, which indicating that the weight of each indicator was acceptable. The weights of the first-level indicators were the combined weights. But the weights of second-level and third-level indicators were the relative weights. The calculation formula for the combined weight of the second-level and third-level indicators were: the combined weight of the second-level indicator = the combined weight of the first-level indicator *the relative weight of second-level indicator; The combined weight of the third-level indicator = the combined weight of the second-level indicator *the relative weights of third-level indicator. See the Table 3.

Table 3 The importance and the weights of indicators at all levels in the framework for comprehensively evaluating the performances in primary TB control institutions
Full size table

Discussion

Delphi method was a mature and easy subjective decision-making technology after years of development. It was widely used in the field of medical and health services. In the process of establishing the indicators framework, this method could synthesize the theory and practical experience of experts from different professional backgrounds to make comprehensive judgement and evaluation [10,11,12,13]. This study was based on the existing research theories and methods [14,15,16,17,18]. Firstly, the initial indicators framework was established based on literature review, which had a good theoretical basis. Then, 14 experts were invited to take part in Delphi expert consultation, experts come from different organizations such as health committee, CDC, TB designated hospitals and universities in Guangxi, who engaged in TB control and public health management, with bachelor’s degree or above, and 78.6% of who had deputy senior professional titles or above, which showed that the experts had good representation and abundant professional knowledge, practical skills or management experience. In the two rounds of consultation, the coefficient of active participation of experts was 100.0%, which indicating that the enthusiasm of experts to participate in this study was high. The authority coefficient of experts (Cr) showed the experts’ theoretical understanding and practical experience about the indicators, and it was generally considered that when the value of Cr was equal to or above 0.7 was accepted. In this study, the average value of Cr in the two rounds of consultation was above 0.8, which showed that the opinion of experts had a good guidance for establishing the indicators framework. After each round of consultation, indicators were screened according to the selection criteria of indicators which had been formulated before, and the opinions of experts were summarized and feedback. Finally, after two rounds of consultation, the experts’ opinions tended to be consistent and meet the requirements of Delphi method, and the indicators framework was established, which included 2 first-level indicators, 10 second-level indicators and 37 third-level indicators, and could reasonably reflect the core contents and performances of TB control at primary TB control institutions.

Analytic hierarchy process (AHP) was a qualitative and quantitative, systematic and hierarchical analysis method, which was widely used in sociological, economics, management, engineering and other fields [19,20,21,22]. The indicators framework for comprehensively evaluating the performances in primary TB control institutions being established in this study was a multi-level and multi-indicators composite system, and the importance of each level and indicator needs to be determined scientifically. Using AHP method to determine the weights of indicator was to comprehensively calculate the weight coefficient of indicator by comparing the relative importance of each indicator at the same level, and the reliability and validity of the weights of indicators being determined were ensured by checking the consistency of the judgment matrix. In this study, the result of AHP was based on the score of the importance of indicators and the group decision of experts, which had good rationality and differentiation.

The indicators framework for comprehensively evaluating the performances in primary TB control institutions in this study took into account both objective performances and subjective effects, and covered all aspects of the work, which fully reflected the characteristics and focused of the new TB control model of trinity form.

From the view of the contents covered by the indicators, the objective performances included: discovery, report, registration, treatment and management of patients, and health education, quality control, training and coordination, a total of 8 aspects, that fully reflected the work flow of the new TB control model of trinity form. Among them, discovery and treatment of patients contain more third-level indicators, there were 7 third-level indicators and 6 third-level indicators, respectively, those were the focus works of the primary TB control institutions. It was in line with the basic TB control strategy in China, that was to discovery and treatment of patients timely, to control the source of infection, and to reduce the spread of TB in the population [23]. These two aspects were also the focus of study on TB control performance, which were used to evaluate the achievement of the objectives of national TB control plan [24,25,26,27]. Quality control was very important for TB control, which contained 9 third-level indicators, the content involved laboratory internal quality control, diagnosis and treatment process, infection control and adverse drug reactions reporting, and it could comprehensively evaluate the overall quality and ability of TB control. The subjective effects included: the satisfaction rate of medical staff and patients, each aspect containing a third-level indicator. Those two aspects were used to evaluate the satisfaction about the treatment of work for medical staff and the costs of treatment for patients. It was in line with the current situation of the two major challenges that insufficient human resources and heavy disease economic burden of patients, which were the mainly limitations to the performance of the primary TB control institution in Guangxi and the other regions of China [28].

From the view of the feasibility of indicators, each indicator had a clear definition and data sources, the data sources of objective performances came from National TB Management Information System and the daily work record for TB control; the data of subjective effect could be obtained by questionnaire survey in practical work.

From the view of the weights of indicators, among the first-level indicators, the objective performances had a high weight of 0.5444, which indicating that evaluating the specific tasks achievement was the main point of the performance evaluation. Among the second-level indicators, in the aspect of objective performances, indicators with the weights ranked in the top three were discovery, treatment and management of patients, that the combined weights were 0.0743, 0.0732, 0.0679 in turn; In the aspect of subjective effects, the weight of the satisfaction of the patients was higher of 0.2284, which indicated the concept of the patient-centered in the work of primary TB control institutions [29]. Among the third-level indicators, indicators with the highest weight in each aspect were as follows respectively: examination rate of sputum smear, timely reporting rate, registration rate of therapy, receiving rate of treatment, rate of regular medication, completion rate of health education, qualified rate of sputum smear, completion rate of training tasks; satisfaction rate of medical staff about the treatment of work; and satisfaction rate of patients about the costs of treatment, those indicators indicated the top priority of work, and had a great significance for effectively evaluating the performance of TB control in primary TB control institutions.

Prospects for the next work

The reliability and operability of the indicators framework for comprehensively evaluating the performances in primary TB control institutions in this study needed to be tested through empirical research. Therefore, the next work was to apply the indicators framework to the TB work practice in Guangxi, test the reliability and validity of the indicators framework, and continuously improve based on the needs and development of practice, so as to ensure the objectivity, authenticity and accuracy of the indicators.

Conclusion

In summary, this study focused on the performance of primary TB control institutions, following the scientific, comprehensive and practical principles, based on a large number of literature and policy guidelines at home and abroad, and an indicators framework fit for primary TB control institutions was established, which can provide a scientific and reasonable evaluation tool for comprehensively evaluating the performance of primary TB control institutions under the new TB control model of trinity form in Guangxi. In addition, our study conducted consultation with experts in Guangxi, so the results maybe more suitable for the work practice in Guangxi, and could also provide reference for the other regions in China.

Availability of data and materials

The datasets generated and/or analyzed in the current study are not publicly available, due to the personal privacy of the consulting experts, such as their names, identification numbers, work addresses and so on, but are available from the corresponding author on reasonable request.

References

  1. World Health Organization. Global Tuberculosis Report 2021[R]. Geneva: World Health Organization; 2021. Licence: CC BY-NC-SA 3.0 IGO.

    Google Scholar 

  2. World Health Organization. Global Tuberculosis Report 2020[R]. Geneva: World Health Organization; 2020. Licence: CC BY-NC-SA 3.0 IGO.

    Google Scholar 

  3. Du X, Li T, Liu X, et al. Health facilities and treatment service models of the National Tuberculosis Program - China, 2010–2020. China CDC Weekly. 2021;3(13):274–8.

    Article  Google Scholar 

  4. Hogan AB, Jewell BL, Sherrard-Smith E, et al. Potential impact of the COVID-19 pandemic on HIV, tuberculosis, and malaria in low-income and middle-income countries: a modelling study. Lancet Glob Health. 2020;8(9):e1132-41.

    Article  Google Scholar 

  5. Chen H, Zhang K. Insight into the impact of the COVID-19 epidemic on tuberculosis burden in China. Eur Respir J. 2020,56(3):2002710. https://doi.org/10.1183/13993003.02710-2020.

  6. Sahu S, Ditiu L, Sachdeva KS, et al. Recovering from the impact of the Covid-19 pandemic and accelerating to achieving the United Nations General Assembly tuberculosis Targets. Int J Infect Dis. 2021;113(Suppl 1):100–3.

    Article  Google Scholar 

  7. Lin D, Wang J, Cui Z, et al. A genome epidemiological study of mycobacterium tuberculosis in subpopulations with high and low incidence rate in Guangxi, South China. BMC Infect Dis. 2021;21(1):840.

    Article  Google Scholar 

  8. Lin D, Cui Z, Chongsuvivatwong V, et al. The geno-spatio analysis of Mycobacterium tuberculosis complex in hot and cold spots of Guangxi, China. BMC Infect Dis. 2020;20(1):462.

    Article  CAS  Google Scholar 

  9. Cui Z, Lin D, Chongsuvivatwong V, et al. Spatiotemporal patterns and ecological factors of tuberculosis notification: a spatial panel data analysis in Guangxi, China. PLoS One. 2019;14(5):e212051.

    Article  Google Scholar 

  10. Nasa P, Jain R, Juneja D. Delphi methodology in healthcare research: how to decide its appropriateness. World J Methodol. 2021;11(4):116–29.

    Article  Google Scholar 

  11. Niederberger M, Koberich S. Coming to consensus: the Delphi technique. Eur J Cardiovasc Nurs. 2021;20(7):692–5.

    Article  Google Scholar 

  12. Niederberger M, Spranger J. Delphi technique in Health Sciences: a Map. Front Public Health. 2020;8:457.

    Article  Google Scholar 

  13. Howarth E, Vainre M, Humphrey A, et al. Delphi study to identify key features of community-based child and adolescent mental health services in the East of England. BMJ Open. 2019;9(6):e22936.

    Article  Google Scholar 

  14. Fan Y, Zhang S, Li Y, et al. Development and psychometric testing of the knowledge, Attitudes and Practices (KAP) questionnaire among student tuberculosis (TB) patients (STBP-KAPQ) in China. BMC Infect Dis. 2018;18(1):213.

    Article  Google Scholar 

  15. Zhang S, Li X, Zhang T, et al. Framework for Establishment of a comprehensive and standardized Administration System for Prevention and Control of Tuberculosis in College Student Community in China. Iran J Public Health. 2016;45(10):1300–8.

    Google Scholar 

  16. Li Y, Ehiri J, Hu D, et al. Framework of behavioral indicators evaluating TB health promotion outcomes: a modified Delphi study of TB policymakers and health workers. Infect Dis Poverty. 2015;4:56.

    Article  Google Scholar 

  17. Li Y, Ehiri J, Hu D, et al. Framework of behavioral indicators for outcome evaluation of TB health promotion: a Delphi study of TB suspects and tb patients. BMC Infect Dis. 2014;14:268.

    Article  Google Scholar 

  18. Hou YC, Wang M, Li XQ, et al. [Construction of surveillance and early-warning-index-system on tuberculosis in China]. Zhonghua Liu Xing Bing Xue Za Zhi. 2012;33(5):505–8.

    Google Scholar 

  19. Gao Z, Jiang Y, He J, Wu J, Xu J, Christakos G. An AHP-based regional COVID-19 vulnerability model and its application in China. Model Earth Syst Environ. 2022;8(2):2525–38. https://doi.org/10.1007/s40808-021-01244-y. Epub 2021 Jul 28.

  20. Leal JE. AHP-express: a simplified version of the analytical hierarchy process method. MethodsX. 2020;7:100748.

    Article  Google Scholar 

  21. Hashemian M, Ghardashi F, Izadi AR, et al. Prioritizing the health education needs based on community participation: AHP method. J Educ Health Promot. 2019;8:127.

    Google Scholar 

  22. Lee CW, Li C. The process of constructing a Health Tourism Destination Index. Int J Environ Res Public Health, 2019,16(22).

  23. Zhao Y, Liu J. Facing the challenge of tuberculosis: towards “End TB in China by 2035“. China CDC Wkly. 2021;3(12):243–6.

    Article  Google Scholar 

  24. Chowdhury AS, Ahmed MS, Ahmed S, et al. Estimating catastrophic costs due to pulmonary tuberculosis in Bangladesh. J Epidemiol Glob Health. 2021;11(1):83–91.

    Article  Google Scholar 

  25. Velleca M, Malekinejad M, Miller C, et al. The yield of tuberculosis contact investigation in low- and middle-income settings: a systematic review and meta-analysis. BMC Infect Dis. 2021;21(1):1011.

    Article  Google Scholar 

  26. Min J, Kim HW, Ko Y, et al. Tuberculosis surveillance and monitoring under the National Public-Private Mix Tuberculosis Control Project in South Korea 2016–2017. Tuberc Respir Dis (Seoul). 2020;83(3):218–27.

    Article  Google Scholar 

  27. Ogbuabor DC, Onwujekwe OE. Governance of tuberculosis control programme in Nigeria[J]. Infect Dis Poverty. 2019;8(1):45.

    Article  Google Scholar 

  28. Haldane V, Zhang Z, Ma Q, et al. A qualitative study of perspectives on access to tuberculosis health services in Xigaze, China. Infect Dis Poverty. 2021;10(1):120.

    Article  Google Scholar 

  29. Reid M, Goosby E. Improving quality is necessary to building a TB-free world: Lancet Commission on Tuberculosis. J Clin Tuberc Other Mycobact Dis. 2020;19:100156.

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank all the experts who participated in the consultation for their responses to the questionnaire, and the supporter: Foundation of Guangxi Health and Economic and Social Development Research Center, China (Project No. :2021RWB04).

Funding

This study was funded by Foundation of Guangxi Health and Economic and Social Development Research Center, China (Project No. :2021RWB04).

Author information

Authors and Affiliations

  1. Department of Health Service Management, School of Information and Management, Guangxi Medical University, Nanning, China

    Tengyan Wu, Huimin He, Pinghua Zhu, Qiming Feng & Zhong Tang

  2. Editorial Board of Chinese Journal of New Clinical Medicine, The People’s Hospital of Guangxi Zhuang Autonomous Region, Nanning, China

    Suosu Wei

Authors
  1. Tengyan Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Huimin He
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Suosu Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pinghua Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Qiming Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Zhong Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Tengyan Wu, Suosu Wei, Zhong Tang wrote the main manuscript text; Tengyan Wu, Huimin He, Zhong Tang manage the project; Tengyan Wu, Pinghua Zhu, Qiming Feng prepared figures and tables; All authors reviewed the manuscript.

Corresponding authors

Correspondence to Tengyan Wu or Zhong Tang.

Ethics declarations

Ethics approval and consent to participate

The ethical approval was provided by the Research Ethics Board of Health (REBH), Guangxi Medical University, China. Informed written consent was requested and obtained from each participant. All operating procedures follow the Declaration of Helsinki (Ethical Principles for Medical Research Involving Human Subjects, 2008, World Medical Association) and the relevant laws and regulations of China. However, this study did not involve human experimentation and/or use of human tissue samples. Besides, in this study, data were collected through questionnaire survey, and Delphi method and analytic hierarchy process(AHP) were carried out in accordance with relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table S1.

The initial indicators framework.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, T., He, H., Wei, S. et al. How to establishing an indicators framework for evaluating the performances in primary TB control institutions under the new TB control model? Based on a Delphi study conducted in Guangxi, China. BMC Public Health 22, 2431 (2022). https://doi.org/10.1186/s12889-022-14865-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-022-14865-4

BMC Public Health

ISSN: 1471-2458

Contact us