Skip to main content

Timeliness of national notifiable diseases surveillance system in Korea: a cross-sectional study



With the increase of international travels, infectious disease control is gaining a greater importance across regional borders. Adequate surveillance system function is crucial to prevent a global spread of infectious disease at the earliest stage. There have been limited reports on the characteristics of infectious disease surveillance in Asia. The authors studied the timeliness of the Korean National Notifiable Disease Surveillance System with regard to major notifiable diseases from 2001 to 2006.


Six notifiable infectious diseases reported relatively frequently were included in this study. Five diseases were selected by the criteria of reported cases > 100 per year: typhoid fever, shigellosis, mumps, scrub typhus, and hemorrhagic fever with renal syndrome. In addition, dengue fever was also included to represent an emerging disease, despite its low number of cases. The diseases were compared for the proportion notified within the recommended time limits, median time lags, and for the cumulative distribution of time lags at each surveillance step between symptom onset and date of notification to the Korea Centers for Disease Control and Prevention (KCDC).


The proportion of cases reported in time was lower for disease groups with a recommended time limit of 1 day compared with 7 days (60%–70% vs. > 80%). The median time from disease onset to notification to KCDC ranged between 6 and 20 days. The median time from onset to registration at the local level ranged between 2 and 15 days. Distribution of time lags showed that main delays arose in the time from onset to diagnosis. There were variations in timeliness by disease categories and surveillance steps.


Time from disease onset to diagnosis generally contributed most to the delay in reporting. It is needed to promote public education and to improve clinical guidelines. Rapid reporting by doctors should be encouraged, and unification of recommended reporting time limit can be helpful. Our study also demonstrates the utility of the overall assessment of time-lag distributions for disease-specific strategies to improve surveillance.

Peer Review reports


Effective public health services for the control and prevention of infectious diseases involve surveillance as a critical element [1]. The aim of infectious diseases surveillance is to initiate public health action in response to changes in the incidence of the disease [2]. The World Health Organization (WHO) has proposed two key functions of any surveillance system: early detection of potential public health threats, and monitoring of programs specific to single or multiple diseases [3]. In most countries, notifiable diseases are designated so that regular, frequent, and timely information can be generated by surveillance systems [4, 5].

Timeliness is determined by the interval between any two steps within a surveillance system. Timeliness is a key measure of any surveillance system and should be assessed regularly [68]. It is a key element that is associated with the system's ability to take appropriate action on public health problems, based on the urgency and the type of responses needed [2]. Many studies have assessed the timeliness of surveillance systems by evaluating the time lag or bottleneck phenomenon of each surveillance step [2, 811], comparing clinical and laboratory surveillance [12, 13], and comparing electronic and conventional (paper-based) methods [10, 14, 15]. Recently, the WHO introduced guidelines for evaluating and monitoring surveillance systems. According to these guidelines, timeliness should be evaluated for specific surveillance steps for each disease and should be fully assessed from the time of infection to central reporting [3]. The conceptual framework provided by the WHO is useful to evaluate surveillance systems in many contexts.

In Korea, the Contagious Diseases Prevention Law was first enacted in year 1954 and laid the foundation of the National Notifiable Disease Surveillance System (NNDSS), by designating 20 notifiable infectious diseases for mandatory reporting. A major revision of this law in 2000 provided the current structure of the NNDSS, which collects individual patient information using an electronic reporting system. As of Aug, 2008, this system covers 50 infectious diseases.

NNDSS classifies infectious diseases into four groups: Group I for those requiring immediate control measures – 6 diseases (for example, cholera, plague, shigellosis); Group II for vaccine-preventable diseases – 9 diseases (for example, measles, mumps, rubella); Group III for diseases that need routine monitoring – 16 diseases (for example, tuberculosis, scrub typhus, malaria); and Group IV for emerging diseases in Korea – 19 diseases (for example, dengue fever, q fever, avian influenza infection in humans). The Korean NNDSS is organized at three levels: local, provincial, and central. At the local level, doctors report to the Public Health Center (PHC) when they diagnose a notifiable disease. Control measures, including epidemiological investigation and epidemic prevention, are conducted at this level by the PHC. At the provincial level, the PHC reports the cases to the Department of Health (DOH) of the province or metropolitan city. The DOH is obliged to control epidemics that may spread beyond a local district. The DOH reports the cases to the Korea Centers for Disease Control and Prevention (KCDC). The KCDC carries out control for multi-provincial outbreaks and assesses disease trends for monitoring and planned government action.

The magnitude and distribution of infectious diseases varies by region, and each country needs its own surveillance system and strategies for its particular situation. Although many studies of surveillance systems have been carried out to date, those in Asia have been rare. The new electronic data collection system of the Korean NNDSS provides a good opportunity to assess surveillance function. Therefore, our aim was to identify the timeliness of notifiable infectious disease surveillance in Korea.


Data collection

We used an anonymized database derived from NNDSS collected by the KCDC from 2001 to 2006. Five diseases were selected for this study that were reported in more than 100 cases every year for 2001–2006; typhoid fever, shigellosis, mumps, scrub typhus, and hemorrhagic fever with renal syndrome (HFRS). Reported in fewer numbers, dengue fever was also included to compare its differences with other disease groups. Despite having reports of more than 100 cases every year, tuberculosis and malaria were not selected because of insufficient information. Tuberculosis had been traditionally managed at the PHC by a different system, which did not include complete data on dates after physicians' notification step. Malaria cases included approximately 20% of the reports from military personnels covered by a separate reporting system within the military, and the information was not comparable for the current analysis. The six selected diseases represented four disease groups: Group I (typhoid fever and shigellosis), Group II (mumps), Group III (scrub typhus, HFRS), and Group IV (dengue fever).

Definition of time lags

Time points recorded in the surveillance data include dates of onset, diagnosis, doctor's notification to the PHC, PHC reporting to the DOH, and DOH reporting to the KCDC. Using these dates, we defined the time lags in days for each interval between the steps as T1 to T4, respectively. Additionally, the time to registration (TR) was defined as the delay from symptom onset to the doctor's notification to the local PHC. This time lag indicates the delay until the first recognition by the public health system that enables control action to be initiated. The time to central appraisal (TC) was defined as the delay from symptom onset to the notification received at the central level (KCDC). Central appraisal is a critical step that involves epidemiological verification of the reported data, statistical analysis, and interpretation. This step provides the basis for any central public health action nationwide. The recommended limits for each time lag are specified by the Contagious Diseases Prevention Law, according to the disease groups (Figure 1).

Figure 1

Time points for NNDSS and recommended time limits for six selected diseases. DOH, Department of Health (at the provincial level); KCDC, Korea Centers for Disease Control and Prevention (at the central level); PHC, Public Health Centers (at the local level).

Statistical Analysis

We analyzed the timeliness between the surveillance steps by calculating: (i) the proportion of cases reported within the recommended time limits; (ii) median time lags between the steps for each disease; and (iii) the cumulative distribution of time lags for diseases at each step. For time limits recommended as "immediately," an operational definition of 1 day was used for the timeliness criterion. Chi-square tests were performed to compare proportions of cases reported by the given time limit. Two-sample Kolmogorov-Smirnov (K-S) tests were used to compare cumulative distributions of time lags between diseases [16]. Analyses were performed using SAS version 9 (SAS Institute, Cary, NC) and Microsoft Office Excel 2003.


Proportion of cases reported in time

For the six notifiable diseases examined, a total of 40,760 records were identified (Table 1). Scrub typhus comprised the largest number of cases (57.9%), followed by mumps (23.5%) and shigellosis (9.5%). The proportion of cases reported within the recommended time limit was calculated for T2 to T4. Generally, the time limit of 1 day was associated with a low proportion of cases reported in time, mostly ranging between 60% and 70%, compared to the 7-day limit, which had > 80% reporting in time. However, there was variation among the diseases for specific time lags. For example, doctors' timely reporting to the PHC was highest for shigellosis (85.3%) and lowest for dengue fever (60.2%) (p < 0.0001), although the limits were both 1 day. When the intervals of T2 to T4 were combined, the diseases in Group I and IV (diseases of immediate concern) had even lower proportions reported in time compared to the other groups (p < 0.0001). Approximately 35% of dengue fever cases were reported in time to the KCDC, whereas ≥ 90% of the diseases in Group II and III were reported in time. Comparison of proportions reported in time may not be appropriate between the disease groups with different recommended limits. Therefore, actual distribution of time lags was used for detailed comparison by disease groups.

Table 1 Number of notified cases and proportion (%) notified within the recommended time limits of law

Median time lag

Median time lags are shown in Figure 2. The TC and TR were shortest for mumps (6 and 2 days, respectively), followed by shigellosis (9 and 6 days, respectively). It is noteworthy that most time lags arose from a delay in diagnosis, especially for typhoid fever (T1, 10 days), dengue fever (T1, 10 days), and shigellosis (T1, 5 days). In contrast, T1 was just 1 day for mumps. Lags in the notification steps (T2 to T4) were generally longer for scrub typhus, and HFRS. Dengue fever showed longer delays in T1 and T3.

Figure 2

Median time lags between the time points of surveillance. DOH, Department of Health (at the provincial level); HFRS, Hemorrhagic fever with renal syndrome; KCDC, Korea Centers for Disease Control and Prevention (at the central level); PHC, Public Health Centers (at the local level). See Figure 1 for definitions of T2, T3, and T4.

Cumulative distribution of time lags

Figure 3 compares the distribution of respective time lags among the diseases. Time lags for HFRS are not shown because their patterns were very similar to those of scrub typhus. The graph not only provides information on the median time lag by which 50% of the cases are reported for a specific disease, but also presents the overall shape of the time lag distribution. The higher curve indicates generally shorter time lags than those for lower curves. For example, TC curves show that at 10 days from the onset, more than 75% of mumps cases are notified to KCDC whereas approximately 50% of shigellosis and 25% of typhoid fever cases are notified, respectively. Comparing the cumulative distribution curves is much more informative than comparing fewer parameters such as median or mean, or proportions notified by given times. This is particularly true when the curves cross each other as shown by TC curves for typhoid and scrub typhus. Although the medians were the same with 15 days, the shapes of the distribution were significantly different from each other (p < 0.0001); Fewer typhoid fever cases were reported by 30 days than were scrub typhus cases.

Figure 3

Cumulative distribution of time lags by disease. DOH, Department of Health (at the provincial level); KCDC, Korea Centers for Disease Control and Prevention (at the central level); PHC, Public Health Centers (at the local level).

Relatively large variation among diseases is apparent in both TC and TR; mumps (Group II) with the shortest and dengue fever (Group IV) with the longest time lags (p < 0.0001). This variation is largely due to a delay in diagnosis (T1) because these two diseases showed smaller difference in the other graphs. Shigellosis and typhoid fever, both in Group I, had relatively shorter time lags in the notification steps (T2 to T4). For these diseases, T1 appeared to be the critical step that contributed to the delay in TC and TR. However, there was a clear delay in doctors' reporting (T2) of typhoid fever compared to that of shigellosis. Doctors' notification of mumps to the PHC (T2) also appeared to involve a delay, with a curve almost overlapping with that for typhoid fever (p = 0.23), despite the fact that mumps had a very short time lag to diagnosis (T1). Scrub typhus (Group III) had a much shorter T1 than did typhoid fever. However, the difference became smaller for TC because it took a longer time for scrub typhus to be reported in the intermediate steps (T2 and T3). Dengue fever that represents Group IV showed the longest delay in TC and TR, primarily due to delays in both steps of diagnosis (T1) and doctor's report (T2).


We investigated the timeliness in different steps of surveillance for six relatively frequent notifiable infectious diseases in Korea. Typhoid fever and shigellosis had major delays in the time to diagnosis. In addition, typhoid fever had a longer time lag than did shigellosis in doctors' notification to the PHC. Mumps was relatively quickly diagnosed, but there was a delay in reporting by doctors. Scrub typhus, and HFRS had relatively greater time lags in reporting, partly because of the longer time limits that are recommended by Korean law.

Generally, we found shorter time lags compared to previous reports for these diseases. For shigellosis, we found a median TC of 9 days, whereas the TC ranged from 15 to 23 days in previous studies [2, 8, 10]. For typhoid fever, the median TR was 11 days, in comparison with approximately 22 days in a previous study in England [11].

Electronic reporting systems can be an important means to enhance timeliness, as previously suggested [10, 15]. Our results showed generally shorter time lags than those of the previous studies using data from conventional systems. We used data collected by an electronic reporting system that was established in 2000, which would have contributed to the better timeliness compared to earlier data.

The level of timeliness varied according to the disease and surveillance step, with the total time lag from onset to central reporting ranging from 6 to 20 days. Previous studies have also described such differences according to diseases and surveillance steps [2, 9, 11, 17]. For this reason, notification processes of infectious diseases cannot be assessed as a whole, but require analysis for separate clinical entities [9].

One of the main reasons for the variation in reporting among different diseases is the clinical characteristics of the diseases such as mode of onset and severity [15]. If the symptoms begin abruptly and progress severely, patients visit the doctor more quickly and diagnostic confirmation is faster. This probably explains the quicker reporting of mumps and shigellosis than the other diseases examined. In other studies, meningococcal infection and salmonellosis had shorter time lags than did tularemia or hepatitis A for the same reason [2, 15]. Difficulty in diagnosis tends to delay the reporting of diseases by doctors because they need to balance the costs of false positives and delayed reporting. The necessity for time-consuming laboratory tests for diagnosis may also delay reporting.

Epidemiological characteristics such as incidence may affect timeliness in reporting, which can be facilitated by familiarity with the disease in the population. For example, measles is more common and thus more quickly reported than malaria in England [11]. Occurrence of an epidemic is likely to have similar effects. In fact, notifications of shigellosis in this study included 1,076 cases identified by KCDC as part of several different epidemics. Although in-depth analyses of these cases are beyond the scope of the current paper, the median TC and TR of the epidemic cases were shorter (8 and 5 days, respectively) compared to those of the other 2,801 non-epidemic cases (9 and 6 days, respectively).

The different patterns of time lags among the diseases examined suggest that there are common features among the disease groups, and strategies for better control should be developed specifically for each disease group. Such patterns by disease groups arise largely from the commonality of clinical and epidemiological nature, and the characteristics of surveillance policy as in Korea. Typhoid fever and shigellosis (Group I) had relatively long time lags to diagnosis, with a median of 10 and 5 days, respectively. It should be noted that these water- or food-borne diseases may result in secondary infection within this time period, causing a large epidemic. Previous studies of surveillance have tended to pay most attention to the time lags in reporting after physicians' diagnosis. However, the delay in diagnosis is also important because it may allow widespread transmission and lead to large epidemics.

Mumps (Group II) had the shortest time lag at every step. Its course is generally not severe and is self-limited. However, mumps is a common childhood viral disease that can induce outbreaks. Our results suggested some delay in physicians' notification of mumps to the PHC. This step needs attention and more investigation to improve the timeliness.

Scrub typhus and HFRS (Group III) seemed relatively limited in timeliness. These are among the most frequently reported infectious diseases in Korea. They are vector-borne diseases that mostly occur in autumn, especially in elderly people who are engaged in farming. Although the clinical course is not extremely severe and treatment is usually effective, early intervention is important to reduce morbidity and mortality, especially for vulnerable elderly groups. Measures such as intensive education and public health campaigns are needed for residents and physicians in high-risk areas and seasons. Moreover, the lenient 7-day time limit of reporting under the current law may cause unnecessary delay, and tightening of the limit should be considered.

Finally, dengue fever (Group IV) showed long delays in TC and TR. Dengue fever is not endemic in Korea and all cases are imported, as most diseases in Group IV. Because of its unfamiliarity, both diagnosis (T1) and doctor's report (T2) seem to be delayed. With recent increase in the number of imported cases, education for travellers and their physicians should be emphasized.

We used a conceptual framework for the surveillance system that involved two key parameters: TC and TR. Our approach was a simplification of the standard conceptual framework proposed by the WHO [3]. In our view, TC and TR capture the most critical aspects of surveillance function that enable responses to epidemics at central and local levels, respectively. These two key parameters were subdivided into the more detailed steps of T1 to T4 to identify the sources of delay and strategies to improve the system. It is also very important to examine the whole distribution of these time-lag parameters, rather than only a few statistics such as medians or means. The entire shape of the cumulative distribution may provide important information about the differences among diseases and specific surveillance steps.

Our study has some limitations. First, the disease-specific completeness of the Korean surveillance system ranges from 40% (HFRS) to 80% (shigellosis), which is comparable to those in other countries [1]. The unreported cases may have different characteristics from the reported cases. Therefore, had they been reported, their time lags might not have followed the same distributions. Although further investigation is needed, any improvement strategy for the current surveillance system would have to depend on the reported cases.

Second, laboratory confirmation is expected to vary according to the disease. The Korean surveillance system depends on the physicians' clinical diagnosis, regardless of laboratory confirmation. This is because the surveillance system aims at detecting all clinically relevant cases, so that transmission prior to laboratory confirmation is minimized. The diagnosis of mumps is typically made without laboratory tests. In contrast, the diagnosis of typhoid fever and shigellosis depends more on laboratory tests. Unfortunately, detailed information on the laboratory tests was not available for this study, and we were not able to stratify the analyses by the laboratory results. Further study is needed to assess how the laboratory confirmation process influences the timeliness of diagnosis or reporting by doctors.


The infectious disease surveillance system in Korea generally functions well in terms of timeliness, although there are variations according to the disease and surveillance step. Three main approaches may improve the timeliness of the system overall. First, the main delays arise from time lags in the diagnosis, and these need to be improved by promoting public education and improving clinical guidelines. Second, more rapid reporting by doctors to PHCs should be encouraged. Third, the unification of recommended time limit as 1 day for all diseases will be helpful to provide simpler guidelines that can prevent needless time delay for reporting.

Methodologically, the assessment of the cumulative distribution of time lags at each step provides important information for evaluating the surveillance system and developing strategies for improvement.



the World Health Organization


the National Notifiable Disease Surveillance System


Public Health Center


Department of Health


Korea Centers for Disease Control and Prevention


Hemorrhagic Fever with Renal Syndrome.


  1. 1.

    Doyle TJ, Glynn MK, Groseclose SL: Completeness of notifiable infectious disease reporting in the United States: an analytical literature review. Am J Epidemiol. 2002, 155 (9): 866-74. 10.1093/aje/155.9.866.

    Article  PubMed  Google Scholar 

  2. 2.

    Birkhead G, Chorba TL, Root S, Klaucke DN, Gibbs NJ: Timeliness of national reporting of communicable diseases: the experience of the National Electronic Telecommunications System for Surveillance. Am J Public Health. 1991, 81 (10): 1313-5. 10.2105/AJPH.81.10.1313.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  3. 3.

    World Health Organization: Communicable disease surveillance and response systems. Guide to monitoring and evaluating. 2006, World Health Organization, []

    Google Scholar 

  4. 4.

    Centers for Disease Control and Prevention: Progress in improving state and local disease surveillance – United States, 2000–2005. MMWR Morb Mortal Wkly Rep. 2005, 54 (33): 822-5.

    Google Scholar 

  5. 5.

    McNabb SJ, Jajosky RA, Hall-Baker PA, Adams DA, Sharp P, Anderson WJ, Javier AJ, Jones GJ, Nitschke DA, Worshams CA, Richard RA, Centers for Disease Control and Prevention (CDC): Summary of notifiable diseases – United States, 2005. MMWR Morb Mortal Wkly Rep. 2007, 54 (53): 1-92.

    PubMed  Google Scholar 

  6. 6.

    Teutsch SM, Churchill RE: Principles and practice of public health surveillance. 2000, New York, Oxford University Press, 2

    Google Scholar 

  7. 7.

    German RR, Lee LM, Horan JM, Milstein RL, Pertowski CA, Waller MN: Updated guidelines for evaluating public health surveillance systems: recommendations from the Guidelines Working Group. MMWR Recomm Rep. 2001, 50 (RR-13): 1-35.

    CAS  PubMed  Google Scholar 

  8. 8.

    Jajosky RA, Groseclose SL: Evaluation of reporting timeliness of public health surveillance systems for infectious diseases. BMC Public Health. 2004, 4: 29-10.1186/1471-2458-4-29.

    Article  PubMed  PubMed Central  Google Scholar 

  9. 9.

    Dominguez A, Coll JJ, Fuentes M, Salleras L: Timeliness of notification in infectious disease cases. Public Health Rep. 1992, 107 (4): 474-6.

    CAS  PubMed  PubMed Central  Google Scholar 

  10. 10.

    Ward M, Brandsema P, van Straten E, Bosman A: Electronic reporting improves timeliness and completeness of infectious disease notification, The Netherlands, 2003. Euro Surveill. 2005, 10 (1): 27-30.

    CAS  PubMed  Google Scholar 

  11. 11.

    Clarkson JA, Fine PE: Delays in notification of infectious disease. Health Trends. 1987, 19 (1): 9-11.

    CAS  PubMed  Google Scholar 

  12. 12.

    Allen CJ, Ferson MJ: Notification of infectious diseases by general practitioners: a quantitative and qualitative study. Med J Aust. 2000, 172 (7): 325-8.

    CAS  PubMed  Google Scholar 

  13. 13.

    Rushworth RL, Bell SM, Rubin GL, Hunter RM, Ferson MJ: Improving surveillance of infectious diseases in New South Wales. Med J Aust. 1991, 154 (12): 828-31.

    CAS  PubMed  Google Scholar 

  14. 14.

    Panackal AA, M'Ikanatha NM, Tsui FC, McMahon J, Wagner MM, Dixon BW, Zubieta J, Phelan M, Mirza S, Morgan J, Jernigan D, Pasculle AW, Rankin JT, Hajjeh RA, Harrison LH: Automatic electronic laboratory-based reporting of notifiable infectious diseases at a large health system. Emerg Infect Dis. 2002, 8 (7): 685-91.

    Article  PubMed  PubMed Central  Google Scholar 

  15. 15.

    Jansson A, Arneborn M, Skarlund K, Ekdahl K: Timeliness of case reporting in the Swedish statutory surveillance of communicable diseases 1998–2002. Scand J Infect Dis. 2004, 36 (11–12): 865-72. 10.1080/00365540410025348.

    Article  PubMed  Google Scholar 

  16. 16.

    Kanji GK: The Kolmogorov-Smirnov test for comparing two populations. 100 Statistical Tests. 1999, London SAGE Publications, 68-2

    Google Scholar 

  17. 17.

    Hong RT, Ou JM, Zhang CM, Huang WL, Xie ZH, Jiang AM, Xu LS: Study on the timeliness of the notifiable communicable diseases surveillance system in Fujian province, China, 2004. Zhonghua Liu Xing Bing Xue Za Zhi. 2005, 26 (9): 694-7.

    PubMed  Google Scholar 

Pre-publication history

  1. The pre-publication history for this paper can be accessed here:

Download references

Author information



Corresponding author

Correspondence to Sung-Il Cho.

Additional information

Competing interests

This work was partially supported by the Brain Korea 21 Project. The authors declare that they have no competing interests.

Authors' contributions

HSY completed the analyses and led the writing. OP helped originate the study and interpret findings. HKP assisted in creating the analytic plan, and provided feedback on article drafts. EGL helped to interpret finding and review drafts of the article. EKJ was instrumental in the design, administration, and analysis. JKL reviewed draft and provided critical feedback on the draft. SIC supervised all stages of the study, including originating the study and developing the analytic plan, and writing the article. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Yoo, H., Park, O., Park, H. et al. Timeliness of national notifiable diseases surveillance system in Korea: a cross-sectional study. BMC Public Health 9, 93 (2009).

Download citation


  • Typhoid Fever
  • Mumps
  • Dengue Fever
  • Shigellosis
  • Hemorrhagic Fever With Renal Syndrome