This article has Open Peer Review reports available.
Toward unsupervised outbreak detection through visual perception of new patterns
© Lévy and Valleron; licensee BioMed Central Ltd. 2009
Received: 24 January 2009
Accepted: 10 June 2009
Published: 10 June 2009
Statistical algorithms are routinely used to detect outbreaks of well-defined syndromes, such as influenza-like illness. These methods cannot be applied to the detection of emerging diseases for which no preexisting information is available.
This paper presents a method aimed at facilitating the detection of outbreaks, when there is no a priori knowledge of the clinical presentation of cases.
The method uses a visual representation of the symptoms and diseases coded during a patient consultation according to the International Classification of Primary Care 2nd version (ICPC-2). The surveillance data are transformed into color-coded cells, ranging from white to red, reflecting the increasing frequency of observed signs. They are placed in a graphic reference frame mimicking body anatomy. Simple visual observation of color-change patterns over time, concerning a single code or a combination of codes, enables detection in the setting of interest.
The method is demonstrated through retrospective analyses of two data sets: description of the patients referred to the hospital by their general practitioners (GPs) participating in the French Sentinel Network and description of patients directly consulting at a hospital emergency department (HED).
Informative image color-change alert patterns emerged in both cases: the health consequences of the August 2003 heat wave were visualized with GPs' data (but passed unnoticed with conventional surveillance systems), and the flu epidemics, which are routinely detected by standard statistical techniques, were recognized visually with HED data.
Using human visual pattern-recognition capacities to detect the onset of unexpected health events implies a convenient image representation of epidemiological surveillance and well-trained "epidemiology watchers". Once these two conditions are met, one could imagine that the epidemiology watchers could signal epidemiological alerts, based on "image walls" presenting the local, regional and/or national surveillance patterns, with specialized field epidemiologists assigned to validate the signals detected.
Interest in syndromic surveillance was fueled in the recent years by the 9/11 attack on the US that revived fears of bioterrorism and by the threat of emerging diseases. Syndromic surveillance is defined as "an investigational approach where health department staff, assisted by automated data acquisition and generation of statistical alerts, monitor disease indicators in real-time or near real-time to detect outbreaks of disease earlier than would otherwise be possible with traditional public health methods". To achieve this goal, the places to observe and the databases to analyze must meet certain prerequisites: observations must be made where patients first seek immediate care, i.e., at general practitioners (GPs), hospital emergency departments (HED) or pharmacies. Data must be accessible in real time and collected on a routine basis. Good examples of such data are over-the-counter drug sales, visits to emergency care units, which, in most hospitals, are recorded in real time, or consultations with GPs in private practice, when a system of real-time data collection is available, as is the case for the French Sentinel Network [2, 3].
Once the databases are available in appropriate settings, outbreak-analysis algorithms are needed. An outbreak is an unexpected cluster of cases of a certain category, given the past experience in the same place and under the same conditions. Thus, outbreak detection can be considered a problem of pattern recognition.
Since the advent of artificial neural network methods of pattern recognition , it has become classical to separate "supervised" and "unsupervised" methods. This distinction is particularly relevant in the context of outbreak detection: supervised methods are used when the pattern to recognize has been defined previously, e.g., the detection of seasonal influenza outbreaks. In this situation, data collection must rely on a well-defined set of symptoms. Then, a statistical algorithm is used to qualify when an excess of observed cases indicates an outbreak. Numerous statistical techniques belonging to this class of supervised methods are routinely used in surveillance (e.g., periodic regression models, which are now available on the Web ), as long as the patterns to recognize have been defined a priori. For example, the Centers for Disease Control and Prevention (CDC) defined 11 classes of syndromes associated with bioterrorism , and several syndromic surveillance algorithms were devised to optimally assign each new case to one of those classes [2, 7–17].
While the supervised approach is straightforward, by definition, it only identifies those events that have been defined a priori. A second class of pattern-recognition techniques is the class of "unsupervised methods". In this class, the patterns to separate have not been defined previously. The challenge is to distinguish them – when they exist – from background "noise". In epidemiological terms, unsupervised approaches are suited to the detection of outbreaks of emerging diseases, for which no prior description is available, or bioterrorist attacks using unconventional biological weapons, i.e., modified biological agents causing novel unknown symptoms. Supervised methods are inapplicable in this critical role of epidemiological surveillance.
Herein, we describe an unsupervised outbreak-detection method that relies on the human visual capacity to detect new patterns . This strategy is based on two components: the first is an adequate visual representation of the clinical encounters during outpatient consultations to a GP or a HED; the second is human, in that we suppose that "epidemiology watchers" could be trained to identify the novel patterns on their air-controller-like monitors, which correspond to the new epidemiological events of potential interest.
Outline of the method
The principle of the method relies on the translation of medical linguistic information collected during the consultation into a visual signal. To do so, the first step is to encode that information using standardized medical terminology. For this study, we chose the International Classification of Primary Care, 2nd version (ICPC-2), which was specifically developed to code the clinical consultations patients in general practice. Then, these code counts, corresponding to number of consultations with those symptoms, are presented within a graphic reference frame, which contains all the codes of the terminology ordered in such a way as to mimic body anatomy. This ordering facilitates the epidemiology watcher's interpretation of the images, that we call ICPCviews.
Each patient-practitioner encounter is described with a chain of linguistic information describing the chief purpose of the consultation. That information is then translated into ICPC-2 code . It can be coded automatically [19, 20] or by an expert.
In ICPC-2, the codes are ranged according to three axes: symptoms, diagnoses and processes. Within these axes, 17 social-nosological categories (social, psychiatry, neurology...) are defined. A total of 745 different codes comprise ICPC-2, compared to the 10,795 codes making up the 10th International Classification of Diseases (ICD-10). In this study, we used the symptoms and diagnoses corresponding to 685 codes.
The aim of the method is to provide an instantaneous visualization of the whole set of codes. Herein, we applied an approach that we previously used for other medical classifications [21, 22]: each ICPC-2 code is assigned to a cell located in the graphic reference frame defined below. A patient population is then represented as an image, in which each cell corresponds to one ICPC-2 code  and the number of affected patients is materialized by the color of this cell.
Each color is coded by a number reflecting the frequency of the diagnosis/symptom, from white (absent) to bright red (= 255). Let's assume that, in a given cell, a frequency x was observed. The color code N(x) assigned to x is defined by N(x) = integer part of [(x/(Max - Min)) × 255], where Max and Min are the respective maximum and minimum numbers of medical consultations associated with the symptom codes corresponding to the image cells for this population of patients.
We used two databases to illustrate our method: one from GPs in private practice and the other from an HED.
Data from GPs were obtained through the French Sentinel Network which has monitored online a series of common communicable diseases since 1984  and, all patient referrals to hospitals by Sentinel GPs since August 1997. A program then converts, when possible, these referrals, which are expressed in free text, into ICPC-2 codes . A total of 17,896 consultations were notified between 1997 and 2004: half were automatically coded by the software, the other half were coded by a medical resident.
Data on outpatients consulting at an HED were obtained during 2006 (n = 45,055) in a major university hospital in Paris. The chief complaints of every consulting patient during 2006 were recorded in free text by the triage nurse. To determine whether characteristic patterns of influenza were visible before the 2006 outbreak, we selected 4 random subsets of 200 consultations each, corresponding respectively to: the week just before the flu period (week 3/2006), the week of the flu outbreak peak (week 6/2006), the week after the flu period (week 14/2006) and the rest of the year. The time of the epidemic peak and its duration were provided by the routine periodic regression software used for real-time data from the Sentinel Network . The chief complaints of these 800 patients were coded by an experienced ICPC-2-coding medical secretary.
We also analyzed the GPs' data concerning influenza-like surveillance over a 7-year period (see Additional file 2, which contains a slide show composed of 82 successive images). The visual changes of disease-associated color patterns generated by the successively entered codes that paralleled flu epidemics are apparent . Note that this example is not provided to proclaim that the visual method should replace in this instance the classical supervised statistical outbreak-detection methods, which are used routinely. It is given as proof-of-concept of the proposed unsupervised method, as it enables the recognition of the influenza outbreaks that are objectively defined with the supervised techniques.
The usual syndromic surveillance methods are supervised and based on statistical tools. Herein, we described a novel method that could be used when the supervised approach is not applicable. That situation occurs when we are faced with the detection of "unexpected" events, which, by definition, are of major interest for epidemiological alert. Indeed, our primary goal is to help recognize, as early as possible, totally unexpected epidemiological patterns. The detection-triggering signal can be the mere increase of an isolated diagnosis code. Pertinently, in this case, a regression method with a threshold would have performed better only under the very restrictive condition that this code would have been identified in advance. However, the signal can also be an unusual association of different color patches on the monitor, which appear to be novel to the observer, and trigger an in depth epidemiological investigation.
Our proposed model is similar to what already happens in an air-traffic-control room: most of the routine tasks are now automated and the attention of the human observers is now focused on "unexpected" events. Likewise, we propose relying on the classical supervised methods for the usual situations that happen regularly (e.g., seasonal flu epidemics), and we seek to improve our detection of the unexpected epidemiological events that are extremely critical from a public health perspective, precisely because they are unexpected.
An important technical problem is the choice of the time resolution of the display on the monitor. For the French Sentinel Network, resolution time was the month: that timeframe is clearly irrelevant for prospective surveillance and was only used to show the potential of our method to recognize a very special event (i.e., the health impact of the 2003 heat wave). Similarly, for the HED, the choice of weekly resolution was only illustrative and was imposed by the numbers of data available per day, keeping in mind that several hundred cases are needed to create an informative image. In a real-world application, the choice of the temporal resolution would depend on the nature of the class of events to be identified: hourly resolution or, at worst, daily resolution would be desirable to recognize a terrorist attack-associated disease. The temporal resolution chosen also reflects the spatial resolution, with the number of cases observed indeed being a decreasing function of both spatial and temporal resolutions.
For example, the HED data we used in our example was collected in real time. The hospital that provided those data has ~150 consultations per day. Using a surveillance system based on the network of all Paris region public hospitals (Assistance Publique-Hôpitaux de Paris), which collects real-time data on 4000 patients per day (i.e., ~150/patients/hour) would, in contrast, empower a much shorter timeframe, of the order of a few hours.
Furthermore, for the method we propose, we chose to code diagnoses and symptoms with the ICPC-2 system, because it was developed precisely for primary care patients, who are the best target for surveillance of emerging diseases or bioterrorist attacks. However, the same paradigm developed herein could be used with other classification methods.
In a first test example, we showed that visual inspection of the ICPCviews obtained based on Sentinel Network GPs' transmissions during the 2003 heat wave in France would have likely raised suspicion that something unusual was occurring at that time. Indeed, in light of the public health and political scandal that ensued, it is highly rewarding that the images generated with our model heralded the high morbidity and mortality (later documented) that passed unnoticed. At the time of the event, the only public health warnings came from newspapers and funeral parlors, not from the health information systems, which were therefore far from the ideal real-time systems we described above. Imagine that the wall of monitors would have generated patterns similar to those seen in Figure 2, derived from data collected throughout the country. We are convinced that the trained "epidemiology watchers" would have detected the unexpected patterns and would have triggered the investigations that were so sorely lacking.
The second example we used was the detection of a flu-like outbreak. Flu-like symptoms are observed at the onset of many diseases, during bioterrorist attacks (e.g., smallpox, plague, anthrax), and for emerging diseases (e.g., severe acute respiratory syndrome, Chikungunya, flu pandemic,...). Numerous supervised techniques proved successful at recognizing seasonal influenza outbreaks, and the goal of our technique is not to compete with those methods in this situation.
Now, imagine an outbreak of influenza-like syndromes occurring in August, or the onset of a new disease heralded by symptoms, like epistaxis or purpura; the supervised methods would be, by definition, unsuited to detect them, while an unsupervised technique, like the one we proposed here, could work. Finally, the method is designed to have the highest sensitivity possible, in order to detect rare, unusual and unexpected signals. To achieve good positive-predictive value would require, in addition, a "back room", where human experts would validate the signals based on appropriate field epidemiological investigations.
One caveat of the method is that it relies, by definition, on human observers. Hence, its effectiveness will depend upon the quality of these observers and their training. The system's quality and that of the epidemiology watcher could be measured with a research protocol based on simulated datasets. This approach has been successfully used in epidemiological surveillance to test new algorithms . Simulated data sets could be generated by adding a given number of codes of interest (e.g., those compatible with an anthrax attack) to an existing database (e.g., the present HED database). Epidemiology watchers would then be shown the successive monitors displaying the evolution of the images within the graphic reference frame, and asked to indicate whether and when they could identify an outbreak. Such a design would allow easy computation the sensitivity and specificity of the system (as a function of the number of simulated codes added to the database). Standard statistical techniques would also allow assessment of intra- and interobserver variabilities.
If one accepts that an epidemiological alert system must be able to detect unexpected events, then huge efforts must be made to develop unsupervised methods precisely designed with this effect in mind. Herein, we described an attempt in this direction. The use of visual perception that we advocate here is not the only possible solution. Unsupervised pattern recognition is a prolific field of research that takes advantage of the ever-increasing power of computers and the new methods of machine learning. Those will be new avenues for epidemiological research into efficient warning systems.
This work was supported by the EU Sixth Framework Programme for research for policy support (contract SP22-CT-2004-511066).
We are grateful to Catherine Fruchart, Oren Semoun, Sofia Meurisse and Witold Jarzebowski for data collection and coding in one hospital emergency department.
We are grateful to the hospital emergency department of Hôpital Saint-Antoine in Paris for providing data.
We thank Janet Jacobson for editorial assistance.
- Buehler JW, Hopkins RS, Overhage JM, Sosin DM, Tong V: Framework for evaluating public health surveillance systems for early detection of outbreaks: recommendations from the CDC Working Group. MMWR Recomm Rep. 2004, 53 (RR-5): 1-11.PubMedGoogle Scholar
- Valleron AJ, Bouvet E, Garnerin P, Menares J, Heard I, Letrait S, Lefaucheux J: A computer network for the surveillance of communicable diseases: the French experiment. Am J Public Health. 1986, 76 (11): 1289-1292. 10.2105/AJPH.76.11.1289.View ArticlePubMedPubMed CentralGoogle Scholar
- Cauchemez S, Valleron AJ, Boelle PY, Flahault A, Ferguson NM: Estimating the impact of school closure on influenza transmission from Sentinel data. Nature. 2008, 452 (7188): 750-754. 10.1038/nature06732.View ArticlePubMedGoogle Scholar
- Micheli-Tzanakou E: Supervised and Unsupervised Pattern Recognition: Feature Extraction and Computational Intelligence. 2000, Boca Raton, FL, USA: CRC PressGoogle Scholar
- Pelat C, Boelle PY, Cowling BJ, Carrat F, Flahault A, Ansart S, Valleron AJ: Online detection and quantification of epidemics. BMC Med Inform Decis Mak. 2007, 7: 29-10.1186/1472-6947-7-29.View ArticlePubMedPubMed CentralGoogle Scholar
- CDC: Syndrome definitions for Diseases associated with Critical Bioterrorism associated Agents. 2003Google Scholar
- Ivanov O, Wagner MM, Chapman WW, Olszewski RT: Accuracy of three classifiers of acute gastrointestinal syndrome for syndromic surveillance. Proc AMIA Symp. 2002, 345-349.Google Scholar
- Mikosz CA, Silva J, Black S, Gibbs G, Cardenas I: Comparison of two major emergency department-based free-text chief-complaint coding systems. MMWR Morb Mortal Wkly Rep. 2004, 53 (Suppl): 101-105.Google Scholar
- Reis BY, Mandl KD: Syndromic surveillance: the effects of syndrome grouping on model accuracy and outbreak detection. Ann Emerg Med. 2004, 44 (3): 235-241. 10.1016/j.annemergmed.2004.03.030.View ArticlePubMedGoogle Scholar
- Chapman WW, Christensen LM, Wagner MM, Haug PJ, Ivanov O, Dowling JN, Olszewski RT: Classifying free-text triage chief complaints into syndromic categories with natural language processing. Artif Intell Med. 2005, 33 (1): 31-40. 10.1016/j.artmed.2004.04.001.View ArticlePubMedGoogle Scholar
- Heffernan R, Mostashari F, Das D, Karpati A, Kulldorff M, Weiss D: Syndromic surveillance in public health practice, New York City. Emerg Infect Dis. 2004, 10 (5): 858-864.View ArticlePubMedGoogle Scholar
- Lombardo JS, Burkom H, Pavlin J: ESSENCE II and the framework for evaluating syndromic surveillance systems. MMWR Morb Mortal Wkly Rep. 2004, 53 (Suppl): 159-165.Google Scholar
- Wagner MM, Espino J, Tsui FC, Gesteland P, Chapman W, Ivanov O, Moore A, Wong W, Dowling J, Hutman J: Syndrome and outbreak detection using chief-complaint data – experience of the Real-Time Outbreak and Disease Surveillance project. MMWR Morb Mortal Wkly Rep. 2004, 53 (Suppl): 28-31.Google Scholar
- Valleron AJ, Garnerin P: Computerised surveillance of communicable diseases in France. Commun Dis Rep CDR Rev. 1993, 3 (6): R82-87.PubMedGoogle Scholar
- Henry JV, Magruder S, Snyder M: Comparison of office visit and nurse advice hotline data for syndromic surveillance – Baltimore-Washington, D.C., metropolitan area, 2002. MMWR Morb Mortal Wkly Rep. 2004, 53 (Suppl): 112-116.Google Scholar
- Jones NF, Marshall R: Evaluation of an electronic general-practitioner-based syndromic surveillance system – Auckland, New Zealand, 2000–2001. MMWR Morb Mortal Wkly Rep. 2004, 53 (Suppl): 173-178.Google Scholar
- Sloane PD, MacFarquhar JK, Sickbert-Bennett E, Mitchell CM, Akers R, Weber DJ, Howard K: Syndromic surveillance for emerging infections in office practice using billing data. Ann Fam Med. 2006, 4 (4): 351-358. 10.1370/afm.547.View ArticlePubMedPubMed CentralGoogle Scholar
- Hosoya T, Baccus SA, Meister M: Dynamic predictive coding by the retina. Nature. 2005, 436 (7047): 71-77. 10.1038/nature03689.View ArticlePubMedGoogle Scholar
- ICPC-2: International Classification of Primary Care. 1998, Oxford, UK: Oxford University Press, 2Google Scholar
- Letrilliart L, Viboud C, Boelle PY, Flahault A: Automatic coding of reasons for hospital referral from general medicine free-text reports. Proc AMIA Symp. 2000, 487-491.Google Scholar
- Levy PP: The case view, a generic method of visualization of the case mix. Int J Med Inform. 2004, 73 (9–10): 713-718. 10.1016/j.ijmedinf.2004.04.014.View ArticlePubMedGoogle Scholar
- Darago Laszlo, Levy Pierre, Veres Anett, kristof Zsolt: ICD-View: a technique and tool to make the morbidity transparent. Visual Information Expert Workshop (VIEW2006): 2006; Paris. Edited by: Levy P, et al. 2006, Springer, 216-226.Google Scholar
- Levy PP, Duche L, Darago L, Dorleans Y, Toubiana L, Vibert JF, Flahault A: ICPCview: visualizing the International Classification of Primary Care. Stud Health Technol Inform. 2005, 116: 623-628.PubMedGoogle Scholar
- Costagliola D, Flahault A, Galinec D, Garnerin P, Menares J, Valleron AJ: A routine tool for detection and assessment of epidemics of influenza-like syndromes in France. Am J Public Health. 1991, 81 (1): 97-99. 10.2105/AJPH.81.1.97.View ArticlePubMedPubMed CentralGoogle Scholar
- Valleron AJ, Boumendil A: [Epidemiology and heat waves: analysis of the 2003 episode in France]. C R Biol. 2004, 327 (12): 1125-1141. 10.1016/j.crvi.2004.09.009.View ArticlePubMedGoogle Scholar
- Temporal visualization of data from the French Senitel Network. [http://www.u707.jussieu.fr/valleron/levy/unsupervised_SGP_movie.ppt]
- Serfling R: Methods for current statistical analysis of excess Pneumonia-Influenza deaths. Public Health Reports. 1963, 78 (6): 494-506.View ArticlePubMedPubMed CentralGoogle Scholar
- Hutwagner L, Browne T, Seeman GM, Fleischauer AT: Comparing aberration detection methods with simulated data. Emerg Infect Dis. 2005, 11 (2): 314-316.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/9/179/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.