Individual-level space-time analyses of emergency department data using generalized additive modeling
© Vieira et al.; licensee BioMed Central Ltd. 2012
Received: 14 March 2012
Accepted: 17 August 2012
Published: 22 August 2012
Although daily emergency department (ED) data is a source of information that often includes residence, its potential for space-time analyses at the individual level has not been fully explored. We propose that ED data collected for surveillance purposes can also be used to inform spatial and temporal patterns of disease using generalized additive models (GAMs). This paper describes the methods for adapting GAMs so they can be applied to ED data.
GAMs are an effective approach for modeling spatial and temporal distributions of point-wise data, producing smoothed surfaces of continuous risk while adjusting for confounders. In addition to disease mapping, the method allows for global and pointwise hypothesis testing and selection of statistically optimum degree of smoothing using standard statistical software. We applied a two-dimensional GAM for location to ED data of overlapping calendar time using a locally-weighted regression smoother. To illustrate our methods, we investigated the association between participants’ address and the risk of gastrointestinal illness in Cape Cod, Massachusetts over time.
The GAM space-time analyses simultaneously smooth in units of distance and time by using the optimum degree of smoothing to create data frames of overlapping time periods and then spatially analyzing each data frame. When resulting maps are viewed in series, each data frame contributes a movie frame, allowing us to visualize changes in magnitude, geographic size, and location of elevated risk smoothed over space and time. In our example data, we observed an underlying geographic pattern of gastrointestinal illness with risks consistently higher in the eastern part of our study area over time and intermittent variations of increased risk during brief periods.
Spatial-temporal analysis of emergency department data with GAMs can be used to map underlying disease risk at the individual-level and view changes in geographic patterns of disease over time while accounting for multiple confounders. Despite the advantages of GAMs, analyses should be considered exploratory in nature. It is possible that even with a conservative cutoff for statistical significance, results of hypothesis testing may be due to chance. This paper illustrates that GAMs can be adapted to measure geographic trends in public health over time using ED data.
KeywordsGeographic information systems Administrative data Hospitals
In this paper, we describe methods for applying generalized additive models (GAMs) to retrospectively analyze spatial-temporal illness patterns using existing emergency department (ED) data. GAMs allow for smoothing of data while adjusting for known covariates, thus providing a useful framework for individual-level analyses [1–4]. By dividing the dataset into data frames of overlapping time periods and spatially analyzing each data frame using GAMs, we essentially smooth over time and space. The resulting series of maps, displayed chronologically, create a movie which allows us to visualize changes in magnitude, geographic size, and location of risk.
ED data is routinely collected to identify outbreaks of illness, which necessitates the collection of detailed geographic information, often at the individual address level and reported on a daily basis [5–7]. Even when outbreaks are not occurring, ED data can also be useful for understanding the underlying spatial and temporal distribution of illnesses in the community. GAMs can be used to measure trends for larger geographic areas over longer time periods than is usually associated with acute illness outbreaks. For example, the methods presented here can be used to detect areas of increased illness resulting from persistent contamination of groundwater supplies for municipal drinking water. Our approach using GAMs implemented with standard software offers public health researchers and practitioners an opportunity for exploratory secondary analyses of existing ED data, but other methods may be more appropriate for real-time surveillance of patterns at a smaller scale [7–14].
In addition to the ease of use, the GAM provides some methodological advantages. Selection of separate smoothing parameters for space and time circumvents a common limitation for many space-time methods. Often, clustering is detected in a 3-dimensional analysis where the effect of one unit in 2-dimensional space is forced to be equivalent to the effect of one unit in one-dimensional time despite the units being different . For example, when estimating the risk of disease at a point in space and time, data points one mile away could contribute the same weight to the prediction as points one day apart, which may or may not be appropriate. Our separate treatment of spatial and temporal smoothing is useful and appropriate for exploratory analyses, but a unified approach to smoothing in both time and space which avoids this issue would be ideal.
Space-time analysis of individual-level emergency department data poses some other challenges as well. Investigating a specific illness among cases requires information on individuals without that illness, or controls, and with ED data, the choice of controls is not obvious. To serve as appropriate controls, they must represent the underlying population that gave rise to the cases . An additional constraint of the emergency department data is that the reason for the ED visit among the controls should be unrelated to whatever may have caused the health outcome of interest among the ill. In studies with primary collection of emergency department data, participants with injuries have been used as controls for outcomes that are non-injury related ; however, these injured individuals may not appropriately represent the underlying population that gave rise to the cases. It may be more likely that an individual presenting with symptoms of one illness will also visit the emergency department for symptoms of an unrelated illness. Furthermore, in analyses of secondary data such as these using existing ED data of infectious diseases, injury outcomes are not collected.
Generalized additive models are a form of non-parametric/semi-parametric regression with the ability to analyze binary or continuous outcome data while simultaneously adjusting for covariates . The methods we propose use smooth terms to model space for overlapping periods of time, and covariates are controlled for parametrically to minimize data requirements. We use a loess smooth, a locally-weighted regression smoother that adapts to changes in data density, which is particularly useful when working with population-based data . GAMs may exhibit biased behavior at the edges of data, and a benefit of a loess smooth is that it uses a tri-cube weight function that down-weights points far from the target point, suggesting smaller edge effects than for nearest neighbor smoothers with the same span. The amount of smoothing performed by loess is determined by minimizing the Akaike's Information Criterion (AIC). The AIC approximates the deviance-based cross validation using the average deviance of a model penalized by the number of degrees of freedom. Given an emergency department dataset of longitude, latitude, day of the ED visit, case status, and covariate age, we use longitude and latitude to model space and day to model time. Case status is the health outcome of interest and can be any illness or symptom presented for emergency care.
For the purposes of understanding illness patterns, data frames should be spaced far enough apart in time so that new cases have occurred but with sufficient overlap of data for smoothing purposes. To determine the optimal time interval between subsequent data frames, we use the optimal span for model (1) of the first data frame. The optimal interval is calculated as the number of days corresponding to the nth record, where n is the length of the optimal smoothing window for the first data frame. For the hypothetical first data frame with 1,000 records, if we determine the smoothing window to be 0.3 (or 30% of the data points), then the day corresponding to record 300 (30% of 1,000 records) is the optimal interval. The optimal interval is then added to the median day of the first data frame (i.e., the day corresponding to the median record) to arrive at the median day of the second data frame. Again, for the hypothetical first data frame, if the days corresponding to records 300 and 500 (the median record) are day 25 and day 35, then the median day for the second data frame is day 35 plus an interval of 25 days, or day 60 (Figure 1b). The second data frame is created by adding records from days before and after the median day of the second data frame until the optimal length is reached. We repeat the process until the last day of a data frame is also the last day in the ED dataset.
where the left-hand side is the log of the illness odds at location (x1 x 2), z is a vector of covariates (in our example, age), and γ is a vector of parameters . We then used the AIC to select the statistically optimal degree of spatial smoothing. We created a rectangular grid of points covering the study area using the minimum and maximum longitude and latitude coordinates for the ED dataset as its dimensions. We used ArcGIS to clip grid points lying outside the outline map of the study area, in areas where people cannot live (e.g., national parks), and in areas with low population density along the edges of the dataset. Because GAMs may exhibit biased behavior at the edges of the data , we do not predict our spatial models in areas of low population density along the geographic edges of our study area . We used model (2) to estimate the adjusted log odds at each grid point on the study area map. The same prediction grid was used for all spatial analyses, and all analyses were adjusted for age.
GAMs also provide a framework for hypothesis testing. For each time-span data frame, we first tested the global null hypothesis that case status does not depend on the smooth term using the difference of the deviances of model (2) with and without the smooth term. We estimated the distribution of the global statistic under the null hypothesis using a permutation test . We ran the GAM using the optimal span of the data frame and computed the deviance statistic. A p-value cut off of 0.005 was used as a screening tool for possibly meaningful associations. Our previous work suggested the global test may have an inflated type 1 error rate when applied with a significance cut-off of 0.05; a cut-off of 0.025 provided an appropriately sized test . Because a separate spatial analysis is performed on each time-span data frame, we applied an even more conservative cut off of 0.005 to account for the multiple analyses. Despite this adjustment for multiplicity, our results should be considered hypothesis generating rather than hypothesis confirming. We discuss results as “significant” if the associated p-values are less than 0.005, but acknowledge that some results still may be due to chance. If the global deviance test indicated that the map was unlikely to be flat, we next located areas of the map that exhibited clusters of unusually high or low odds of illness. We examined point-wise departures from the null hypothesis of a flat surface using the same set of permutations we used for calculating the global statistics. Once we had a distribution of log odds at every point, points that ranked in the lower and upper 2.5% of the point-wise permutation distributions were identified as areas of significantly decreased odds (“cold spots”) and increased odds (“hot spots”).
The resulting log odds from our spatial analyses were converted to odds ratios (ORs) using the whole study population as the reference, dividing the predicted odds by the odds calculated by the reduced model while omitting the smooth term. Adjusted ORs and pointwise permutation test ranks were exported from R  into ArcGIS  for mapping. R-code and simulated data are freely available . The results for each time-span data frame were displayed using the same dark blue to dark red continuous color scale and the same range of odds ratios to make maps visually comparable. We denoted cold and hot spots on the maps using black contour lines created from the pointwise permutation test ranks. Maps were saved as image files and used to create a storyboard in Windows Movie Maker . Each map plays for 0.5 seconds before transitioning to the next map. The resulting movie shows how illness risk varies over space and time.
To illustrate our methods with a real-world application, we used daily ED data from the Cape Cod region of Massachusetts, collected by the Institute for Health Metrics from three Cape Cod hospitals. Each record in the dataset includes the geocoded patient billing address (in longitude and latitude), the date of the emergency department visit, the patient’s age, and the syndrome group of the patient’s complaint . We converted date to a continuous measure of time by setting the first record to day 1 and calculating subsequent days based on the days that passed between records. We used the optimal span sizes for the temporal analysis of the entire dataset (0.03) and the first time-span data frame (0.25) to divide the dataset into a series of overlapping time-span data frames. For this application, we examined the space-time distribution of gastrointestinal illness in Cape Cod using the proposed methods . Patients who presented with respiratory illnesses were chosen as a control group. The respiratory illnesses displayed a consistent temporal pattern during the study time period with expected increased numbers in the winter season and geographic distribution that was comparable to population distributions from census data. When controls are appropriately sampled from the population giving rise to the cases, the case–control ratio (illness odds) in a subset of the area should be proportional to the incidence rate . The IRB for the Boston University Medical Campus approved this research.
We created a movie of continuous space-time animation for gastrointestinal illness based on location and time (see Additional file 1). The movie begins with the first data frame (median day 46, which for simplicity is labeled Week 1 in the movie) as the first frame of the movie and moves two weeks at a time until the last data frame (median day 1810, Week 257), for a total of 127 map frames. Each frame of the movie shows the risk of GI illness in the study area for that time period, the p-value for the global hypothesis test, and black contour lines depicting areas of statistically significant high or low odds ratios when applicable. Risk was not predicted for the military reservation in the west, conservation area in the north, and area of low population density to the far northeast region of the study area.
Space-time maps allow for pattern analysis of illnesses among cases and controls using individual-level data [24–33]. The GAM method visualizes risk while adjusting for known confounders and testing for the statistical significance of location and time. Our analyses illustrate its application as a method for secondary retrospective analysis of existing ED data. No one method is ideal for every disease cluster investigation and each contributes different and important features to space-time analyses [1–14]. While many methods focus on identifying disease outbreaks, we were primarily interested in visualizing the broader underlying pattern of disease.
Although GAMs have many advantages, a number of issues remain. The GAM analysis uses separate optimal smoothing spans for time and space based on minimizing the AIC for each dataset. While this ensures that the appropriate span is used in each map, it does sometimes result in sudden and spatially large-scale changes. This is less problematic in our application for exploratory analyses, but ideally, we would like to use smoothing spans determined to be optimal in a combined time-space framework so that the method is useful for other spatio-temporal applications as well. Further work is needed to resolve this methodological issue, and we are currently exploring additional GAM methods for simultaneously smoothing time and space . Until such statistical methods have been evaluated and modified for use with public health data, the methods presented here are appropriate for exploratory space-time analyses. The ease of implementation using existing standard software makes it accessible to other researchers and practitioners. GAMs may also exhibit edge effects, which are biased behavior at the edges of the data . As much of our spatial data is found along the edges (i.e., population is denser by the coastline), this issue remains a concern despite our work with synthetic data showing little, if any, edge effect . In the current space-time analysis, we restricted the prediction of risk to areas with high population density in order to limit some of the edge effect bias that may occur.
We computed global and pointwise p-values, but many epidemiologists prefer confidence intervals when evaluating the precision of point estimates . It should be possible to compute variance bands (also known as confidence bands) for our maps using bootstrap methods and work on this, including how to display variance bands in our movies, is ongoing . Further, the global and pointwise hypothesis tests result in having to make multiple comparisons, which increases the likelihood of finding location significant by chance alone. To adjust for multiplicity, we use a conservative global p-value and we only conducted pointwise tests if the global deviance test indicated that the map was unlikely to be flat. The location of significant hot and cold spots should be considered exploratory. As our objective is to measure the geographic patterns of disease rather than identify specific clusters, we focused our results on comparison of magnitude and location of risk regardless of statistical significance. Rather than using statistical significance to identify clusters, another approach is to use a predefined risk level based on the outcome of interest and use that as a way to determine public health significance . This is something we will pursue in future work.
Secondary analyses using existing surveillance data also has its own set of challenges. Further work is needed to determine the optimal control group in a surveillance dataset. There is a possibility that variations in patterns of the control group would result in a shifting reference, for example temporal variations in our controls that do not reflect changes in the population giving rise to the cases. We are currently exploring the use of cases from a prior time period as the reference. While areas of increased or decreased risk may theoretically be caused by non-uniform control selection, selection of controls within the study area did not depend on geography. Also, surveillance data do not include extensive covariates so the observed patterns may be due to spatial confounders like socioeconomic status. Despite these limitations, GAMs remain a useful framework for examining spatial and temporal patterns from ED datasets.
The GAM methods we presented predict risk of illness with a bivariate smooth for longitude and latitude using data frames of overlapping time periods to smooth over time while simultaneously adjusting for confounders. We illustrated this approach using existing surveillance data for the Cape Cod region of Massachusetts. By spatially analyzing data frames created from records of overlapping time periods, we were able to create a movie that showed geographic patterns of illness that were generally similar over time but showed significant variation at certain time periods. The public health of the community during these time periods may warrant further investigation.
The project described was supported by grant numbers NIBIB R01 EB006195-15A1 and 5P42ES007381 from the National Institutes of Health (NIH). Its contents are solely the responsibility of the authors and do not necessarily represent the official views of NIH.
- Hastie T, Tibshirani R: Generalized Additive Models. 1990, Chapman and Hall, LondonGoogle Scholar
- Vieira V, Webster T, Weinberg J, Aschengrau A, Ozonoff D: A spatial-temporal analysis of breast cancer on upper Cape Cod, Massachusetts. Int J Health Geogr. 2008, 7: 46-10.1186/1476-072X-7-46.View ArticlePubMedPubMed CentralGoogle Scholar
- Kelsall J, Diggle P: Spatial variation in risk of disease: a nonparametric binary regression approach. J Roy Stat Soc C-App. 1998, 47: 559-573.View ArticleGoogle Scholar
- Webster T, Vieira V, Weinberg J, Aschengrau A: Method for mapping population-based case control studies: an application using generalized additive models. Int J Health Geogr. 2006, 5: 26-10.1186/1476-072X-5-26.View ArticlePubMedPubMed CentralGoogle Scholar
- Lombardo JS, Burkom H, Pavlin J: ESSENCE II and the framework for evaluating syndromic surveillance systems. MMWR. 2004, 53 (Suppl): 159-165.Google Scholar
- Heffernan R, Mostashari F, Das D, Karpati A, Kulldorff M, Weiss D: Syndromic surveillance in public health practice, New York City. Emerg Infect Dis. 2003, 10 (5): 858-864.View ArticleGoogle Scholar
- Kleinmann KP, Abrams AM, Kulldorff M, Platt R: A model-adjusted space-time scan statistic with an application to syndromic surveillance. Epidemiol Infect. 2005, 133: 409-419. 10.1017/S0950268804003528.View ArticleGoogle Scholar
- Brix A, Diggle PJ: Spatio-temporal prediction for log-Gaussian Cox processes. J Roy Stat Soc B. 2001, 63: 823-841. 10.1111/1467-9868.00315.View ArticleGoogle Scholar
- Diggle P, Knorr-Held L, Rowlingson B, Su T, Hawtin P, Bryant T: On-line monitoring of public health surveillance data. Monitoring the Health of Populations: Statistical Principles and Methods for Public Health Surveillance. Edited by: Brookmeyer R, Stroup DF. 2003, Oxford University Press, Oxford, 233-266.View ArticleGoogle Scholar
- Diggle PJ, Rowlingson B, Su TL: Point process methodology for on-line spatio-temporal disease surveillance. Environmetrics. 2005, 16: 423-434. 10.1002/env.712.View ArticleGoogle Scholar
- Takahashi K, Kulldorff M, Tango T, Yih K: A flexibly shaped space-time scan statistic for disease outbreak detection and monitoring. Int J Health Geogr. 2008, 7: 14-10.1186/1476-072X-7-14.View ArticlePubMedPubMed CentralGoogle Scholar
- Heffernan R, Mostashari F, Das D, Karpati A, Kulldorff M, Weiss D: Syndromic surveillance in public health practice, New York City. Emerg Infect Dis. 2003, 10 (5): 858-864.View ArticleGoogle Scholar
- Ozonoff A, Forsberg L, Bonetti M, Pagano M: A bivariate method for spatio-temporal syndromic surveillance. MMWR. 2004, 53 (Suppl): 61-66.Google Scholar
- Ozonoff A, Jeffery C, Manjourides J, White LF, Pagano M: Effect of spatial resolution on cluster detection: a simulation study. Int J Health Geogr. 2007, 6: 52-10.1186/1476-072X-6-52.View ArticlePubMedPubMed CentralGoogle Scholar
- Wood S: Generalized Additive Models. 2006, Chapman and Hall, LondonGoogle Scholar
- Rothman K, Greenland S: Modern Epidemiology. 1998, Lippincott-Raven, Philadelphia, 2Google Scholar
- Warden CR: Comparison of Poisson and Bernoulli spatial cluster analyses of pediatric injuries in a fire district. Int J Health Geogr. 2008, 7: 51-10.1186/1476-072X-7-51.View ArticlePubMedPubMed CentralGoogle Scholar
- Young R, Weinberg J, Ozonoff A, Vieira V, Webster T: Generalized Additive Models and Inflated Type I Error Rates of Smoother Significance Tests. CSDA.
- The R Project for Statistical Computing. http://www.r-project.org/,
- ESRI GIS and Mapping Software: ArcView. http://www.esri.com/software/arcgis/arcview/index.html,
- Boston University Center for Interdisciplinary Research in Environmental Exposures and Health. http://www.cireeh.org/pmwiki.php/Main/Gam-mapWorkshop,
- Microsoft Windows Movie Maker. http://www.microsoft.com/windowsxp/using/moviemaker/default.mspx,
- Corso PS, Kramer MH, Blair KA, Addiss DG, Davis JP, Haddix AC: Cost of illness in the 1993 waterborne Chrptosporidium outbreak, Milwaukee, Wisconsin. Emerg Infect Dis. 2003, 9 (4): 426-431. 10.3201/eid0904.020417.View ArticlePubMedPubMed CentralGoogle Scholar
- Finkenstadt B, Held L, Isham V: Statistical Methods for Spatio-Temporal Systems, Monographs on Statistics and Applied Probability 107, Chapman and Hall/CRC. 2007Google Scholar
- Knox EG: The detection of space-time interactions. Appl Stat. 1964, 13: 25-30. 10.2307/2985220.View ArticleGoogle Scholar
- Knox G: Epidemiology of childhood leukaemia in Northumberland and Durham. Br J Prev Soc Med. 1964, 18: 17-24.PubMedPubMed CentralGoogle Scholar
- McNally RJQ, Feltbower RG, Parker L, Bodansky HJ, Campbell F, Mckinney PA: Space-time clustering of type 1 diabetes amongst 0–29 year olds in Yorkshire, UK. Diabetologia. 2006, 49: 900-904. 10.1007/s00125-006-0208-5.View ArticlePubMedGoogle Scholar
- Pugliatti M, Riise T, Sotgiu MA, Satta WM, Sotgiu S, Pirastru MI, Rosati G: Evidence of early childhood as the susceptibility period in multiple sclerosis: Space-time cluster analysis in a Sardinian population. Am J Epidemiol. 2006, 164: 326-333. 10.1093/aje/kwj190.View ArticlePubMedGoogle Scholar
- Diggle PJ, Chetwynd AG, Haggkvist R, Morris SE: Second-order analysis of space-time clustering. Stat Methods Med Res. 1995, 4: 124-136. 10.1177/096228029500400203.View ArticlePubMedGoogle Scholar
- Kulldorff M, Hjalmars U: The Knox method and other tests for space-time interaction. Biometrics. 1999, 55: 544-552. 10.1111/j.0006-341X.1999.00544.x.View ArticlePubMedGoogle Scholar
- Kulldorff M: A spatial scan statistic. Commun Statist Theory and Methods. 1997, 26: 1481-1496. 10.1080/03610929708831995.View ArticleGoogle Scholar
- Kwan M: Interactive geovisualization of activity-travel patterns using three-dimensional geographic information systems: a methodological exploration with a large data set. Transportation Research Part C. 2000, 8: 185-203. 10.1016/S0968-090X(00)00017-6.View ArticleGoogle Scholar
- Jacquez GM, Kaufmann A, Meliker J, Goovaerts P, AvRuskin G, Nriagu J: Global, local and focused geographic clustering for case–control data with residential histories. Environ Health. 2005, 4: 4-10.1186/1476-069X-4-4.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/12/687/prepub