Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Using an autologistic regression model to identify spatial risk factors and spatial risk patterns of hand, foot and mouth disease (HFMD) in Mainland China

BMC Public Health201414:358

DOI: 10.1186/1471-2458-14-358

Received: 12 July 2013

Accepted: 4 April 2014

Published: 14 April 2014

Abstract

Background

There have been large-scale outbreaks of hand, foot and mouth disease (HFMD) in Mainland China over the last decade. These events varied greatly across the country. It is necessary to identify the spatial risk factors and spatial distribution patterns of HFMD for public health control and prevention. Climate risk factors associated with HFMD occurrence have been recognized. However, few studies discussed the socio-economic determinants of HFMD risk at a space scale.

Methods

HFMD records in Mainland China in May 2008 were collected. Both climate and socio-economic factors were selected as potential risk exposures of HFMD. Odds ratio (OR) was used to identify the spatial risk factors. A spatial autologistic regression model was employed to get OR values of each exposures and model the spatial distribution patterns of HFMD risk.

Results

Results showed that both climate and socio-economic variables were spatial risk factors for HFMD transmission in Mainland China. The statistically significant risk factors are monthly average precipitation (OR = 1.4354), monthly average temperature (OR = 1.379), monthly average wind speed (OR = 1.186), the number of industrial enterprises above designated size (OR = 17.699), the population density (OR = 1.953), and the proportion of student population (OR = 1.286). The spatial autologistic regression model has a good goodness of fit (ROC = 0.817) and prediction accuracy (Correct ratio = 78.45%) of HFMD occurrence. The autologistic regression model also reduces the contribution of the residual term in the ordinary logistic regression model significantly, from 17.25 to 1.25 for the odds ratio. Based on the prediction results of the spatial model, we obtained a map of the probability of HFMD occurrence that shows the spatial distribution pattern and local epidemic risk over Mainland China.

Conclusions

The autologistic regression model was used to identify spatial risk factors and model spatial risk patterns of HFMD. HFMD occurrences were found to be spatially heterogeneous over the Mainland China, which is related to both the climate and socio-economic variables. The combination of socio-economic and climate exposures can explain the HFMD occurrences more comprehensively and objectively than those with only climate exposures. The modeled probability of HFMD occurrence at the county level reveals not only the spatial trends, but also the local details of epidemic risk, even in the regions where there were no HFMD case records.

Background

Enterovirus 71 (EV71) is a common cause of hand, foot, and mouth disease (HFMD), may also cause severe neurological diseases, such as encephalitis and poliomyelitis-like paralysis. Outbreaks of hand, foot and mouth disease associated with EV71 infections have occurred in the Asia Pacific region since 1997 [1]. HFMD is a children's common infectious disease that mainly occurs in children under five years old [2]. In most cases, the disease is mild and self-limiting. However, severe clinical presentations with neurological symptoms such as meningitis, encephalitis, polio-like paralysis, and pulmonary edema may occur [3], which can cause serious injury or even death to young children. Outbreaks of HFMD have been reported many times in the countries of Western Pacific Region over the last decade [47]. There were large-scale HFMD outbreaks in Mainland China in 2008 and 2009 that led to 488,955 reported cases and a morbidity of 37/100,000 during the year 2008 and 1,155,525 cases, a mortality of 0.0095/100,000 and a fatality of 0.26/1000 during the year 2009 [2]. HFMD can produce a pandemic in a short period of time due to its highly infectious characteristic, thus poses a serious threat to the public health.

Many studies have extensively investigated the disease transmission characteristics, the risk factors, and the spatial distribution patterns of HFMD risk. It was found that the transmission pattern of HFMD shows strong seasonal characteristics. The epidemic peaks occurred in spring and early summer in Mainland China [2]. The highest incidence of HFMD was in summer in Taiwan, China [4]. The epidemics have inter-years periodic characteristics, as they occur once every three years In Malaysia [8]. At the temporal scale of weeks, HFMD incidence has a significant association with weekly temperature and precipitation with 1–2 weeks in Singapore [9] and 7 weeks in China [10].

Odds ratio (OR) is used to measure the risk of a disease exposed to the determinants, which has been widely used to identify risk factors in epidemiology [11]. It indicates the strength of the association between the exposures and disease. An OR value greater than 1 indicates that the exposure is a risk factor, a value less than 1 indicates a protective factor and a value equal to 1 indicates an unrelated factor. Previous studies on the OR values of the significant HFMD risk factors showed that 1.0 to 2.9 years old children have the highest risk (OR > 2.3). Boys were more susceptible than girls (OR > 1.56). Infant cases had the highest incidences of severe disease (OR > 1.4) and death (OR > 2.4). Enterovirus 71 is more strongly associated with severe disease compared with Coxsackie A16 (OR > 16) [12]. Playing with neighborhood children (OR = 11), visiting an outpatient clinic for another reason > 1 week before the onset of HFMD (OR = 20), community exposures to crowded places (OR = 7.3) [13], rural/urban areas (OR = 2.1), drinking behavior (OR = 2.441), infant hand washing before/after dinner (OR = 0.505) [14], float population (OR = 4.507), toy sucking (OR = 3.220) [15] and being in a low-income families are other risk factors [16].

Besides the personal characteristics above, climate variables as the spatial risk factors associated with HFMD occurrence have been recognized. Using the Bayesian Maximum Entropy (BME) model and self-organizing map (SOM) algorithm, the number of HFMD cases has been shown to have a close relationship to monthly precipitation in Mainland China [2]. Child population density (CPD) and climatic factors were the potential determinants of HFMD incidence in most areas of the Mainland China [3]. Weekly mean temperature and cumulated rainfall are significantly associated with HFMD incidence with a time lag of 1–2 weeks in Singapore [9]. A higher risk of transmission is associated with temperatures in the range of 70°F to 80°F, higher relative humidity, lower wind speed, more precipitation, and greater population density in China [12]. In Japan, a series study found that ambient temperature and relative humidity were significantly linked with increased HFMD occurrence [17]. The association between climate variables and HFMD also has been examined in many provinces and cities of China, such as Beijing [18], Hong Kong [19], Guangdong province [20], Shenzhen [21] and Guangzhou city [22].

In previous studies, few studies have discussed the socio-economic exposures as the risk factors of HFMD occurrence at a space scale, not to mention combined with climate exposures. Methodologically, the spatial autocorrelation is prevalent in the data in social and economic sciences [23]. The neglect of the spatial autocorrelation could result in a biased and under-performing model in health risk assessment [24, 25]. In spatial epidemiology, researchers are concerned more about the spatial distribution pattern of the epidemic risk more than just identifying risk factors, so it is important to predict the spatial distribution of the HFMD risk.

To address the problems and challenges mentioned above, both climate and socio-economic exposure factors were selected as potential determinants to explore the spatial risk factors of HFMD occurrence in Mainland China. We built an autologistic regression model that takes spatial autocorrelation effect of variables into account to identify the risk factors with OR values and model the spatial distribution of the HFMD risk over Mainland China at the county level. The study revealed the local variations of HFMD epidemic risk at county level by mapping the probability of disease occurrence in each geographic unit.

Methods

Data

The original HFMD reported data consisted of daily number of disease cases at the county level from May 1, 2008 to March 27, 2009. The data were provided by the Chinese Center for Disease Control and Prevention (CDC). Our study focused on whether a county had any HFMD cases or not and the potential risk factors of the disease occurrence. As the dependent variable, if there are any HFMD cases in a county, it is labeled as true or 1, otherwise false or 0 [26]. The disease record in May 2008 had the most amounts of data (disease variable = 1), 87.19% of the spatial units were reported having cases. The disease record in May 2008 also had the highest number of monthly cases. Thus, the data of May 2008 was chosen as the study data in this experiment. Figure 1 shows the spatial distribution of the HFMD occurrence in Mainland China in May 2008. A total of 1,975 geographical units have valid data, where 1,722 of them were reported to have cases. The study area has been divided into seven districts, North China, East China, South China, Central China, Northeast, Southwest and Northwest.
https://static-content.springer.com/image/art%3A10.1186%2F1471-2458-14-358/MediaObjects/12889_2013_Article_6570_Fig1_HTML.jpg
Figure 1

The spatial distribution of HFMD occurrence at county level in Mainland China in May 2008.

The monthly climate data of May 2008 were provided by the China Meteorological Data Sharing Service System. The original data were collected from 727 meteorological stations over the whole area of China. We used ordinary kriging interpolation [27] and spatial aggregation technology to estimate each county’s mean value of the climate factors. Seven routine climate variables were used as candidates to explore the climate risk factors of HFMD occurrence [3]: monthly average wind speed, monthly average precipitation, monthly average temperature, monthly average temperature difference, monthly average atmospheric pressure, monthly average sunshine duration and monthly average relative humidity.

We also collected the social and economic data as potential risk factors for HFMD occurrence from the City (County) Social Economic Statistical Yearbook of China, the Regional Statistical Economic Yearbook of China and the Urban Statistical Yearbook of China in 2008. Unlike the climate data, the socio-economic factors were for the entire year of 2008. There is no monthly data available. The candidate socio-economic exposed indicators include population density, the proportion of student population, per capita household savings, the number of hospital beds per capita, industrial output value, number of industrial enterprises, product GDP per capita, number of telephones per capita and other factors.

The geographical administrative division data were obtained from the Chinese National Administration of Surveying, Mapping and Geoinformation. The data were published in 2010, so we updated, amended, merged and split the original vector data according to the latest administrative divisions’ code published by the National Bureau of Statistics of the People's Republic of China (http://www.stats.gov.cn, as of December 31, 2008), to guarantee the data were consistent with the HFMD records in every unit. As a result, HFMD data, climate data, and socio-economic data were all geo-linked to the vector geographical administrative division data in a geo-spatial database.

Logistic and autologistic regression model

Logistic regression model has been widely used in epidemiology to explore the risk factors of disease [12, 1416, 28]. The ordinary logistic model is the most common method in a case–control study. The dependent variable of the model is expressed by a binary classification variable where one indicates the true (having case), and zero indicates the false (no case). The independent variables of the model are described by a series of natural and socio-economic potential exposed factors. The model calculates the probability of the occurrence of an event, uses independent variables as the predictor values that are continuous or categorical variables. For an ordinary logistic regression, the form of the model is given by equation (1) [29, 30]:
In P i 1 - P i = β 0 + β 1 x 1 , i + + β n x n , i
(1)

where P i (probability of the occurrence of a disease) is the expected value of the dependent variable y i (so that y i  = 1 if a sample has disease case and y i =0, otherwise), x is the independent variables (potential exposed factors), β is the estimated coefficient, i is the index of the records, such as a geographical unit. Significance levels for variables to be included in the model are often set as 0.05 or 0.1.

The autologistic regression is the most widely used one for modeling spatially correlated presence/absence data. Indeed, many studies have demonstrated the usefulness of the autologistic regression in modeling binary data with observed covariates. The autologistic regression model is a special case of the general logistic models. It was introduced by Besag et al. (1974) [31]. The model introduces a spatial autocorrelation term in the form of weighting coefficients and solves the problem of spatial autocorrelation effects in the process of statistical analysis. We can express the conditional probability of the occurrence of a disease using equation (2) [3235]:
P i y i = 1 | β 0 , β , r = exp β 0 + β 1 x 1 , i + + rAuto cov i 1 + exp β 0 + β 1 x 1 , i + + rAuto cov i
(2)

The predicted result P i denotes the probability of an event occurring for every geographic unit. x is independent variables. Autocov is the autocovariate variable. β and r are the coefficients of variables in the equation. i is the index of the geographical units.

Spatial autocorrelation is frequently encountered in spatial data. Typically, disease occurrences and spatial risk factors are positively autocorrelated such that nearby units in space tend to have more similar values than would be expected by random chance. Thus, models that ignore the spatial autocorrelation may be inappropriate because they might overestimate the importance of environmental variables [36]. In addition, models that ignore spatial autocorrelation effect could include variables that have little or no relevance to the response variable, creating false conclusions in modeling spatial distribution of diseases. This problem could be solved by incorporating spatial autocorrelation (autocovariate) into logistic regression models, which would result in model improvements such as increased predictive accuracy and model versatility [37].

The ordinary binary logistic model is modified to incorporate any spatial autocorrelation between geographic units by incorporating an autocovariate variable. The probability of the event occurring in one geographic unit is higher, if it is also present in the neighboring units due to the spatial autocorrelated effect. The autocovariate variable can be calculated from the predicted probabilities of occurrence, which is estimated by an ordinary logistic regression model, using the equation (3) [29, 33, 34]:
Auto cov i = j = 1 k i w ij P ^ j j = 1 k i w i j
(3)

The autocovariate variable (Autocov i ) is a weighted average of the probabilities of the geographic units amongst a set of k i neighbors of the geographic unit i. A method of with a certain distance (20000 m) of the centroid is used to define the neighbors of the geographic unit i in this study. The spatial weight between the geographic unit i and j is w ij = 1/h ij , where h ij is the Euclidean distance between the centroids of geographic unit i and j, and p ^ j represents the probability estimated by the ordinary logistic regression model [29, 33]. The autocovariate variables were incorporated into the ordinary logistic regression formula stepwisely until each parameter was statistically significant. We used the statistical software SPSS 19 to solve the ordinary logistic regression model and evaluate the model results. ArcGIS 10 was used to process the autocovariate variables data, conduct spatial analysis and create the thematic maps of risk factors and disease risk.

Odds ratio

Odds ratio (OR) is widely used to measure the risk of a disease exposure to a determinant [3840]. The odds ratio is the ratio of the odds that a case has been exposed to a risk factor is compared to the odds for a case that has not been exposed, using equation (4).
OR = odd s exp osed odd s un exp osed = p exp osed / 1 - p exp osed p un exp osed / 1 - p un exp osed
(4)
where P is the probability of the event in a group. An OR greater than 1.0 indicates that the condition or event is more likely to occur in the first group (exposed), and an OR less than 1.0 indicates that the condition or event is less likely to occur in the first group (exposed) [40]. Logistic regression is one method to generalize the odds ratio beyond two binary variables. OR values can be obtained directly by a logistic regression model, using equation (5):
O R x = e β
(5)

where β is the coefficient of the environmental variable x[41]. In epidemiology, an OR value higher than 1.0 indicates that the variable (exposure factor) is a positively correlated risk factor, lower than 1.0 means a negatively correlated risk factor and equal to 1.0 indicates an unrelated factor. For instance, it is common to describe the OR value of two in terms of a twofold risk of developing a disease compared with the reference group [40]. We obtained the OR value of every exposed factor and identified the risk factors of HFMD using this method.

Identification of risk variables

Method for identifying the risk factors was carried out in SPSS 19.0. All the climate and socio-economic variables (Additional file 1) were included into the analysis to determine which of them were significantly associated with HFMD occurrence. Two types of determinants are suspected potentially to cause HFMD, the climatic and the socio-economic. The candidate climatic variables reflect the monthly average status of wind speed, precipitation, temperature, temperature difference, atmospheric pressure, sunshine duration, and relative humidity. Socio-economic variables were taken into account to identify the significant related variables to the HFMD occurrence, which reflect the population, regional comprehensive economy, agriculture, industry and investment, education, public health and social security of the administrative division unit. We conducted transformation processing for some socio-economic indicators before modeling to guarantee the comparability between administrative division units. For example, the number of hospital beds is divided by the population into a number of beds for every million people. All variables were standardized.

Figure 2 is the experiment flow chart that shows how to select exposure variables and use them to build the models. The first criterion of selection is the impact of multicollinearity. Multicollinearity is a statistical phenomenon in which two or more predictor variables in a multiple regression model are highly correlated [4244]. Multicollinearity can lead to the meaning of the equation parameters unreasonable, cause significant test variables lose significance and exclude important explanatory variables from of the model. To decrease such influence, we calculated the variance inflation factor (VIF) and tolerance for each climate variable and socio-economic variable to assess the multicollinearity. In general, the smaller the tolerance and the larger the VIF is, the more serious multicollinearity is [45]. In ordinary logistic models, it is usually taken 10 as the threshold value of VIF. With consideration that the study area is too large and a lot of spatial factors need to be identified, we use a VIF less than 15 as the threshold to choose variables without multicollinearity effect in our case.
https://static-content.springer.com/image/art%3A10.1186%2F1471-2458-14-358/MediaObjects/12889_2013_Article_6570_Fig2_HTML.jpg
Figure 2

Experiment flow chart.

Secondly, we used the stepwise regression method to exclude the variables without statistical significance to establish the best predictive regression model. In statistics, stepwise regression includes regression models in which the choice of predictive variables is conducted by an automatic procedure. Here, we used forward stepwise regression. At the beginning, the model is without any independent variable. Then, introducing variables into the model one by one, each time selecting one variable with the smallest p value (significance) and that the p value < α 1 (threshold value) into the model. Once we introduced a variable into the regression model, we needed to investigate whether the model had a variable with p value > α 2 (threshold value). If it existed, then it was excluded from the model, and the model was re-fitted. Introducing the variables step by step until there were no more variables can satisfy the above conditions. In this experiment, we set α 1 =0.05 and α 2 =0.1 as threshold values when using ordinary logistic regression. As a result, the selected variables were statistically significant.

Results

Spatial distribution of the risk factors

In May 2008, among the recorded geographical units, 12.06% were reported to have no HFMD cases (dependent variable =0), and 87.94% were reported to have more than one HFMD case (dependent variable =1). Figure 1 displays the spatial distribution of the HFMD-dependent values in Mainland China. The distribution of HFMD occurrence shows a strong spatial aggregation that mainly concentrates in eastern, southern and central China. Other regions near the center of the aggregation also present a serious aggregation, such as the south-eastern part in north China and the southern part in northeast China. It is easier to have HFMD cases when the surrounding counties have cases. This spatial autocorrelation characteristic makes it necessary to consider the spatial effect in a logistic regression model [24].

The significant risk factors identified by the flowchart in Figure 2 are monthly average temperature, monthly average precipitation, monthly average wind speed, population density, number of industrial enterprises above designated size and the proportion of student population. Figure 3 shows the spatial distribution of the identified HFMD risk factors. No data regions refer to Taiwan, Hong Kong and the islands in the south, which are not in our study area of Mainland China. The spatial variations of climate factors are large and have strong spatial heterogeneity among the whole region. For example, the difference between the maximum and minimum average temperature is 23.09°C and the standard deviation is 42.19°C. The same situation can be observed for the average precipitation and the average wind speed, which led to significant spatial heterogeneity. High temperature and precipitation are mainly concentrated in eastern, northern and southern China, whereas the values tend to be lower in western and north-eastern China in Figure 3a and b. Socio-economic factors involving population density and the number of industrial enterprises above designated size show a similar trend across the area, decreasing from south-eastern to northwestern China (Figure 3d and f). The spatial trend of the average wind speed and the proportion of the student population are different from the previous. The average wind speed decreased from the north to the south, and the proportion of students increased from the northeast to the southwest (Figure 3c and e).
https://static-content.springer.com/image/art%3A10.1186%2F1471-2458-14-358/MediaObjects/12889_2013_Article_6570_Fig3_HTML.jpg
Figure 3

The spatial distribution of selected exposure factors in the regression model in China in May 2008. (a) Monthly average temperature. (b) Monthly average precipitation. (c) Monthly average wind speed. (d) Population density. (e) Proportion of student population. (f) Number of industrial enterprises above designated size.

Figure 4 shows the spatial distribution of the autocovariate variable in equation (3), which represents the residual spatial autocorrelation term in the autologistic regression model. “No data” regions refer to Taiwan, Hong Kong and the islands in the south. Introducing the spatial autocovariate variable reflects the first law of geography expressed as spatial autocorrelation [46]. It is actually a process of data smoothing, reducing local spatial differences between geographical units to present the inherent spatial difference and tendency. The autocovariate variable has the same unit of the dependent variable, which also represents the probability of the disease occurrence, but it is just a macro spatial trend. Figure 4 shows that the spatial distribution of probability of HFMD occurrence has a strong spatial tendency and heterogeneity, which presents a transitional and gradual change throughout Mainland China. The probability of disease occurrence gradually increases from the northwest to the southeast. The probability is very high in central, southern and eastern china, which is consistent with what we observed in Figure 1 that these areas were hit hardest by the HFMD outbreak.
https://static-content.springer.com/image/art%3A10.1186%2F1471-2458-14-358/MediaObjects/12889_2013_Article_6570_Fig4_HTML.jpg
Figure 4

The spatial distribution of the autocorrelation term: the autocovariate variable.

Validation of the models

In our case, the model was evaluated based on the goodness of fit, the prediction accuracy, and the equation coefficients of model [33, 35, 47]. An autologistic regression model needs the autocovariate variable first, and this step requires the prediction results of the ordinary logistic regression model. The ordinary logistic regression model is an intermediate step in building a spatial model (Figure 2). The performance of the logistic and autologistic regressions models are listed to indicate that they both pass the significance tests. In addition, we selected 30% of samples from all geographical units as the verified dataset using stratified random sampling [48, 49], and the remaining 70% of samples (1383 records) were used for model building. For the binary value of disease, we stratified the whole area into having case and no case stratas, and selected the samples based on the simple random sampling method in the two stratas respectively.

Goodness of fit

Table 1 summarizes the overall model statistics of the logistic and autologistic regression models. A key starting point could be the model chi-square whose value provides the usual significance test for a logistic regression. It is a difference between the best-fitting model and the null hypothesis in which all the coefficients are set to 0. The chi-squares values of the models measure the improvement of fitness due to the inclusion of independent variables into the regression. A high value indicates that the occurrence of disease is far less likely under the null hypothesis (without any influencing parameters) than the full regression model where the parameters are included [47]. Both models are highly significant with parameters. The goodness of fit of the models was further measured by the Cox & Snell R Square and Nagelkerke R Square statistics. These are often called pseudo-coefficients of determination. The higher the statistic values are, the better the model fits the observations. Both of the models pass the significance test. The Relative Operating Characteristic (ROC) is used to compare a Boolean map of “reality” (the presence or absence of disease) with the probability map. The ROC value ranges from 0.5 to 1, where 1 indicates a perfect fit and 0.5 represents a random fit. ROC is the reporting area under the Receiver Operating Characteristic Curve which we obtained in SPSS. In our case, the ROC of the logistic model is 0.816, and the ROC of the autologistic model is 0.817, which indicate a high correlation between the independent and dependent variables. In summary, both of the autologistic regression model and the ordinary logistic regression model have a good goodness of fit.
Table 1

Summary statistics of the logistic and autologistic regression model

Statistics

Logistic

Autologistic

Modeling sample proportion

70%

70%

Number

1383

1383

Model chi-square

206.806

209.640

Cox & Snell R Square

0.139

0.141

Nagelkerke R Square

0.266

0.270

ROC

0.816

0.817

Prediction accuracy

Prediction accuracy represents the accuracy of the predicted results of the dependent variable. The larger the value is, the better the prediction is. It is obtained from the contingency table between the recorded data and the predicted result. Table 2 summarizes the prediction accuracy of the spatial autologistic regression model, including the no-case region (no HFMD case), the having-cases region (having HFMD case) and the whole region (all samples). For the prediction results of verification data, the accuracies of the no-case region, the having-cases region and the whole region are 63.95%, 80.24% and 77.87% respectively.
Table 2

The prediction accuracy of the spatial autologistic regression model

 

Accuracy (%)

Modeling (70% samples)

No-case region

67.66

Having-cases region

79.93

The whole region

78.45

Verification (30% samples)

No-case region

63.95

Having-cases region

80.24

 

The whole region

77.87

Equation coefficients

The parameters of the spatial autologistic model are given in Table 3. The selected six independent variables are all statistically significant (sig. in logistic) in the forward stepwise logistic regression models. All the values of significance level are less than 0.05 in the ordinary logistic model except for average wind speed, for which the significance of average wind speed is less than 0.1. When building the autologistic regression model based on these selected variables, we used forced regression other than forward stepwise regression because adding new spatial autocorrelation variables might lead to the significance of variables increase and exclude related variables we have selected. As a result, we obtained the regression coefficients of every variable and their OR values, as well as the OR values of the spatial autologistic regression model between the 95% confidence interval. The result shows that the OR values of precipitation, temperature, wind speed, population density, proportion of the student population and number of industrial enterprises above designated size are all greater than 1, which indicates that these variables are significant risk factors that are positively related to the occurrence of HFMD. The OR value of the added spatial covariate is the greatest among all variables, which indicates that it is a positively correlated risk factor to the occurrence of HFMD.
Table 3

The OR values obtained for the independent parameters

Independent parameter

Sig. in logistic

Coefficient in autologistic

OR

95% CI of OR

Average temperature

0.000

0.321

1.379

0.863-2.205

Average precipitation

0.002

0.361

1.434

1.044-1.969

Average wind speed

0.074

0.152

1.186

0.881-1.598

Population density

0.001

0.670

1.953

1.215-3.140

Number of above-scale enterprises

0.003

2.873

17.699

1.969-159.095

Proportion of the student population

0.020

0.252

1.286

1.209-1.607

Constant

0.000

0.223

1.250

——

Autocovariate variable

——

2.934

18.800

0.614-575.604

In addition, the added spatial variable (autocovariate variable) has a significant reduction of the contribution of the constant in the equation (from OR = 17.25 to OR = 1.25). This reduction indicated that the added spatial variable expresses the spatial effect in the constant term and reduces the residual error of the constant. Therefore, it is very meaningful to introduce the residual spatial autocorrelation into the model because the spatial autologistic regression model excavates inherent errors that are caused by spatial autocorrelation effect in the ordinary logistic regression model.

Spatial distribution of the probability of HFMD occurrence

The OR values of potential determinants were used to identify spatial risk factors. We estimated the P i in equation (2) at each county. Figure 5 shows the probability P i of disease occurrence of every county in Mainland China to represent the local epidemic risk level. No data regions refer to Taiwan, Hong Kong and the islands in the south. In local space scale, P = 0.5 is taken as a reference standard based on the segmentation criteria in the autologistic model for whether there is disease happen or not in this region. If the P value is greater than 0.5, this indicates that this area is risky for HFMD under the combined effects of the risk factors. The larger the P value is, the more dangerous the county is. Conversely, a P value less than 0.5 indicates that the county is safe for HFMD. The smaller the P value is, the less dangerous the county is. The risk areas of HFMD in Mainland China are mainly locate in eastern, southern and central China, especially in Beijing, Tianjin, Shandong, Henan, Guangdong and Sichuan province. The spatial distribution of probability P i represents more local details of the HFMD risk variations than the spatial distribution of HFMD original records does. For instance, from Figure 1, one can only find that the eastern China was hit hardest by HFMD, but one can find more local variations of the HFMD risk in the eastern China in Figure 5. Such local variations of the HFMD risk can also be found in the north, central, south, northeast, northwest and southwest regions of China. The local patterns of disease are important because the regions with high risk are worth of more attentions in the disease prevention and control.
https://static-content.springer.com/image/art%3A10.1186%2F1471-2458-14-358/MediaObjects/12889_2013_Article_6570_Fig5_HTML.jpg
Figure 5

The spatial distribution of the probability of disease occurrence in Mainland China.

We further obtained the absolute residual error of the estimated P i where original disease records were available to evaluate the uncertainties of the risk predictions. The absolute residual error is calculated by |P real -P predicted |, in which P is the probability of given geographical unit. We created the absolute residual error map to present the spatial uncertainty (Figure 6). The absolute residual error map shows that the probabilities at most of the counties are well predicted with residual errors less than 0.2, especially in East, South and Central China, where there have been the most serious HFMD risk. The regions with relative high residual error are located in areas with low-risk, such as North and Northwest China.
https://static-content.springer.com/image/art%3A10.1186%2F1471-2458-14-358/MediaObjects/12889_2013_Article_6570_Fig6_HTML.jpg
Figure 6

The spatial distribution of the uncertainty of the predictions in the study area.

Discussion

Autologistic regression model

There are often marked spatial autocorrelations in prediction residual terms in the regression analysis for public health risk assessment due to the spatial effects that are not captured in the model [46, 47]. The ordinary logistic regression model is a non-spatial model, and it is based on the assumption that the relationship between disease risk and potential explanatory factors is a stationary spatial process. It is reasonable to assume that the explanatory factors and the relationship between HFMD and the potential risk factors would not change significantly across the whole region for a small and homogenous region of interest. However, the topography, climate and socio-economic factors change greatly over regions in regard to a large region such as China with a territory over 9.6 million square kilometers [50]. It is impossible to maintain the spatial stationary assumption in such a large and heterogeneous area. As a result, the neglect of the spatial effect in a regression analysis could result in a biased and under-performing model in health risk assessment [25].

The autologistic regression model is a spatial model that considers the spatial residual autocorrelation effect in the model. It introduces a spatial residual autocorrelation variable based on a rational assumption that the relationships between the risks of the exposure factors and the risk of HFMD occurrence are more similar in nearby regions. Only nearby counties are included in the spatial autocovariate variable, and every included county is given a weight according to its spatial distance to the destination county. The spatial autocovariate variable also reflects the global spatial trend of the probability the HFMD occurrence, as is shown in Figure 4.

The autologistic regression model also reduces the contribution of the residual significantly, which reflects the spatial inherent residuals, by introducing a spatial autocorrelation variable. The constant in the regression model is the prediction residual error of the model. The smaller the contribution of the constant is, the better the explanatory power of the model is. By introducing the spatial autocovariate variable, the contribution of the constant is reduced significantly in the autologistic model. It changes from OR = 17.25 (for logistic regression) to OR = 1.25 (for autologistic regression). However, the spatial autocovariate variable can be comprehended as the spatial inherent residual to reflect spatial effect in space data, which can reduce bias in health risk assessment. The spatial autocovariate variable helped to remove inherent residual errors from the ordinary logistic regression model.

The main shortcoming of the autologistic regression model is that it’s only suitable for the binary or multiple category dependent variables. The other one is that the autologistic regression model does not have a spatio-temple type so far, which cannot satisfy the need for the analysis of spatio-temporal variation of disease risk.

Identification of risk factors

This study used an autologistic regression model to identify risk factors of HFMD in Mainland China from 29 potential exposed variables (Additional file 1). The results indicate that both climate and socio-economic factors were significant spatial risk factors for HFMD occurrence in Mainland China in May 2008. The significant spatial risk factors are monthly average temperature (OR = 1.379), monthly average precipitation (OR = 1.4354), monthly average wind speed (OR = 1.186), population density (OR = 1.953), the number of industrial enterprises above designated size (OR = 17.699) and the proportion of student population (OR = 1.286). All the risk factors are positively correlated to the occurrence of HFMD.

Our study revealed that the climate factors, such as the air temperature, relative humidity, wind speed and the precipitation, are risk factors associated with the occurrence of HFMD, which is consistent with the conclusions of previous studies in Mainland China, Taiwan and Hong Kong [2, 4, 19].

To our knowledge, this is the first study to explore the socio-economic factors of HFMD from a spatial analysis point of view. It is worth mentioning that introducing spatial socio-economic factors into HFMD risk assessment can explain the spatial pattern of HFMD risk more comprehensively and objectively, than previous studies that are mainly concerned with climate risk factors. We found that in addition to the climate factors, population density, the number of industrial enterprises above designated size and the proportion of student population had significant contributions to the risk of HFMD incidence. The number of industrial enterprises has the largest value of OR (OR = 17.699) among all socio-economic factors, which indicates the level of industry of a county is very risky. It has been confirmed that air pollution is closely related to the industrial level, which would lead to many epidemic diseases and weaken the immunity especially between children and elderly people [51]. We can also find that heavy industrial areas in Figure 3f are significantly consistent with the distribution of cluster disease areas in Figure 1. It makes the value of OR much larger. This indicates that level of industrialization of a county can influence the air pollution level, concentration of PM2.5 and Children's immunity, which thereby affecting the HFMD outbreak.

The comprehensive effect of the climate and social-economic factors makes the regression model have more convincing power and application value. In addition, the autocovariate variable (OR = 18.800) also occupies an important contribution in the autologistic model. It indicates that except for the climate and social-economic factors, the HFMD occurrence risk is related to the spatial location. Thus, the autocovariate variable can be seen as the third type of risk factor addition to the climate and social-economic factors.

The risk in local areas

In spatial epidemiology, researchers are concerned more about the degree of epidemic risk in each geographic unit (counties and cities) at the local spatial scale than the identification of risk factors. We identified the spatial risk factors of HFMD throughout the Mainland China. Another purpose of this research was to determine the combined and interactive effects of these spatial risk factors on HFMD occurrence, which can be called local disease risk. We modeled the probability P i of the HFMD occurrence to each geographical unit to express the spatial distribution pattern of risk (Figure 5).

Using the probability P i of the HFMD occurrence to identify the risk in local areas has many advantages over traditional epidemiological studies. First of all, compared with the original data, the high value region in Figure 5 is consistent with the distribution of cluster disease area in Figure 1. The risk areas are mainly distributed in eastern, southern and central China. Furthermore, the spatial distribution map for probability fills the missing data places where there are no HFMD collection agencies and reflects the risks in those no-data regions. Secondly, spatialized probability obviously displays more local details of epidemic risk. For instance, previously we only knew it was hit the hardest by the HFMD in the eastern China from Figure 4. Now, we can identify that the risk in the east areas is more serious, and the risk in the north is more serious than the risk in the south. There are also three stepped transitions of HFMD risk level in the southwest of China from west to east. The particular risk areas are in Beijing, Tianjin, Shandong, Henan Guangzhou and Sichuan province. Finally, identifying the local areas epidemic risk can provide valuable information regarding the allocation of public health resources for prevention and treatment purposes compared with traditional epidemiology. In this context, we calculated the probability of HFMD occurrence in each geographical unit, connected them to the spatial features and produced a disease risk hierarchical thematic map to show the spatial distribution pattern of HFMD local risk with GIS technology.

Limitations

There are some biases in the study that may affect the results. First and most importantly, the underreporting of HFMD cases in clinics and hospitals is a potential limitation of our study because of the individual disease severity and the gap between the levels of regional medical resources [3], and regional differences in the reporting of HFMD cases can influence the dependent variable and verification accuracy. Secondly, because the socio-economic factors are annual average data, the spatial heterogeneity might be hidden or smooth, which could result in uncertainty. Thirdly, bias could come from the sampling error when choosing modeling data and validation data, which cannot be avoided. That is, if there is sampling, bias will occur. Finally, confounding bias is a widespread uncertainty in epidemiological analysis, especially in spatial epidemiology in which socio-economic factors are strong predictors of the vast majority of health outcomes but when exposed to many environmental-related factors, the confounding phenomenon will be more obvious.

Conclusions

Using a spatial autologistic regression model, we found that HFMD occurrence is heterogeneously related to the climate and socio-economic factors distributed at the county level unit over the Mainland China. The combined effect of socio-economic and climate indicators can explain the determents of HFMD outbreak more comprehensively and objectively. The spatial autologistic regression model that considers spatial autocorrelation and heterogeneity has a relative good goodness of fit and prediction accuracy of HFMD occurrence. The spatial autologistic regression model also reduces the residuals in the ordinary logistic regression model significantly. The spatial autologistic model can be used to geographically differentiate the local risk of disease occurrence by the variation of explanatory spatial risk factors. Through the spatial probability risk map, people can identify risk characteristics in local areas to determine the spatial distribution pattern of HFMD occurrence. Such conclusions could guide local public health institutes to rationally allocate public health resources and improve their preparedness for an outbreak according to region-specific conditions. As a result, the spatial autologistic regression model is effectively used to identify spatial risk factors and spatial patterns of the risk of HFMD. The experimental process and results may provide a theoretical basis, epidemic prediction and determination of the focus areas for national HFMD prevention and control in China.

Declarations

Acknowledgements

This study was jointly supported by MOST (2012CB955503; 2012ZX10004-201; 201202006) and the State Key Lab of Remote Sensing Science.

Authors’ Affiliations

(1)
State Key Laboratory of Remote Sensing Science, Research Center for Remote Sensing and GIS, and School of Geography, Beijing Normal University
(2)
Beijing Key Laboratory of Environmental Remote Sensing and Digital City
(3)
LREIS, Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences
(4)
Key Laboratory of Surveillance and Early-warning on Infectious Disease, Chinese Center for Disease Control and Prevention

References

  1. Zhang J, Sun JL, Chang ZR, Zhang WD, Wang ZJ, Feng ZJ: Characterization of hand, foot, and mouth disease in china between 2008 and 2009. Biomed Environ Sci. 2011, 24 (3): 214-221.PubMedGoogle Scholar
  2. Wang JF, Guo YS, Christakos G, Yang WZ, Liao YL, Li ZJ, Li XZ, Lai SJ, Chen HY: Hand, foot and mouth disease: spatiotemporal transmission and climate. Int J Health Geogr. 2011, 10 (25): 1-10.Google Scholar
  3. Hu M, Li Z, Wang J, Jia L, Liao Y, Lai S, Guo Y, Zhao D, Yang W: Determinants of the incidence of hand, foot and mouth disease in China using geographically weighted regression models. PLoS One. 2012, 7 (6): e38978-10.1371/journal.pone.0038978.View ArticlePubMedPubMed CentralGoogle Scholar
  4. Ho M, Chen ER, Hsu KH, Twu SJ, Chen KT, Tsai SF, Wang JR, Shih SR: An epidemic of enterovirus 71 infection in Taiwan. Taiwan Enterovirus Epidemic Working Group. N Engl J Med. 1999, 341 (13): 929-935. 10.1056/NEJM199909233411301.View ArticlePubMedGoogle Scholar
  5. Liu MY, Liu W, Luo J, Liu Y, Zhu Y, Berman H, Wu J: Characterization of an outbreak of hand, foot, and mouth disease in Nanchang, China in 2010. PLoS One. 2011, 6 (9): e25287-10.1371/journal.pone.0025287.View ArticlePubMedPubMed CentralGoogle Scholar
  6. Chatproedprai S, Theanboonlers A, Korkong S, Thongmee C, Wananukul S, Poovorawan Y: Clinical and molecular characterization of hand-foot-andmouth disease in Thailand, 2008–2009. Jpn J Infect Dis. 2010, 63: 229-233.PubMedGoogle Scholar
  7. Ang LW, Koh BKW, Chan KP, Chua LT, James L, Goh KT: Epidemiology and control of hand, foot and mouth disease in Singapore. Ann Acad Med Singapore. 2009, 38: 106-112.PubMedGoogle Scholar
  8. Podin Y, Gias ELM, Ong F, Leong YW, Yee SF, Yusof MA, Perera D, Teo B, Wee TY, Yao SC: Sentinel surveillance for human enterovirus 71 in Sarawak, Malaysia: lessons from the first 7 years. BMC Public Health. 2006, 6 (1): 180-10.1186/1471-2458-6-180.View ArticlePubMedPubMed CentralGoogle Scholar
  9. Hii YL, Rocklöv J, Ng N: Short term effects of weather on hand, Foot and Mouth Disease. PLoS One. 2011, 6 (2): e16796-10.1371/journal.pone.0016796.View ArticlePubMedPubMed CentralGoogle Scholar
  10. Wang J, Xu C, Tong S, Chen H, Yang W: Spatial dynamic patterns of hand-foot-mouth disease in the People's Republic of China. Geospatial health. 2013, 7 (2): 381-390.View ArticlePubMedGoogle Scholar
  11. Bland JM, Altman DG: Statistics notes: the odds ratio. BMJ. 2000, 320 (7247): 1468-10.1136/bmj.320.7247.1468.View ArticlePubMedPubMed CentralGoogle Scholar
  12. Wang Y, Feng Z, Yang Y, Self S, Gao Y, Longini IM, Wakefield J, Zhang J, Wang L, Chen X, Yao L, Stanaway JD, Wang Z, Yang W: Hand, foot, and mouth disease in China: patterns of spread and transmissibility. Epidemiology. 2011, 22 (6): 781-792. 10.1097/EDE.0b013e318231d67a.View ArticlePubMedPubMed CentralGoogle Scholar
  13. Ruan F, Yang T, Ma H, Jin Y, Song S, Fontaine RE, Zhu BP: Risk factors for hand, foot, and mouth disease and herpangina and the preventive effect of hand-washing. Pediatrics. 2011, 127 (4): e898-e904. 10.1542/peds.2010-1497.View ArticlePubMedGoogle Scholar
  14. Yao XJ, Hao C, Xu H, Chen C, Zhang HL, Deng YM: Investigation of the risk factors of hand-foot-mouth disease in Changzhou. Acta Universitatis Medicinalis Nanjing (Natural Science). 2010, 30 (9): 1275-1278.Google Scholar
  15. Li ST: Analysis of HFMD epidemiology and risk factors in Hebei district of Tianjin from 2008 to 2009. Port Health Control. 2010, 15 (4): 26-28.Google Scholar
  16. Cao MH, Liu H, Wan JF, Zhu LY: An case–control study of severe case of hand-foot-and-mouth disease (EV71) in Fuyang City, Anhui Province. Anhui J Preventive Med. 2010, 16 (1): 19-20.Google Scholar
  17. Onozuka D, Hashizume M: The influence of temperature and humidity on the incidence of hand, foot, and mouth disease in Japan. Sci Total Environ. 2011, 410: 119-125.View ArticlePubMedGoogle Scholar
  18. Cao Z, Zeng D, Wang Q, Zheng X, Wang F: An epidemiological analysis of the Beijing 2008 Hand-Foot-Mouth epidemic. Chinese Sci Bull. 2010, 55 (12): 1142-1149. 10.1007/s11434-010-0144-0.View ArticleGoogle Scholar
  19. Ma E, Lam T, Wong C, Chuang SK: Is hand, foot and mouth disease associated with meteorological parameters. Epidemiol Infect. 2010, 138 (12): 1779-1788. 10.1017/S0950268810002256.View ArticlePubMedGoogle Scholar
  20. Deng T, Huang Y, Yu S, Gu J, Huang C, Xiao G, Hao Y: Spatial-temporal clusters and risk factors of hand, foot, and mouth disease at the district level in Guangdong province, China. PLoS One. 2013, 8 (2): e56943-10.1371/journal.pone.0056943.View ArticlePubMedPubMed CentralGoogle Scholar
  21. Lin H, Zou H, Wang Q, Liu C, Lang L, Hou X, Li Z: Short-term effect of El Nino-southern oscillation on pediatric hand, foot and mouth disease in Shenzhen, China. PLoS One. 2013, 8 (7): e65585-10.1371/journal.pone.0065585.View ArticlePubMedPubMed CentralGoogle Scholar
  22. Chen C, Lin H, Li X, Lang L, Xiao X, Ding P, He P, Zhang Y, Wang M, Liu Q: Short-term effects of meteorological factors on children hand, foot and mouth disease in Guangzhou, China. Int J Biometeorol. 2013, 57 (6): 1-10.Google Scholar
  23. Conley TG, Topa G: Socio-economic distance and spatial patterns in unemployment. J Appl Econ. 2002, 17 (4): 303-327. 10.1002/jae.670.View ArticleGoogle Scholar
  24. Miller HJ: Tobler's first law and spatial analysis. Ann Assoc Am Geogr. 2004, 94 (2): 284-289. 10.1111/j.1467-8306.2004.09402005.x.View ArticleGoogle Scholar
  25. Li L, Wang J, Wu J: A spatial model to predict the incidence of neural tube defects. BMC Public Health. 2012, 12 (1): 951-10.1186/1471-2458-12-951.View ArticlePubMedPubMed CentralGoogle Scholar
  26. Austin PC, Tu JV: Automated variable selection methods for logistic regression produced unstable models for predicting acute myocardial infarction mortality. J Clin Epidemiol. 2004, 57 (11): 1138-1146. 10.1016/j.jclinepi.2004.04.003.View ArticlePubMedGoogle Scholar
  27. Jeffrey SJ, Carter JO, Moodie KB, Beswick AR: Using spatial interpolation to construct a comprehensive archive of Australian climate data. Environ Model Softw. 2001, 16 (4): 309-330. 10.1016/S1364-8152(01)00008-1.View ArticleGoogle Scholar
  28. Heidenreich PA, Trogdon JG, Khavjou OA, Butler J, Dracup K, Ezekowitz MD, Finkelstein EA, Hong Y, Johnston SC, Khera A: Forecasting the future of cardiovascular disease in the United States a policy statement from the American heart association. Circulation. 2011, 123 (8): 933-944. 10.1161/CIR.0b013e31820a55f5.View ArticlePubMedGoogle Scholar
  29. Augustin NH, Mugglestone MA, Buckland ST: An autologistic model for the spatial distribution of wildlife. J Appl Ecol. 1996, 33: 339-347. 10.2307/2404755.View ArticleGoogle Scholar
  30. Conen D, Wietlisbach V, Bovet P, Shamlaye C, Riesen W, Paccaud F, Burnier M: Prevalence of hyperuricemia and relation of serum uric acid with cardiovascular risk factors in a developing country. BMC Public Health. 2004, 4 (1): 9-10.1186/1471-2458-4-9.View ArticlePubMedPubMed CentralGoogle Scholar
  31. Besag J: Spatial interaction and the statistical analysis of lattice systems. J R Stat Soc Ser B Methodol. 1974, 36 (2): 192-236.Google Scholar
  32. Koutsias N: An autologistic regression model for increasing the accuracy of burned surface mapping using landsat thematic mapper data. Int J Remote Sens. 2003, 24 (10): 2199-2204. 10.1080/0143116031000082073.View ArticleGoogle Scholar
  33. Tsuyuki S: GIS-based modeling of javan hawk-eagle distribution using logistic and autologistic regression models. Biol Conserv. 2008, 141 (3): 756-769. 10.1016/j.biocon.2007.12.030.View ArticleGoogle Scholar
  34. Wu H, Huffer FRW: Modelling the distribution of plant species using the autologistic regression model. Environ Ecol Stat. 1997, 4 (1): 31-48. 10.1023/A:1018553807765.View ArticleGoogle Scholar
  35. Ohlmacher GC, Davis JC: Using multiple logistic regression and GIS technology to predict landslide hazard in northeast Kansas. USA Eng Geol. 2003, 69 (3): 331-343.View ArticleGoogle Scholar
  36. Osborne PE, Alonso JC, Bryant RG: Modelling landscape‐scale habitat use using GIS and remote sensing: a case study with great bustards. J Appl Ecol. 2001, 38 (2): 458-471. 10.1046/j.1365-2664.2001.00604.x.View ArticleGoogle Scholar
  37. He F, Zhou J, Zhu H: Autologistic regression model for the distribution of vegetation. J Agric Biol Environ Stat. 2003, 8 (2): 205-222. 10.1198/1085711031508.View ArticleGoogle Scholar
  38. Lee J: Odds ratio or relative risk for cross-sectional data?. Int J Epidemiol. 1994, 23 (1): 201-203. 10.1093/ije/23.1.201.View ArticlePubMedGoogle Scholar
  39. Schechtman E: Odds ratio, relative risk, absolute risk reduction, and the number needed to treat—which of these should we use?. Value Health. 2002, 5 (5): 431-436. 10.1046/J.1524-4733.2002.55150.x.View ArticlePubMedGoogle Scholar
  40. Schmidt CO, Kohlmann T: When to use the odds ratio or the relative risk?. Int J Public Health. 2008, 53 (3): 165-167. 10.1007/s00038-008-7068-3.View ArticlePubMedGoogle Scholar
  41. Zhang J, Kai FY: What's the relative risk?. JAMA. 1998, 280 (19): 1690-1691. 10.1001/jama.280.19.1690.View ArticlePubMedGoogle Scholar
  42. Graham MH: Confronting multicollinearity in ecological multiple regression. Ecology. 2003, 84 (11): 2809-2815. 10.1890/02-3114.View ArticleGoogle Scholar
  43. Cortina JM: Interaction, nonlinearity, and multicollinearity: Implications for multiple regression. Journal of Management. 1994, 19 (4): 915-922.View ArticleGoogle Scholar
  44. Farrar DE, Glauber RR: Multicollinearity in regression analysis: the problem revisited. Rev Econ Stat. 1967, 49 (1): 92-107. 10.2307/1937887.View ArticleGoogle Scholar
  45. Hayes AF, Matthes J: Computational procedures for probing interactions in OLS and logistic regression: SPSS and SAS implementations. Behav Res Methods. 2009, 41 (3): 924-936. 10.3758/BRM.41.3.924.View ArticlePubMedGoogle Scholar
  46. Tobler WR: A computer movie simulating urban growth in the Detroit region. Econ Geogr. 1970, 46: 234-240.View ArticleGoogle Scholar
  47. Ayalew L, Yamagishi H: The application of GIS-based logistic regression for landslide susceptibility mapping in the kakuda-yahiko mountains. Central Japan Geomorphology. 2005, 65 (1): 15-31.View ArticleGoogle Scholar
  48. Wang J, Liu J, Zhuan D, Li L, Ge Y: Spatial sampling design for monitoring the area of cultivated land. Int J Remote Sens. 2002, 23 (2): 263-284. 10.1080/01431160010025998.View ArticleGoogle Scholar
  49. Tucker DM: Spatial sampling of head electrical fields: the geodesic sensor net. Electroencephalogr Clin Neurophysiol. 1993, 87 (3): 154-163. 10.1016/0013-4694(93)90121-B.View ArticlePubMedGoogle Scholar
  50. Zheng J, Yin Y, Li B: A new scheme for climate regionalization in China. Acta Geograph Sin. 2010, 65 (1): 3-12.Google Scholar
  51. Pope CA, Burnett RT, Thurston GD, Thun MJ, Calle EE, Krewski D, Godleski JJ: Cardiovascular mortality and long-term exposure to particulate air pollution epidemiological evidence of general pathophysiological pathways of disease. Circulation. 2004, 109 (1): 71-77.View ArticlePubMedGoogle Scholar
  52. Pre-publication history

    1. The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/14/358/prepub

Copyright

© Bo et al.; licensee BioMed Central Ltd. 2014

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.

Advertisement