Skip to main content

ARIMA and ARIMA-ERNN models for prediction of pertussis incidence in mainland China from 2004 to 2021

Abstract

Objective

To compare an autoregressive integrated moving average (ARIMA) model with a model that combines ARIMA with the Elman recurrent neural network (ARIMA-ERNN) in predicting the incidence of pertussis in mainland China.

Background

The incidence of pertussis has increased rapidly in mainland China since 2016, making the disease an increasing public health threat. There is a pressing need for models capable of accurately predicting the incidence of pertussis in order to guide prevention and control measures. We developed and compared two models for predicting pertussis incidence in mainland China.

Methods

Data on the incidence of pertussis in mainland China from 2004 to 2019 were obtained from the official website of the Chinese Center for Disease Control and Prevention. An ARIMA model was established using SAS (ver. 9.4) software and an ARIMA-ERNN model was established using MATLAB (ver. R2019a) software. The performances of these models were compared.

Results

From 2004 to 2019, there were 104,837 reported cases of pertussis in mainland China, with an increasing incidence over time. The incidence of pertussis showed obvious seasonal characteristics, with the peak lasting from March to September every year. Compared with the mean squared error (MSE), mean absolute error (MAE), and mean absolute percentage error (MAPE) of the ARIMA model, those of the ARIMA-ERNN model were 81.43%, 95.97% and 80.86% lower, respectively, in fitting performance. In terms of prediction performance, the MAE, MSE and MAPE were 37.75%, 56.88% and 43.75% lower, respectively.

Conclusion

The fitting and prediction performances of the ARIMA-ERNN model were better than those of the ARIMA model. This provides theoretical support for the prediction of infectious diseases and should be beneficial to public health decision making.

Peer Review reports

Introduction

Pertussis (whooping cough) is an acute and highly contagious pulmonary disease caused by a small aerobic Gram-negative bacterium, Bordetella pertussis [1]. Pertussis can occur in adults and children, but is often more serious in children, particularly very young infants. Worldwide, pertussis is one of the top ten causes of death during childhood [2]. A 2012 study of pertussis estimated that there were about 30 to 50 million cases and 300,000 deaths per year globally [3], and a 2014 study estimated that there were 24.1 million cases and 160,700 deaths per year globally in children younger than 5 years [4]. In 2018, the WHO estimated that there were approximately 150,000 cases of pertussis worldwide [5]. However, pertussis is often overlooked or misdiagnosed because in many patients it presents with only mild clinical symptoms [6], leading to a possible underestimation of its morbidity [7]. Recent studies of the epidemiology of pertussis reported an epidemic cycle, with increasing numbers of patients every 3 years (on average) [8] in countries such as Canada, Australia, and China [9, 10]. Several other recent studies reported that the incidence of pertussis in China has risen sharply during recent years [11, 12]. In China, for example, the median total economic burden for each case of pertussis in 2017 and 2018 was 8603 Yuan in Yantai (Shangdon) [13], and the average direct economic burden of each inpatient with pertussis in 2019 was 13,291 Yuan in Chongqing[14]. Thus, the resurgence of pertussis is a major financial and public health problem in China.

It is necessary to forecast changes in the morbidity of pertussis so that effective strategies can be implemented for prevention and control, and so that associated health hazards and economic losses can be reduced. There are currently two general types of time series forecasting models that are widely used in epidemiological forecasting. Conventional time series analysis models construct a model using historical data and mainly rely on the linear features of the data; these include the Grey model, Markov model, and autoregressive integrated moving average (ARIMA). A time series may also be analyzed using machine learning theory, in which a model is constructed using an artificial neural network (ANN) to capture the nonlinear features of the data. ARIMA models are the best-known model for time series forecasting, and have been used by many researchers to predict infectious diseases that have characteristic seasonal outbreaks [15]. However, an ARIMA model does not consider nonlinearities in a time series [16].

Given the shortcomings of ARIMA models, there is increasing interest in using ANN models for epidemiological time series forecasting [17] because these models account for nonlinearities in the data. Most of the ANN models used in epidemiological forecasting are based on feed-forward ANNs (static neural networks), such as the back-propagation neural network and the generalized regression neural network. Due to the aggregation and variation of infectious diseases, feed-forward ANNs may not be suitable for analyzing epidemiological data [18]. Unlike feed-forward neural networks, the Elman recurrent neural network (ERNN) can model dynamic information because it uses of additional memory neurons and local feedback [3]. The ability of the ERNN to model dynamic information and its strong sensitivity to time series data thus make it suitable for modeling infectious diseases. Although ANNs can successfully model nonlinear data, they often fail to capture the linear features of the data. Real world time series often contain linear and nonlinear components [19] hence, a model should capture both of these patterns [20]. Therefore, the combined use of an ARIMA model and an ERNN model may provide superior performance [21].

A wide range of epidemiological research has been conducted on pertussis, with most studies focusing on factors that influenced its incidence [22,23,24,25,26]. Very few reports have focused on predicting the incidence of pertussis. Two recent studies used ARIMA to predict the incidence of pertussis. Raycheva R et al. [27] developed an ARIMA (3, 0, 0) model that adequately reflected trends in pertussis incidence and predicted recent disease dynamics with acceptably low errors. Zeng et al. [12] used ARIMA to analyze pertussis data from January 2005 to June 2016 in China; they found that an ARIMA(0,1,0)(1,1,1)12 model showed the best performance. Another study used a seasonal ARIMA model combined with a nonlinear autoregressive network (SARIMA-NAR) model to forecast the incidence of pertussis in China, and found that using this combination of models greatly improved the accuracy of predictions [11]. In this research, we compared the abilities of an ARIMA-ERNN model and an ARIMA model to predict incidence of pertussis in China. We evaluated the performance of these models by calculating the mean squared error (MSE), mean absolute error (MAE), and mean absolute percentage error (MAPE).

Materials and Methods

Data sources

Monthly data on all cases of pertussis from January 2004 to December 2019 in mainland China (excluding Hong Kong, Macao Special Administrative Region, and Taiwan) were obtained from the official website of the Chinese Center for Disease Control and Prevention (China CDC, http://www.chinacdc.cn/). Annual data on cases during the same period were obtained from the National Bureau of Statistics of China (http://www.stats.gov.cn/tjsj/ndsj/). Pertussis is classified as a Class B notifiable disease in China, and has been reported through China's National Disease Report System (NDRS) network since 2004. Detailed criteria for the diagnosis of pertussis (WS 274–2007) were issued by the Chinese Ministry of Health on April 17, 2007 [28].

Seasonal-trend decomposition using loess (STL)

STL can decompose a time series with seasonal characteristics into a long-term trend, a seasonal trend, and random effects. Thus, this method was used to analyze the seasonal characteristics and incidence of pertussis. Based on the monthly incidence rate of pertussis from 2004 to 2019, the original sequence was decomposed into three parts: a long-term trend, a seasonal trend, and a remainder. The STL plot was used to initially identify seasons that had a high incidence of pertussis.

ARIMA Model

Box and Jenkins proposed the ARIMA model as a method for time series analysis and prediction. The basic idea of an ARIMA model is that it treats a data series formed by predicted objects over time as a random sequence. The relationship between these random sequences reflects the extensibility of the development of the predicted objects. This relationship is expressed by mathematical models and used for prediction. Generally, an ARIMA model can be classified as a simple ARIMA (p, d, q) model, a seasonal ARIMA (P, D, Q) S model, and a seasonal-product ARIMA (p, d, q) (P, D, Q) S model, where p, d, q and P, D, Q are the orders of the continuous and seasonal autoregressive terms, difference terms, and moving average terms, respectively. The essence of this model is that it extracts nonstationary deterministic information from a time series by calculating differences. When the residual sequence of an ARIMA model is random (white noise), the model is considered the best linear prediction model for short-term predictions of a time series.

Elman Recurrent Neural Network

The Elman Recurrent Neural Network (ERNN) is a feedback-like (dynamic) neural network proposed by Jeffrey L. Elman and revised by Pham et al. It is a classical nonlinear local recursive network, which consists of an input layer, a hidden layer, a receiving layer, and an output layer. The receiving layer stores the output state of feedback using the delay operator to provide dynamic memorization, so that the system has timely reactions and accurately reflects the dynamics of a system. The self-connection mode of the hidden layer is more sensitive to the time series data. The internal feedback of the ERNN provides dynamic processing of data, and ignores the influence of external noise on the prediction model, thus enabling the model to map nonlinearities with high accuracy.

During the learning process of the ERNN, the dynamics between the input and output parameters are acquired from training data, and stable network parameters are then determined. The ERNN learning algorithm uses rules for error correction. First, input training data is processed through the input layer and the hidden layer, and the input signal is then propagated forward by the output results of the output layer. Then, the error between the predicted and measured values of the output layer is calculated, and if this error exceeds a pre-set threshold, it enters the error back-propagation. The error signals are propagated back to each layer of neurons by a certain form, layer by layer, and the connection weights and threshold matrices of neurons in each layer are updated and modified accordingly.

ARIMA-ERNN Model

First, an optimal ARIMA model was constructed, and information extracted from the original sequence was used to construct an ANN. Second, the predicted values of the ARIMA model and the normalized data of the corresponding time series were used as input data and the normalized real values as the output data to establish an ERNN model that had two-dimensional input and one-dimensional output. Third, the ERNN model used the MSE of the error sequence to evaluate network performance using the continuous learning and training input data and output data. When the MSE was smallest, the ERNN was considered to have the best fit. Fourth, an inverse transformation was performed from the predicted value to establish the combined model. The error of the prediction model was reduced by nonlinear mapping of the ANN, and the advantages of the two models were thus synthesized to improve the prediction accuracy.

Indicators of model performance

The statistical fits and accuracies of prediction of the selected models were measured using three metrics, MSE, MAE, and MAPE, in which smaller values indicated a better model [11, 29].

$$MSE=\frac{1}{N}\sum_{i=1}^{N}{({X}_{i}-{\overline{X} }_{i})}^{2}$$
(1)
$$MAE=\frac{1}{N}\sum_{i=1}^{N}\left|{X}_{i}-{\overline{X} }_{i}\right|$$
(2)
$$MAPE=\frac{1}{N}\sum_{i=1}^{N}\frac{\left|{X}_{i}-{\overline{X} }_{i}\right|}{{X}_{i}}$$
(3)

where \({X}_{i}\) is the actual value at time i, \({\overline{X} }_{i}\) is the predicted value at time i, and N is the number of cases.

Data analysis

Microsoft Excel (2016) was used for data collation and statistical descriptions, and R software (Version 3.6.0) was used for plotting seasonal breakdowns, monthly changes, and time series. The ARIMA model was developed using SAS version 9.4, and the ARIMA-ERNN model was developed using MATLAB version R2019a.

Results

Time Distribution of Pertussis

Changes in Pertussis Incidence

From 2004 to 2019, 104,837 cases of pertussis were reported in mainland China, with an increasing incidence over time (Table 1). Compared with 2004 (4705 cases), the incidence of pertussis was 538% greater in 2019 (30,027 cases).

Table 1 Incidence of pertussis in mainland China from 2004 to 2019

Seasonal Pattern of Pertussis

Analysis of the raw data indicated that the incidence of pertussis had a seasonal pattern with a period of 1 year (Fig. 1, top). Further analysis of these data using STL indicated an obvious seasonal pattern with a long-term trend indicating declining incidence, followed increasing incidence (Fig. 1, middle). The STL method provided a reliable extraction of seasonal information and trend, as indicated by the remainder plot, which showed that the errors were evenly distributed (Fig. 1, bottom).

Fig. 1
figure 1

Seasonal decomposition (STL) of the incidence of pertussis from January 2004 to June 2019

The STL results can only approximate the seasonal characteristics and long-term trend of a disease, and cannot determine the peak season. Thus, we also examined these data as a “monthly plot”, which presents the changing incidence from 2004 to June 2019 during each month (Fig. 2). These results indicated that August had the most reported cases, and the period of March to September had high incidence rates.

Fig. 2
figure 2

Pertussis incidence rates during each month from 2004 to June 2019

ARIMA Model

We developed the ARIMA model using the monthly incidence data of pertussis cases from January 2004 to December 2017 as a training set and the monthly incidence data from January 2018 to June 2019 as a validation set. The raw data indicated a slow decline, followed by a significant increase (Fig. 3).

Fig. 3
figure 3

Monthly incidence of pertussis from 2004 to 2017

The unit root test was used to determine the stationarity of the data. For an alpha level of 0.05, the results of this test showed that the original series was stationary after accounting for the first-order difference and seasonal difference (P < 0.05). We then established an ARIMA model for the adjusted sequence and examined the results using the white noise test (Table 2). These results showed that the adjusted sequence was not a white noise sequence, and that an ARIMA model could be established. Because the original series had a period of 12 months and became stable after accounting for the first-order difference and seasonal difference, we used an ARIMA (p, 1, q) (P, 1, Q) 12 model.

Table 2 White noise test of the adjusted sequence

ARIMA Model Recognition and Order Determination

Next we performed model recognition procedures for the ARIMA model (Fig. 4). In particular, we applied the autocorrelation function (ACF) and partial autocorrelation function (PACF) of the adjusted sequence to determine the values of P, Q, p, and q. A white noise test of the residuals (Table 2) indicated that the information of the fitted model was extracted completely, and that the ARIMA model had parameters of (1,1,1) (0,1,1) 12.

Fig. 4
figure 4

ACF and PACF of differenced pertussis incidence series. ACF, autocorrelation function; PACF, partial autocorrelation function

Model Validation

We then used an ARIMA (1,1,1) (0,1,1) 12 model to predict the incidence of pertussis in mainland China from January 2018 to June 2019. The MSE of this model was 0.00937, indicating high accuracy.

ARIMA-ERNN model

To develop the ARIMA-ERNN model, we first used the fitted values and corresponding times of the seasonal product ARIMA (1,1,1) (0,1,1) 12 model to train the network.

Sample Set Partition

Due to the establishment of an optimal ARIMA model for first-order and seasonal differences, the number of predicted values declined by 13 samples. In the second step, we used data from February 2005 to December 2017 as training data and an internal validation period of January 2017 to December 2017, and then tested the model using external validation for the period of January 2018 to December 2019. The input and output data were normalized, and then network training was carried out using the mapminmax function in MATLAB.

Construction of the ARIMA-ERNN model

The following empirical formula was used to determine the number of neurons in the hidden layer (N):

$$N=\sqrt{n+m}+a$$

where m is the number of neurons in the input layer, n is the number of neurons in the output layer, and a is a constant [1, 10]. According to this calculation, the hidden layer of the ERNN had 3 to 12 neurons. We used a Tan-Sigmoid function for the implicit layer of ERNN, a Purelin function for the output layer, traingdx for the training function, Learngdm for the network weight learning function, and MSE to assess model performance. The parameters of the network were as follows: 10,000 iteration steps, learning rate of 0.01, and learning objective (learning error) of 0.004. We then used an ERNN with a structure of 2–9-1 structure to predict the incidence of pertussis. The MSE of the ARIMA-ERNN model was 0.00077, better than that of the ARIMA model (0.00937).

Model Prediction

Next we used the ARIMA model and the ARIMA-ERNN model to predict the incidence of pertussis in China from July 2019 to June 2021 (Fig. 5), and compared these models by calculating of MSE, MAE, and MAPE (Table 3). All three of these error values were lower for the ARIMA-ERNN model than for the ARIMA model, indicating that the ARIMA-ERNN model performed better.

Fig. 5
figure 5

Predictions of the incidence of pertussis in China from the ARIMA model and the ARIMA-ERNN model. Statistical fits: left of the vertical dashed line; predictions: right of the vertical dashed line

Table 3 Comparison of the performance of the ARIMA and ARIMA-ERNN models

Discussion

The introduction of the pertussis vaccine greatly reduced the threat of this disease. However, a resurgence of pertussis has occurred in many countries, including China, and pertussis remains a challenging public health problem in China and elsewhere. Therefore, the ability to accurately predict the incidence of pertussis would assist in the implementation of appropriate public health interventions. This study compared an ARIMA model with an ARIMA-ERNN model in predicting the incidence of pertussis in mainland China. We found that an ARIMA (1,1,1) (0,1,1) 12 model provided highly accurate predictions of the incidence of pertussis in mainland China from January 2018 to June 2019. This is not consistent with the best ARIMA used in the previous two studies [12, 27], presumably due to the use of data from different years.

In other fields, such as economics and transportation, the ARIMA-ERNN model has been found to provide better predictive accuracy than other models [30, 31]. However, epidemiologists have only rarely used the ARIMA-ERNN model for the prediction of infectious diseases [32]. To the best of our knowledge, the present study constitutes the first use of a combined ARIMA-ERNN model to predict the incidence of pertussis. Compared with the ARIMA model, the statistical fit of our ARIMA-ERNN model had an 81.43% lower MAE, 95.97% lower MSE, and 80.86% lower MAPE, and the model predictions had a 37.75% lower MAE, 56.88% lower MSE, and 43.75% lower MAPE. Thus, the statistical fit and predictions of the combined model were better than those of the single ARIMA model, consistent with previous researches [11, 29]. We attribute these findings to the superior ability of the ARIMA-ERNN model to capture the linear and nonlinear characteristics of the sequence, and to reduce the loss of information. At the same time, the ERNN contains a local topological recursive structure, which makes it more tolerant [20] and provides certain advantages in dynamic modeling compared with a static neural network [3, 33]. We believe that these characteristics of the ERNN give the ARIMA-ERNN model a better ability to characterize the dynamic information in the time series data.

Compared with the results of two other studies [11, 12], our ARIMA-ERNN model also provided better accuracy. The MAPE is the most commonly used measure of model accuracy due to its scale-independency and easy interpretability [34]. Analysis of the statistical fit indicated that the MAPE value of our ARIMA-ERNN model was 76.96% lower than reported for an ETS model and 52.59% lower than reported for a novel wavelet-based SARIMA-NAR hybrid model. This increased prediction accuracy may be due to our use of more monthly data. Specifically, we used 18 months as the forecast set, whereas previous studies [11, 12] used only 6 months as the forecast set. We also calculated the MAPE of the forecast set from January to June 2018 to ensure the accuracy of comparison. Our MAPE was 6.53%, slightly lower than reported in the previous study (6.70%), confirming that our model was more accurate. Thus, our research indicated that the ARIMA-ERNN model was highly effective in predicting the incidence of pertussis, suggesting it may also have potential for predicting the incidence of similar infectious diseases.

The present research indicated that the incidence of pertussis in China did indeed increase, especially during 2018. This is consistent with previous research findings in China [11, 12, 35]. From 2004 to 2013, the incidence of pertussis in China had an overall downward trend. However, after 2014, there was a huge increase up to a rate of 2.15 per 100,000 in 2019, providing an important reminder that pertussis remains a threat in China. Similar to countries such as Canada, the United States, and Australia [36], the recurrence of pertussis has become an increasing problem in China. Previous studies indicated that the appearance of erythromycin-resistant B. pertussis and the evolution of B. pertussis might be the responsible for the increasing incidence in China [35]. In 2013, China completed the switch from the whole-cell pertussis vaccine (DTwP) to the diphtheria tetanus pertussis (DTaP) vaccine. Since 2013, three anti-PT IgG antibody detection kits have been approved in China, and nucleic acid PCR detection reagents were approved in 2019 [37]. We speculate that the change of vaccine type and the increased use of diagnostic testing may have contributed to the increased identification of cases, as in some developed countries [38]. In addition, unlike some developed countries, China does not implement a “cocooning strategy” [39, 40] for immunization and it does not have separate pertussis vaccines for adolescents and adults; these, two factors may also have contributed to the increase in incidence of pertussis. In general, we believe that the resurgence of pertussis cannot be attributed to any single factor, and that further studies are needed to determine the potential reasons for the increasing incidence in China.

We found a significant seasonality in the incidence of pertussis, with the greatest incidence during March to September. This result is consistent with several other studies [11, 12], but the nature of the seasonality of pertussis differs in different regions. For example, Leong et al. reported a peak incidence in Australia during spring and summer (November to January) [41], Guimarães et al. reported a peak incidence in Brazil during spring and autumn [42] and Hitz et al. reported a peak incidence in Germany during summer. Unfortunately, the reasons for the seasonality of pertussis remain mostly unknown. Some seasons may provide a more optimal environment for the pathogen, and the human immune response may also vary with the seasons. Thus, further studies are needed to examine the distribution and survival of B. pertussis and the mechanisms of underlying pathogenic factors [43].

This study had some limitations. All of our primary data were from a national database. Although China classifies pertussis as a Class B statutory infectious disease, the actual incidence of the disease is probably underestimated. Our research predicted the incidence rate for China overall, although there are likely to be large differences in incidence within China due to its large area and many regional differences. Moreover, we were unable to include some factors in our models that may affect the incidence of pertussis because the available data were not comprehensive. Future studies should seek to overcome these limitations.

Conclusion

The present study compared predictions of pertussis incidence in mainland China obtained using an ARIMA model and an ARIMA-ERNN model. The results indicated that an ARIMA-ERNN model should be considered for monitoring the incidence of pertussis in China.

Availability of data and materials

The datasets generated and/or analyzed during the current study are available in the [official website of Chinese Center for Disease Control and Prevention] repository (http://www.chinacdc.cn/) and [National Bureau of Statistics of China] (http://www.stats.gov.cn/tjsj/ndsj/).

References

  1. Della Torre JAG, Benevides GN, Melo AMAG, Ferreira CR. Pertussis: The resurgence of a public health threat. J Autopsy & Case Reports. 2015;5:9–16.

    Article  Google Scholar 

  2. Crowcroft NS, Pebody RG. Recent developments in pertussis. J. Lancet. 2006;367:1926–36.

    Article  PubMed  Google Scholar 

  3. Lai FY, Thoon KC, Ang LW, et al. Comparative seroepidemiology of pertussis, diphtheria and poliovirus antibodies in Singapore: waning pertussis immunity in a highly immunized population and the need for adolescent booster doses[J]. Vaccine. 2012;30(24):3566–71.

    Article  CAS  PubMed  Google Scholar 

  4. Yeung KHT, Duclos P, Nelson EAS, Hutubessy RCW. An update of the global burden of pertussis in children younger than 5 years: a modelling study. Lancet Infect Dis. 2017;17(9):974–80. https://doi.org/10.1016/S1473-3099(17)30390-0.

    Article  PubMed  Google Scholar 

  5. World Health Organization. Home/Health topics/Pertussis. Retrieved from: https://www.who.int/health-topics/pertussis#tab=tab_1.

  6. Mattoo S, Cherry JD. Molecular pathogenesis, epidemiology, and clinical manifestations of respiratory infections due to Bordetella pertussis and other Bordetella subspecies. J Clin Microbiol Rev. 2005;18:326–82.

    Article  CAS  Google Scholar 

  7. Chen CC, et al. Estimated incidence of pertussis in people aged <50 years in the United States. Hum Vaccin Immunother. 2016;12:2536–45.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Cherry JD. The history of pertussis (whooping cough); 1906–2015: facts, myths, and misconceptions. Current epidemiology reports. 2015;2:120–30.

    Article  Google Scholar 

  9. Saadatian-Elahi M, et al. Pertussis: biology, epidemiology and prevention. Vaccine. 2016;34:5819–26.

    Article  PubMed  Google Scholar 

  10. Zhang T, Yin F, Zhou T, Zhang X, Li X. Multivariate time series analysis on the dynamic relationship between Class B notifiable diseases and gross domestic product (GDP) in China. Sci Rep. 2016;6:1–10.

    Article  Google Scholar 

  11. Yongbin, et al. Time series modeling of pertussis incidence in China from 2004 to 2018 with a novel wavelet based SARIMA-NAR hybrid model. Plos One. 2018;13(13):e0208404.

    Google Scholar 

  12. Zeng Q, Li D, et al. Time series analysis of temporal trends in the pertussis incidence in Mainland China from 2005 to 2016. Sci Rep. 2016;6:32367.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Weihong Cui, Na Li, Yaming Zheng, et al. The economic burden of pertussis in Yantai city, 2017–2018. Chinese Journal of Vaccines and Immunization. 2020;26(3):293–5 305.

    Google Scholar 

  14. ShangTingTing. Analysis of the economic burden of pertussis. Journal of Modern Medicine. 2019;35(23):3679–81.

    Google Scholar 

  15. Masum S, Liu Y, Chiverton J. Comparative analysis of the outcomes of differing time series forecasting strategies. 2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD); 2017. p. 1964–8. https://doi.org/10.1109/FSKD.2017.8393069.

  16. Zhang GP. Time series forecasting using a hybrid ARIMA and neural network model. J Neurocomputing. 2003;50:159–75.

    Article  Google Scholar 

  17. Fei Y, Li WQ. Improve artificial neural network for medical analysis, diagnosis and prediction. J J Crit Care. 2017;40:293.

    Article  PubMed  Google Scholar 

  18. Zhang J, Nawata K. A comparative study on predicting influenza outbreaks. Biosci Trends. 2017;11(5):533–41. https://doi.org/10.5582/bst.2017.01257.

    Article  PubMed  Google Scholar 

  19. Panigrahi S, Behera HS. A hybrid ETS–ANN model for time series forecasting. J Eng Appl Artif Intel. 2017;66:49–59.

    Article  Google Scholar 

  20. Zhang XALY. Comparative Study of Four Time Series Methods in Forecasting Typhoid Fever Incidence in China. J Plos One. 2013;8:1–11.

    CAS  Google Scholar 

  21. Wang YW, Shen ZZ, Jiang Y. Comparison of autoregressive integrated moving average model and generalised regression neural network model for prediction of haemorrhagic fever with renal syndrome in China: a time-series study. J Bmj Open. 2019;9: e25773.

    Google Scholar 

  22. de Greeff SC, et al. Seasonal patterns in time series of pertussis. Epidemiology & Infection. 2009;137:1388–95.

    Article  Google Scholar 

  23. Leong RNF, Wood JG, Turner RM, Newall AT. Estieasonal patterns in time series of pustralian pertussis notifications from 1991 to 2016: evidence of spring to summer peaks. J Epidemiol Infect. 2019;147: e155.

    Article  CAS  Google Scholar 

  24. Marchi S, et al. Pertussis over two decades: seroepidemiological study in a large population of the Siena Province, Tuscany Region. Central Italy J Bmj Open. 2019;9: e32987.

    Google Scholar 

  25. Bento A, Riolo M, Choi Y, King A, Rohani P. Core pertussis transmission groups in England and Wales: A tale of two eras. J Vaccine. 2018;36:1160–6.

    Article  Google Scholar 

  26. Von K O Nig CW, et al. Factors influencing the spread of pertussis in households. Eur J Pediatr. 1998;157:391–4.

    Article  Google Scholar 

  27. Raycheva R, Stoilova Y, Kevorkyan A, Rangelova V. Epidemiological Prognosis of Pertussis Incidence in Bulgaria. Folia Med (Plovdiv). 2020;62(3):509–14. https://doi.org/10.3897/folmed.62.e49812.

    Article  Google Scholar 

  28. National Health Commission of the PRC , 2007. Pertussis Diagnostic Criteria. Available at: http://www.nhc.gov.cn/wjw/s9491/201410/52040bc16d3b4eecae56ec28b3358666.shtml. Accessed May 23, 2022. [Google Scholar] [Ref list]

  29. Zhai M, Li W, Tie P, et al. Research on the predictive effect of a combined model of ARIMA and neural networks on human brucellosis in Shanxi Province, China: a time series predictive analysis. BMC Infect Dis. 2021;21(1):280. Published 2021 Mar 19. doi:https://doi.org/10.1186/s12879-021-05973-4

  30. MATROUSHI S. Hybrid computational intelligence systems based on statistical and neural networks methods for time series forecasting: the case of gold price. J Lincoln University; 2011. https://hdl.handle.net/10182/3986.

  31. Qian Y, et al. Forecasting deaths of road traffic injuries in China using an artificial neural network. J Traffic Injury Prevention. 2020;21:407–12.

    Article  Google Scholar 

  32. Zheng Y, Zhang L, Zhu X, Guo G. A comparative study of two methods to predict the incidence of hepatitis B in Guangxi, China. Plos one. 2020;15:e0234660.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  33. Lin FJ, Lee SY, Chou PH. Intelligent nonsingular terminal sliding-mode control using MIMO elman neural network for piezo-flexural nanopositioning stage. IEEE Transactions on Ultrasonics Ferroelectrics & Frequency Control. 2012;59:2716.

    Article  Google Scholar 

  34. Kim S, Kim H. A new metric of absolute percentage error for intermittent demand forecasts. J International Journal of Forecasting. 2016;32:669–79.

    Article  Google Scholar 

  35. Zhang Y, et al. Resurgence of pertussis infections in Shandong, China: space-time cluster and trend analysis. The American journal of tropical medicine and hygiene. 2019;100:1342–54.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Kim C, Yi S, Cho SI. Recent increase in pertussis incidence in Korea: an age-period-cohort analysis. Epidemiol Health. 2021;43: e2021053. https://doi.org/10.4178/epih.e2021053.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Chinese Preventive Medicine Association, Chapter on Vaccines and Immunization. Expert consensus on the China Pertussis Initiative [J]. Chinese Journal of Applied Clinical Pediatrics,2021,36(11):801–810. DOI:https://doi.org/10.3760/cma.j.cn101070-20210308-00273.

  38. Spokes PJ, Quinn HE, McAnulty JM. Review of the 2008–2009 pertussis epidemic in NSW: notifications and hospitalisations. NSW Public Health Bull. 2010;21:167–73.

    Article  Google Scholar 

  39. Australian Technical Advisory Group on Immunisation (ATAGI). The Australian Immunisation Handbook. 10th ed. Canberra: ACT: Australian Government Department of Health; 2017.

    Google Scholar 

  40. Amirthalingam G, et al. Effectiveness of maternal pertussis vaccination in England: an observational study. J The Lancet. 2014;384:1521–8.

    Article  Google Scholar 

  41. Leong RNF, Wood JG, Turner RM, Newall AT. Estimating seasonal variation in Australian pertussis notifications from 1991 to 2016: evidence of spring to summer peaks. J Epidemiol Infect. 2019;147: e155.

    Article  CAS  Google Scholar 

  42. Guimarães LM, Carneiro ELND, Carvalho-Costa FA. Increasing incidence of pertussis in Brazil: a retrospective study using surveillance data. BMC infectious diseases. 2015;15:442.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Bhatti MM, et al. Eight-year review of Bordetella pertussis testing reveals seasonal pattern in the United States. Journal of the Pediatric Infectious Diseases Society. 2017;6:91–3.

    PubMed  Google Scholar 

Download references

Acknowledgements

We sincerely express our gratitude to all participants.

Funding

This work was supported by the “Wuhan Institute of Biological Products Co, Ltd: The evaluation on the immune effect of pertussis” and “Research on Pertussis Cases and Intention to accept Pertussis Cocooning Vaccination in Families of Guizhou”.

Author information

Authors and Affiliations

Authors

Contributions

W.W. and Y.W. conceived the research. J.P., M.L., S.C., L.L. and Z.L. collected and analyzed the data. M.W., X.L., H.C., F.J. and L.Z. wrote the manuscript. W.W., Y.W. and Q.Z. supervised the research and reviewed the manuscript. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Weibing Wang or Ying Wang.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Medical Research Ethics Committee, School of Public Health, Fudan University. All authors confirm that the study methods were carried out in accordance with the relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, M., Pan, J., Li, X. et al. ARIMA and ARIMA-ERNN models for prediction of pertussis incidence in mainland China from 2004 to 2021. BMC Public Health 22, 1447 (2022). https://doi.org/10.1186/s12889-022-13872-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-022-13872-9

Keywords