- Research article
- Open Access
Differential impact of non-pharmaceutical public health interventions on COVID-19 epidemics in the United States
BMC Public Health volume 21, Article number: 965 (2021)
The widespread pandemic of novel coronavirus disease 2019 (COVID-19) poses an unprecedented global health crisis. In the United States (US), different state governments have adopted various combinations of non-pharmaceutical public health interventions (NPIs), such as non-essential business closures and gathering bans, to mitigate the epidemic from February to April, 2020. Quantitative assessment on the effectiveness of NPIs is greatly needed to assist in guiding individualized decision making for adjustment of interventions in the US and around the world. However, the impacts of these approaches remain uncertain.
Based on the reported cases, the effective reproduction number (Rt) of COVID-19 epidemic for 50 states in the US was estimated. Measurements on the effectiveness of nine different NPIs were conducted by assessing risk ratios (RRs) between Rt and NPIs through a generalized linear model (GLM).
Different NPIs were found to have led to different levels of reduction in Rt. Stay-at-home contributed approximately 51% (95% CI 46–57%), wearing (face) masks 29% (15–42%), gathering ban (more than 10 people) 19% (14–24%), non-essential business closure 16% (10–21%), declaration of emergency 13% (8–17%), interstate travel restriction 11% (5–16%), school closure 10% (7–14%), initial business closure 10% (6–14%), and gathering ban (more than 50 people) 7% (2–11%).
This retrospective assessment of NPIs on Rt has shown that NPIs played critical roles on epidemic control in the US in the past several months. The quantitative results could guide individualized decision making for future adjustment of NPIs in the US and other countries for COVID-19 and other similar infectious diseases.
Coronavirus disease 2019 (COVID-19), caused by the severe acute respiratory syndrome coronavirus 2 (SARS-COV-2), has become a global pandemic. Currently, the epidemic in the United States (US) is still of serious concern . As of June 27, 2020, there have been 2,596,537 reported cases in the US, with 128,152 deaths . The daily number of reported new cases has recently been rising again after a period of decline. Between February and April, 2020, various non-pharmaceutical public health interventions (NPIs) were adopted in different US states. However, they were occasionally challenged by local governments and the public due to high economic and lifestyle costs [3,4,5]. Notably, since April 20, 2020, all 50 states have been gradually relaxing NPIs. However, due to the lack of data supporting the actual effect of each NPIs, unsuitable policy relaxation may cause an even more serious pandemic. For example, a substantial increase in daily new cases was observed in Texas after the relaxation of stay-at-home on April 30th. Therefore, a retrospective quantitative assessment of the impacts of individual interventions on epidemic control is of great importance. This could assist policymakers and health care providers in making informed decisions on future adjustment of NPIs for COVID-19 and other infectious diseases transmitted via similar routes.
This study leveraged the combined NPIs being executed in different states to estimate the effects of individual NPIs implemented for epidemic containment among US states, including declaration of emergency, school closure, gathering ban (more than 10 or 50 people), initial business closure (e.g., dine-in service and retail), non-essential business closure, interstate travel restriction, wearing face masks, and stay-at-home orders.
The number of reported cases in the US (50 states) from January 21 to May 31, 2020 was collected for this study . Considering the time delay between infection time and reporting time, including an incubation period (assumed to follow a gamma distribution with mean = 5.1 days and SD = 3.0 days ) and a reporting delay (assumed to follow a gamma distribution with mean = 4.9 days and SD = 3.3 days ), the infection epidemic curves were inferred by randomly selecting samples from the two gamma distributions. The total daily number of reported new cases and inferred new infection cases in all 50 states during this period are shown in Fig. 1a, along with the timeline of Federal NPI responses. Due to the fact that states have been gradually relaxing interventions since April 20, 2020, the inferred infection numbers for each state prior to April 20th were used for final estimates of the daily effective reproduction number (Rt). Relationships among these time-related concepts are shown in Supplemental fig. 1a. The method proposed by Thompson R et al.  was applied to estimate the time varying Rt for each state (R software package EpiEstim) from the inferred infection epidemic curves over seven-day sliding windows. The generation time used for the calculation of Rt was obtained from the time lag between the 133 collected infector/infectee pairs through a gamma distribution using maximum likelihood estimation (mean: 5.9, SD: 3.9, Supplemental fig. 1b, Supplemental table 3, R software package R0). To examine the association between Rt and NPIs, the timeline of the most widely executed NPIs for each state from February 29th to April 20th were collected (Fig. 1b, Supplemental table 1, 2). Note that inclusion relations exist for certain selected interventions, meaning that one intervention would be implemented by default if another more aggressive intervention was issued. Here, three such relations were identified: 1) gathering ban (more than 50 people) is included in gathering ban (more than 10 people); 2) initial business closure is included in non-essential business closure; 3) stay-at-home covers all other interventions except for declaration of emergency, interstate travel restriction and wearing (face) masks. The generalized linear model (GLM) with ridge regression for the gamma distribution (glmGamma) was developed to estimate the impacts of different interventions on Rt (R package H2o). For each state, the population density (number of people per square mile) , per capita GDP , median age , testing rate, and testing positive rate  were considered potential confounders. The risk ratios (RRs) of different interventions were then calculated from the coefficients, representing the impact of interventions on Rt.
The infection epidemic curves were first estimated for all 50 states, with consideration of the incubation period and reporting delays, based on the number of daily reported new cases from January 21 to May 31, 2020. The Rt of each state was calculated accordingly, from the first inferred case to April 20th (exemplified by New York (NY) State in Fig. 2a; others in Supplemental fig. 2). Some states started with high Rt values in the early phase that then fell below 1.0 on April 20th (Supplemental fig. 3) after implementation of aggressive NPIs. Taking NY as an example, Rt decreased from 3.25 (95% CI 3.17–3.32) on March 7th (declaration of emergency) to 1.52 (1.50–1.53) on March 22nd (stay-at-home), then fell below 1.0 on April 4th.
When constructing the GLM model for effect estimation, only population density was statistically significant (p < 0.0001), while P-values of the other pre-defined confounders were above 0.1 (per capita GDP 0.45; median age, 0.20; testing rate, 0.87; testing positive rate, 0.35). In the final model, only population density was selected as a confounder. Based on the constructed GLM model (R-squared = 0.79), risk ratios (RRs) of each NPI with respect to Rt were assessed (Fig. 2b). Due to the inclusion relation of some interventions, the actual RR of a more aggressive intervention was recalculated by accumulating the multivariable adjusted RRs of the included interventions (Supplemental table 4). Based on the constructed GLM model, stay-at-home exhibited the lowest RR value of 0.49 (95% CI 0.43–0.54), indicating that the execution of this NPI could reduce the current Rt by about 51% (46–57%). The reduction in Rt generated by wearing (face) masks, gathering ban (more than 10 people), non-essential business closure, and declaration of emergency were 29% (15–42%), 19% (14–24%), 16% (10–21%), and 13% (8–17%), respectively. Interstate travel restriction, school closure, and initial business closure achieved reductions in Rt corresponding to 11% (5–16%), 10% (7–14%) and 10% (6–14%), respectively. Gathering ban (more than 50 people) had the smallest effect (Rt (7, 2–11%) among the nine interventions.
This study quantitatively estimated the impacts of different NPIs on Rt in the US and ranked nine selected interventions in terms of their potential capacities to decrease Rt and control the COVID-19 epidemic. We have demonstrated that the selected nine interventions substantially reduce Rt, which represents control of a COVID-19 outbreak. The analysis in this study reveals which interventions were more effective in controlling epidemics in the US. Stay-at-home produced the greatest reduction in Rt of about 51% (95% CI 46–57%). This covers a series of strong controls for maintaining social distancing, including, but not limited to, restricting gathering sizes to 10 or 50 people and closing initial businesses, non-essential businesses, and schools. As a basic NPI measure, wearing (face) masks was found to reduce Rt by about 29% (15–42%). Some studies have also found that wearing a face mask can be effectively combined with social distancing to flatten the epidemic curve . By integrating 12,710 samples from more than 50 countries in the world, Barasheed et al. found that wearing masks in crowded places could reduce the risk of respiratory infections by 20% . Interstate travel restriction and closing schools were found to moderately reduce Rt by about 11% (5–16%) and 10% (7–14%), respectively, which is in agreement with other studies [15,16,17]. As an empowerment measure for state governments, declaration of emergency could reduce Rt by about 13% (8–17%). Although this is not a specific NPI, we infer that a declaration of emergency not only warns people to maintain social distancing, but also provides more access to medical resources needed to prepare for the epidemic. In summary, we incorporated all nine major NPIs in a single study and further extended our understanding of the effectiveness of various NPIs. This provides comparative insights for decision making and intervention prioritizations.
All 50 US states have initiated reopening in some way since April 20th. However, some states were faced with increasing daily new cases from May to June. The findings of this study are valuable for states in making individualized plans for adjusting interventions to control the epidemic and avoid a potential second wave of cases. For states that currently have Rt > 1.0, relaxation is not recommended  and more NPIs should be re-implemented based on both current Rt and the differential impact of each NPI to reduce Rt. Otherwise, infection rates could rise rapidly, resulting in more severe human health and the economic losses. For states with Rt < 1.0 at present or in the future, it is important to comprehensively evaluate respective NPI impacts on Rt (keeping Rt below 1.0 based on the RRs of our model), infection size, and their burden on the healthcare system. A gradual lifting plan should start with interventions that have a lower impact on Rt (high RRs) and then be extended to more aggressive interventions. As states began gradually relaxing interventions after April 2020, an important follow-up study concerning the impacts of the re-openings of different NPIs after April 20, 2020 is currently being conducted.
This study has several limitations. First, the three parameters for estimating Rt, i.e., incubation time, reporting delay, and generation time, were not estimated using US data due to limited data availability. However, because incubation period estimates are similar across studies [18, 19], we believe this part of the COVID-19 virologic cycle is reasonably independent of the outbreak location. The generation time was estimated based on the data from different countries, including China, Japan, South Korea, Vietnam, Germany, US and Malaysia. This estimate was consistent with those of other studies which applied similar data to the US (mean = 5.12, SD = 4.28) . The distribution of reporting delays among different districts and different time was indeed different from each other. A study in China  found that the empirical mean time from symptom onset to reporting was 4.9 days (SD 3.3) for Beijing, 7.6 days (4.2) for Shenzhen, and 6.3 days (4.4) for Wenzhou. Considering that the distribution from February to April in the US was not obtainable, we assume similar distribution of reporting delay between Beijing and each US state (4.9 days (SD 3.3)), which may cause some bias for the estimation of Rt. We did a sensitivity analysis using the distribution of reporting delays in Shenzhen and Wenzhou to evaluate the possible impacts of the parameter. It showed that the core findings of this study were insensitive to this parameter. The order of the impact of different NPIs remained the same, and the quantitative values were also similar (Supplemental table 5, 6). Second, there are other confounders that have not been taken into account in evaluating the association between Rt and NPIs, such as climate factors and medical resources. Third, variations in the enforcement of NPIs in different states has not been taken into account, as more detailed data are required to quantify their impact. Finally, in this study, it was postulated that the impact of NPIs on Rt would remain fixed over time and the average Rt over a period was used as the response value. Incorporating the time factor into the modeling requires more data on the diversity of policies.
We estimated associations between nine main NPIs and the effective reproduction number (Rt) among 50 states in the US. We found that implementation of NPIs has substantially reduced Rt, shedding light on their effectiveness for epidemic control. The respective impacts of different NPIs on Rt varied; in particular, stay-at-home decreased Rt to the largest extent (51, 95% CI 46–57%) and wearing (face) masks could reduce Rt by about 29% (15–42%). The quantitative effects also provide valuable insight for decision makers in tuning NPIs to mitigate the outbreak of other similar respiratory infectious diseases.
Availability of data and materials
The data used in the study are included in the supplementary material or in the manuscript. The code used in the study are available from the corresponding author on reasonable request. The link of the datasets used in this study are listed below.
Centers for Disease Control and Prevention-Coronavirus Disease 2019 (COVID-19) (open): https://www.cdc.gov/coronavirus/2019-ncov/covid-data/covidview/index.html.
Daily coronavirus cases and deaths in the US (open): https://www.worldometers.info/coronavirus/country/us/.
The number of daily reported cases in the US (open): https://covidtracking.com/api.
Population density by state (open): https://worldpopulationreview.com/states/.
GDP by state (open): https://www.bea.gov/data/gdp/gdp-state.
Median age by state (open): http://www.statsamerica.org/sip/rank_list.aspx?rank_label=pop46&ct=S09. STATSAMERICA-Data Source: US Census Bureau.
Coronavirus disease 2019
Non-pharmaceutical public health interventions
- R t :
The effective reproduction number
Generalized linear model
Severe acute respiratory syndrome coronavirus 2
https://www.cdc.gov/coronavirus/2019-ncov/covid-data/covidview/index.html. Centers for Disease Control and Prevention-Coronavirus Disease 2019 (COVID-19) [Accessed 9 Oct 2020].
https://www.worldometers.info/coronavirus/country/us/. [Accessed 28 June 2020].
Hsiang S, Allen D, Annan-Phan S, Bell K, Bolliger I, Chong T, et al. The effect of large-scale anti-contagion policies on the COVID-19 pandemic. Nature. 2020;584(7820):262–7. https://doi.org/10.1038/s41586-020-2404-8.
Flaxman S, Mishra S, Gandy A, Unwin HJT, Mellan TA, Coupland H, et al. Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe. Nature. 2020;584(7820):257–61. https://doi.org/10.1038/s41586-020-2405-7.
Pan A, Liu L, Wang C, Guo H, Hao X, Wang Q, et al. Association of Public Health Interventions with the epidemiology of the COVID-19 outbreak in Wuhan. China JAMA. 2020;323(19):1915–23. https://doi.org/10.1001/jama.2020.6130.
https://covidtracking.com/api. [Accessed 22 June 2020].
Kraemer MU, Yang C-H, Gutierrez B, Wu C-H, Klein B, Pigott DM, et al. The effect of human mobility and control measures on the COVID-19 epidemic in China. Science. 2020;368(6490):493–7. https://doi.org/10.1126/science.abb4218.
Leung K, Wu JT, Liu D, Leung GM. First-wave COVID-19 transmissibility and severity in China outside Hubei after control measures, and second-wave scenario planning: a modelling impact assessment. Lancet. 2020;395(10233):1382–93. https://doi.org/10.1016/S0140-6736(20)30746-7.
Thompson R, Stockwin J, van Gaalen R, Polonsky J, Kamvar Z, Demarsh P, et al. Improved inference of time-varying reproduction numbers during infectious disease outbreaks. Epidemics. 2019;29:100356. https://doi.org/10.1016/j.epidem.2019.100356.
>https://worldpopulationreview.com/states#statesTable. [accessed 20 Apr 2020].
https://www.bea.gov/data/gdp/gdp-state. [Accessed 20 Apr 2020].
Median age in 2019 http://www.statsamerica.org/sip/rank_list.aspx?rank_label=pop46&ct=S09. STATSAMERICA-Data Source: US Census Bureau [Accessed 9 Oct 2020].
Li T, Liu Y, Li M, Qian X, Dai SY. Mask or no mask for COVID-19: a public health and market study. PLoS One. 2020;15(8):e0237691. https://doi.org/10.1371/journal.pone.0237691.
Barasheed O, Alfelali M, Mushta S, Bokhary H, Alshehri J, Attar AA, et al. Uptake and effectiveness of facemask against respiratory infections at mass gatherings: a systematic review. Int J Infect Dis. 2016;47:105–11. https://doi.org/10.1016/j.ijid.2016.03.023.
Chinazzi M, Davis JT, Ajelli M, Gioannini C, Litvinova M, Merler S, et al. The effect of travel restrictions on the spread of the 2019 novel coronavirus (COVID-19) outbreak. Science. 2020;368(6489):395–400. https://doi.org/10.1126/science.aba9757.
Esposito S, Principi N. School closure during the coronavirus disease 2019 (COVID-19) pandemic: an effective intervention at the global level? JAMA Pediatr. 2020;174(10):921–2. https://doi.org/10.1001/jamapediatrics.2020.1892.
Viner RM, Russell SJ, Croker H, Packer J, Ward J, Stansfield C, et al. School closure and management practices during coronavirus outbreaks including COVID-19: a rapid systematic review. Lancet Child Adolesc Health. 2020;4(5):397–404. https://doi.org/10.1016/S2352-4642(20)30095-X.
Courtemanche C, Garuccio J, Le A, Pinkston J, Yelowitz A. Strong social distancing measures in the United States reduced the COVID-19 growth rate. Health Aff (Millwood). 2020;39(7):1237–46. https://doi.org/10.1377/hlthaff.2020.00608.
Lauer SA, Grantz KH, Bi Q, Jones FK, Zheng Q, Meredith HR, et al. The incubation period of coronavirus disease 2019 (COVID-19) from publicly reported confirmed cases: estimation and application. Ann Intern Med. 2020;172(9):577–82. https://doi.org/10.7326/M20-0504.
Monitoring changes in COVID-19 transmission over time in the United States, March 1, 2020-August 8, 2020.69(33).
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Symptom onset time, reporting time, incubation period, reporting delay, and generation time. a. Illustration of the relationships among the infection time, symptom onset time, reporting time, incubation period, reporting delay, and generation time (serial interval). b. Distribution of the generation time based on gamma distribution. Figure S2. Time varying Rt and inferred infection epidemic curve for the other states. The blue bars represent the daily number of infections, the orange lines show the trends of Rt (standard deviation less than 0.5), and the grey shading refers to the 95% confidence intervals of Rt. The dates range from February 22 (one week before the first state emergency on February 29) to April 20. Figure S3. The value of Rt and the inferred infection number for all the 50 states on April 20.
Execution dates of the selected main NPIs among 50 states in the US from February 29 to April 20, and the dates of staring to relax interventions. Table S2. Source of information for the dates of interventions. Table S3. Dates of symptom onset of infector-infectee pairs. Table S4. Risk Ratios (RR) of each variable to the response variable Rt. Table S5. Risk Ratios (RR) of each variable to the response variable Rt (Shenzhen). Table S6. Risk Ratios (RR) of each variable to the response variable Rt (Wenzhou).
About this article
Cite this article
Liu, X., Xu, X., Li, G. et al. Differential impact of non-pharmaceutical public health interventions on COVID-19 epidemics in the United States. BMC Public Health 21, 965 (2021). https://doi.org/10.1186/s12889-021-10950-2
- Non-pharmaceutical public health interventions
- Reproduction number
- Epidemic control
- The United States