- Research article
- Open Access
- Open Peer Review
Impact of changes in specificity of data recording on cause-specific injury mortality in the United States, 1999–2010
- Guoqing Hu1Email author and
- Keita Mamady1
https://doi.org/10.1186/1471-2458-14-1010
© Hu and Mamady; licensee BioMed Central Ltd. 2014
- Received: 18 June 2014
- Accepted: 22 September 2014
- Published: 27 September 2014
Abstract
Background
We aimed to examine changes in the specificity of data recording and assess the impact on cause-specific injury mortality during 1999–2010.
Methods
A longitudinal study was designed to analyze injury mortality data of 1999-2010. Mortality rates for unspecified injury and for cause-specific injury were obtained using CDC’s Web-based Injury Statistics Query and Reporting System (WISQARS™). The proportion of unspecified injury was used to measure the specificity of injury data recording. We used the proportionate method to adjust data specificity and compared changes in cause-specific mortality before and after adjustment.
Results
Between 1999 and 2010, the age-adjusted mortality from unspecified injuries decreased from 3.4 to 2.5 per 100,000 persons for all ages. The proportion of unspecified unintentional injury decreased from 18.9% to 10.9% for the elderly ages 65+. The proportion of unspecified homicide significantly increased for all age groups except ages 25–44 years. After adjustment, increases in age-adjusted mortality rates from falls, poisoning and drowning were less (77 vs. 61%, 66 vs. 51%, and 9 vs. 0%) and decreases in injuries from motor vehicle crashes, suffocation, fire/burn, and natural/environmental disasters were greater (-30 vs. -37%, -17 vs. -24%, -23 vs. -24%, and -46 vs. -51%), respectively. The adjustment resulted in reversed changes in homicide by firearm (-1 vs. 5%) and cut/pierce (-5 vs. 2%), greater increases in homicide by suffocation (9 vs. 16%) for ages 45–64 years, and smaller decreases in all other age- and cause-specific homicide groups.
Conclusions
During 1999–2010, the specificity of data recording changed significantly for homicide rates and elderly unintentional injury mortality and the changes altered trends in cause-specific injury mortality.
Keywords
- Homicide Rate
- Unintentional Injury
- Motor Vehicle Crash
- Proportionate Method
- Injury Death
Background
Accurate cause-specific injury statistics are essential for defining the severity of the injury problem, identifying and characterizing influencing factors, and developing effective prevention interventions. When detailed medical documents are lacking, cause-specific injury deaths are often recorded by certifiers as “unspecified injuries” [1]. Of the framework for injury mortality data recommended by U.S. CDC, the category “unspecified number of deaths” is defined as injury cases whose mechanisms are not reported on the death certificate [2]. Many deaths coded as ‘unspecified injury’ were found to come from “fracture, cause unspecified”, “unspecified accidents”, “late effects of unspecified accidents” and “assault by unspecified means” [2]. A study in 2012 reported that current fall mortality data for old adults do not appear to identify all instances of falls because of state variations in coding practice [3].
Two recent studies revealed that the latest large increase in fall mortality among persons age 65 years and older was possibly due to improved data reporting [4, 5], strongly indicating that the quality of data recording has changed; this change may affect all cause-specific injury statistics and further influence the evaluation of cause-specific injury interventions. Unfortunately, these two important issues have not been examined so far.
Data quality of public health surveillance systems reflects the completeness and validity of the data recorded in the surveillance system [6]. Indicators including data completeness, sensitivity, specificity, representativeness, positive predictive value, and positive likelihood ratio are often used to reflect the quality of surveillance system data [6–8]. A full assessment of the completeness and validity of surveillance system data often requires collection of external information on surveillance data through a special study (e.g., a review of sample data, special record linkage, or patient interview) [6].
Due to lack of external information on injury deaths (e.g., verbal autopsy data), we cannot systematically examine the quality of injury mortality data. In this case, as Lu et al. described [1], we used the proportion of unspecified injury deaths as a surrogate indicator to approximately reflect the specificity of data recording, which measured the level of sufficiency and specificity of information for injury causes.
Considering that the recording quality of injury deaths on death certificates was reported to vary with age group and injury intent [9], we proposed two research assumptions: 1) the specificity of injury mortality data changed significantly during 1999–2010 and the changes varied with age group and injury intent; and 2) the changing specificity of mortality data between 1999 and 2010 affected cause-specific injury mortality rates and trends in mortality.
We analyzed mortality rates from 1999 to 2010 to examine changes in the specificity of recorded data and assess the impact on trends in cause-specific injury mortality.
Methods
Data source
We obtained mortality rates for unspecified injury and for cause-specific injury using CDC’s Web-based Injury Statistics Query and Reporting System (WISQARS™). WISQARS™ defines “unspecified injuries” using ICD-10 codes: X59 (unintentional); Y09,*U01.9 (homicide); Y35.7 (legal intervention); X84,*U03.9 (suicide); and Y34, Y89.9 (undetermined intent) [10].
Data analysis
a) Changes in specificity of injury mortality data
The proportion of unspecified injury deaths was calculated as “unspecified injury mortality divided by all-injury mortality*100%”. Based on published studies [1, 8], we defined the quality of data specificity as ‘improved’ when the proportion decreased; when the proportion increased, we defined the quality as ‘worsened’.
Based on the results of preliminary analysis that revealed similarity in proportions of unspecified injury for some age groups (not shown here), we divided ages into four groups: 0–24 years, 25–44 years, 45–64 years, and 65+. Because unspecified injuries from legal intervention and with undetermined intent accounted for <8% of all unspecified injuries during 1999–2010, we targeted unspecified injuries of three intent-specific categories: unintentional injury, homicide, and suicide.
Linear regression was used to examine the significance of changes in the proportion of unspecified injury deaths by intent and age group from 1999 to 2010.
b) Relationship between changes in mortality rates from unspecified injuries and from cause-specific injuries
For the groups that had high proportions of unspecified injuries and experienced significant changes in the proportion of unspecified injuries between 1999 and 2010, we plotted stacked bar charts to demonstrate changes in mortality rates from unspecified injuries and from cause-specific injuries and performed Spearman correlation to measure the relationship between them. Suicide was excluded from Spearman rank correlation analysis because of very low proportions of unspecified suicide during 1999–2010 (<0.7%).
Based on preliminary analysis (not shown here), seven major unintentional injury causes (falls, motor vehicle traffic crashes/MVT, suffocation, fire/burn, natural/environmental disaster, poisoning, and drowning) and four common homicide mechanisms (firearm, cut/pierce, suffocation, and struck by or against) were targeted for Spearman rank correlation analysis.
c) Impact of changes in specificity of data recording
Only intent- and age-specific groups showing significant changes in unspecified injury mortality during 1999–2010 in step a) and significant correlations between unspecified injury mortality and specific injury mortality in step b) were chosen for redistribution of unspecified injury mortality. In total, four groups were redistributed, including unintentional injury, 65+; homicide, 0–24 years; homicide, 45–64 years; and homicide, 65 + .
To quantify the impact of changes in specificity of data recording, we first adjusted the proportion of unspecified injuries at different years to the same level. Of 1999–2010, we chose the year having the lowest proportion of unspecified injuries as reference. We assumed that the proportions of unspecified injuries in other years could be lowered to the reference level if the specificity of injury data recording improved.
For the years not having the lowest proportion, we then redistributed the “excess unspecified injuries” to cause-specific injuries using proportionate method. Early studies indicated that the proportionate method was useful for approximately redistributing injuries with unspecific codes to cause-specific injuries [2, 11, 12]. The proportionate method supposes that the “excess unspecified deaths” have similar cause-specific proportions as injuries with cause-specific codes in the same year. We performed the redistribution of “excess unspecified injuries” by age group and intent.
Finally, we compared the percent change in cause-specific mortality between 1999 and 2010 before and after the redistribution. The percent change in mortality was calculated as “(age-adjusted mortality in 2010 – age-adjusted mortality in 1999)/age-adjusted mortality in 1999*100%”.
The data were from CDC’s Web-based Injury Statistics Query and Reporting System (WISQARS™) that does not cover any private information and could be accessed freely at http://webappa.cdc.gov/sasweb/ncipc/mortrate10_us.html. This study was approved by the IRB of the School of Public Health, Central South University (China) to be exempt for review. Data analysis was performed between March 1, 2014 and May 15, 2014.
Results
Changes in specificity of injury mortality data
Age-adjusted mortality /100,000 persons from unspecified injuries by intent (U.S., 1999-2010).
Percent of unspecified injury mortality among all-injury mortality by intent and age group (United States, 1999-2010). A. unintentional injury, B. homicide, C. suicide, 0-24 years.
Linear regression between percent of unspecified injury mortality and year (United States, 1999–2010)
Intent | Age group | b | s b | 95% confidence interval | AdjustedR 2 | |
|---|---|---|---|---|---|---|
Lower limit | Upper limit | |||||
Unintentional | 0-24 years | -0.037* | 0.013 | -0.066 | -0.009 | 0.413 |
25-44 years | -0.077** | 0.011 | -0.101 | -0.053 | 0.816 | |
45-64 years | -0.006 | 0.006 | -0.020 | 0.007 | 0.004 | |
65+ | -0.746** | 0.047 | -0.851 | -0.641 | 0.958 | |
Homicide | 0-24 years | 0.232** | 0.034 | 0.156 | 0.307 | 0.807 |
25-44 years | 0.059 | 0.046 | -0.044 | 0.163 | 0.056 | |
45-64 years | 0.483** | 0.093 | 0.277 | 0.690 | 0.704 | |
65+ | 0.578** | 0.754 | 0.223 | 0.932 | 0.525 | |
Suicide | 0-24 years | -0.010 | 0.012 | -0.038 | 0.018 | -0.031 |
25-44 years | 0.007 | 0.008 | -0.010 | 0.024 | -0.024 | |
45-64 years | 0.011 | 0.008 | -0.006 | 0.028 | 0.091 | |
65+ | 0.001 | 0.008 | -0.017 | 0.020 | -0.097 | |
The proportion of unspecified homicide increased as age increased during 1999–2010. The proportion of unspecified homicide significantly increased for all age groups except ages 25–44 years (Figure 2B, Table 1).
The proportions of unspecified suicide were under 0.7% and fluctuated between 1999 and 2010 for all age groups (Figure 2C, Table 1).
Relationship between changes in mortality rates from unspecified injuries and from cause-specific injuries
Age-adjusted injury mortality /100,000 persons by intent and cause (United States, 1999-2010). A. unintentional injury, age 65+; B. homicide, age 0-24 years; C. homicide, age 45-64 years; D. homicide, ages 65+.
Unspecified homicide was negatively correlated with homicide described as “struck by or against” in age groups 0–24 years and 45–64 years (r s = -0.713 and -0.643), respectively (Figure 3B-D).
Impact of changes in specificity of data recording
Percent change in cause-specific injury mortality/100,000 persons after adjusting unspecified injury (United States, 1999–2010)
Intent/age group | Cause | Unadjusted | Adjusted | ||||
|---|---|---|---|---|---|---|---|
1999 | 2010 | % change in rates | 1999 | 2010 | % change in rates | ||
Unintentional injury, 65+ | Falls | 29.4 | 52.1 | 77% | 32.5 | 52.4 | 61% |
MVT | 21.5 | 15.0 | -30% | 23.8 | 15.1 | -37% | |
Suffocation | 9.9 | 8.2 | -17% | 10.9 | 8.3 | -24% | |
Fire/burn | 3.5 | 2.7 | -23% | 3.7 | 2.7 | -24% | |
Natural/environmental | 2.8 | 1.5 | -46% | 3.1 | 1.5 | -51% | |
Poisoning | 2.0 | 3.4 | 66% | 2.3 | 3.4 | 51% | |
Drowning | 1.2 | 1.3 | 9% | 1.3 | 1.3 | 0% | |
Homicide, 0–24 years | Firearm | 4.4 | 2.7 | -16% | 4.4 | 3.8 | -13% |
Cut/pierce | 0.5 | 0.4 | -11% | 0.5 | 0.4 | -8% | |
Suffocation | 0.2 | 0.1 | -49% | 0.2 | 0.1 | -48% | |
Struck by or against | 0.1 | 0.02 | -83% | 0.1 | 0.02 | -82% | |
Homicide, 45–64 years | Firearm | 2.1 | 2.1 | -1% | 2.1 | 2.3 | 5% |
Cut/pierce | 0.59 | 0.56 | -5% | 0.60 | 0.61 | 2% | |
Suffocation | 0.15 | 0.16 | 9% | 0.15 | 0.18 | 16% | |
Struck by or against | 0.15 | 0.07 | -54% | 0.15 | 0.08 | -51% | |
Homicide, 65+ | Firearm | 0.89 | 0.82 | -8% | 0.91 | 0.88 | -3% |
Cut/pierce | 0.34 | 0.24 | -28% | 0.34 | 0.26 | -25% | |
Suffocation | 0.24 | 0.17 | -32% | 0.25 | 0.18 | -28% | |
Struck by or against | 0.13 | 0.05 | -61% | 0.13 | 0.05 | -59% | |
In contrast, the adjustment resulted in more increases in 2010 than in 1999 for cause-specific homicide rates in age groups 0–24 years, 45–64 years and 65+; this resulted in reversed trends in homicide by firearm (-1 vs. 5%) and cut/pierce (-5 vs. 2%) and greater increases in homicide by suffocation (9 vs. 16%) for ages 45–64 years, and smaller decreases in all other age- and cause-specific homicide (Table 2).
Discussion
As assumed, we found that (1) the specificity of data recording changed distinctly during 1999–2010 and the changes varied with age and intent; (2) changes in specificity of data recording were closely related to changes in mortality rates from some cause-specific unintentional injuries and homicide; and (3) changes in cause specificity affected cause-specific unintentional injury and homicide mortality rates in 1999 and in 2010 and altered trends in cause-specific injury mortality substantially.
These findings have important implications. On the one hand, the results indicate that the specificity of data recording has improved for unintentional injury but worsened for homicide in the last decade. It emphasizes that recent changes in cause-specific injury mortality should be interpreted with caution for age-and intent-specific groups having a high proportion of unspecified injury and experiencing large changes in the specificity of data recording (typically for homicide and elderly unintentional injury). For example, the recently reported increases in injury deaths from falls [13–15] and poisoning [13, 16] were possibly overestimated while the reported decrease in deaths from motor vehicle crashes [13] may be underestimated. The high proportions of unspecified homicide rates among age groups 45–64 years (11-18%) and 65+ (18-27%) also suggest that cause-specific homicide rates may be seriously underestimated for 1999–2010. Encouragingly, the specificity of suicide data has remained at a high level between 1999 and 2010 and unspecified suicide has little impact on cause-specific suicide rates. Variations in specificity between intent-specific groups may reflect differences in coding practice. Dijkhuis et al [9] reported that intentional fatalities were more likely to be investigated by a medical examiner than fatalities from unintentional falls and transportation fatalities among the elderly.
On the other hand, it underscores the value of looking into the quality of injury data recording. Data quality is influenced by the performance of the screening and the case definition for the health-related event, the clarity of hardcopy or electronic surveillance forms, the quality of training and supervision of persons who complete these surveillance forms, and the care exercised in data management [6]. To provide reliable statistics for policy-making, it is necessary to systematically assess the quality of data recording (under-reporting, specificity and misclassification), identify factors influencing the quality of data recording, and develop solutions to improve data quality. At present, it is helpful to quantify the overall impact of changes in data recording on cause-specific injury mortality rates and adjust the reported cause-specific injury mortality rates.
In addition, our findings have potential implications in health resource allocation and utilization, policy evaluation for some other countries and the world. We realize that the quality of mortality statistics has improved in some countries (e.g., China.) but worsened in other countries (e.g., Iraq, Afghanistan and Syria), as the result of socio-economic factors such as economic growth and war. Clearly, changes in data quality (including specificity) can have an effect on health policy-making in these countries, especially for the evaluation of cause-specific health policy changes over time. The potential effect of changes in data quality in these countries further affects the estimation of global mortality statistics, such as the global burden of disease. Unfortunately, the impact of changes in data quality has not been rigorously assessed in countries where data quality improved or worsened. To obtain reliable and valid mortality statistics (not merely injury statistics), it is important for the government of these countries and international organizations such as the World Health organization (WHO) to assess and quantify changes in mortality data quality in the last several decades. Our study is primarily limited by lack of external information on injury deaths. Without the information, we cannot examine the effects of underreporting and misclassification on cause-specific injury mortality. This is critical for generating high-quality injury statistics. Second, we did not assess the impact of specificity changes on injury morbidity. Because of differences in coding practice between mortality data and morbidity data, the impact on injury morbidity data may differ. In addition, we did not analyze changes in specificity within the same injury cause on code-specific injury mortality. Code-specific data provides more details of injury than aggregated cause-specific data. For example, injury from falls includes 20 mechanisms (w00-w19), but the last three categories do not provide the details (w17, other fall from one level to another; w18, other fall on same level; and w19, unspecified fall) [17]. Recent studies reported substantial changes in code-specific fall mortality for the elderly ages 65 + [4, 5].
Conclusions
We conclude that the specificity of data recording changed significantly for homicide rates and elderly unintentional injury mortality rates during 1999–2010 and the changes yielded an important impact on changes in cause-specific injury mortality. Policy-makers and researchers should interpret recent trends in cause-specific injury mortality with caution. Further studies are needed to quantify and adjust the overall impact of changes in data recording (including under-reporting, specificity and misclassification) on reported cause-specific injury statistics, in order to provide high-quality statistics for policy-making.
Declarations
Acknowledgement
This work was supported by the 2009 New Central Scholar Support Grant of Ministry of Education of China (NCET-10-0782) and the China Medical Board (CMB) grant (CMB13-132). We thank Professor Susan P. Baker at Johns Hopkins Bloomberg School of Public Health for valuable suggestion.
Authors’ Affiliations
References
- Lu TH, Walker S, Anderson RN, McKenzie K, Bjorkenstam C, Hou WH: Proportion of injury deaths with unspecified external cause codes: a comparison of Australia, Sweden, Taiwan and the US. Inj Prev. 2007, 13 (4): 276-281. 10.1136/ip.2006.012930.View ArticlePubMedPubMed CentralGoogle Scholar
- Centers for Disease Control and Prevention: Recommended framework for presenting injury mortality data. MMWR Recomm Rep. 1997, 46 (RR-14): 1-30.Google Scholar
- Maresh J, Guse C, Layde P: National trends and coding patterns in fall-related mortality among the elderly in the United States. J Public Health Policy. 2012, 33 (2): 202-214. 10.1057/jphp.2012.6.View ArticlePubMedPubMed CentralGoogle Scholar
- Hu G, Baker SP: An explanation for the recent increase in the fall death rate among older Americans: a subgroup analysis. Public Health Rep. 2012, 127 (3): 275-281.PubMedPubMed CentralGoogle Scholar
- Stevens JA, Rudd RA: Circumstances and contributing causes of fall deaths among persons aged 65 and older: United States, 2010. J Am Geriatr Soc. 2014, 62 (3): 470-475. 10.1111/jgs.12702.View ArticlePubMedPubMed CentralGoogle Scholar
- German RR, Lee LM, Horan JM, Milstein RL, Pertowski CA, Waller MN: Guidelines Working Group Centers for Disease Control and Prevention (CDC). Updated guidelines for evaluating public health surveillance systems: recommendations from the Guidelines Working Group. MMWR Recomm Rep. 2001, 50 (RR-13): 1-35.PubMedGoogle Scholar
- Mitchell RJ, Williamson AM, O'Connor R: The development of an evaluation framework for injury surveillance systems. BMC Public Health. 2009, 9: 260-10.1186/1471-2458-9-260. 10.1186/1471-2458-9-260View ArticlePubMedPubMed CentralGoogle Scholar
- Bhalla K, Harrison JE, Shahraz S, Fingerhut LA: Global burden of disease injury expert group. Availability and quality of cause-of-death data for estimating the global burden of injuries. Bull World Health Organ. 2010, 88 (11): 831-838C. 10.2471/BLT.09.068809.View ArticlePubMedPubMed CentralGoogle Scholar
- Dijkhuis H, Zwerling C, Parrish G, Bennett T, Kemper HC: Medical examiner data in injury surveillance: a comparison with death certificates. Am J Epidemiol. 1994, 139 (6): 637-643.PubMedGoogle Scholar
- Centers for Disease Control and Prevention: National Center for Injury Prevention and Control. Web-based Injury Statistics Query and Reporting System (WISQARS) [online]. 2005, [April 5, 2014]. Available from URL: http://www.cdc.gov/injury/wisqars Google Scholar
- Híjar M, Chandran A, Pérez-Núñez R, Lunnen JC, Martín Rodríguez-Hernández J, Hyder AA: Quantifying the underestimated burden of road traffic mortality in Mexico: a comparison of three approaches. Traffic Inj Prev. 2012, 13 (Suppl 1): 5-10.View ArticlePubMedGoogle Scholar
- Naghavi M, Makela S, Foreman K, O'Brien J, Pourmalek F, Lozano R: Algorithms for enhancing public health utility of national causes-of-death data. Popul Health Metr. 2010, 8: 9-10.1186/1478-7954-8-9. 10.1186/1478-7954-8-9View ArticlePubMedPubMed CentralGoogle Scholar
- Rockett IR, Regier MD, Kapusta ND, Coben JH, Miller TR, Hanzlick RL, Todd KH, Sattin RW, Kennedy LW, Kleinig J, Smith GS: Leading causes of unintentional and intentional injury mortality: United States, 2000–2009. Am J Public Health. 2012, 102 (11): e84-e92. 10.2105/AJPH.2012.300960.View ArticlePubMedPubMed CentralGoogle Scholar
- Alamgir H, Muazzam S, Nasrullah M: Unintentional falls mortality among elderly in the United States: time for action. Injury. 2012, 43 (12): 2065-2071. 10.1016/j.injury.2011.12.001.View ArticlePubMedGoogle Scholar
- Hu G, Baker SP: Recent increases in fatal and non-fatal injury among people aged 65 years and over in the USA. Inj Prev. 2010, 16 (1): 26-30. 10.1136/ip.2009.023481.View ArticlePubMedGoogle Scholar
- Bohnert AS, Fudalej S, Ilgen MA: Increasing poisoning mortality rates in the United States, 1999–2006. Public Health Rep. 2010, 125 (4): 542-547.PubMedPubMed CentralGoogle Scholar
- World Health Organization: International statistical classification of diseases and related health problems - 10th revision. Available at http://apps.who.int/classifications/icd10/browse/2010/en. Accessed at March 5, 2014, 2010
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/14/1010/prepub
Pre-publication history
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
