Consumer perceptions of safety in hospitals
© Evans et al; licensee BioMed Central Ltd. 2006
Received: 07 June 2005
Accepted: 22 February 2006
Published: 22 February 2006
Studies investigating adverse events have traditionally been principally undertaken from a medical perspective. The impact that experience of an adverse event has on consumer confidence in health care is largely unknown. The objectives of the study were to seek public opinion on 1) the rate and severity of adverse events experienced in hospitals; and 2) the perception of safety in hospitals, so that predictors of lack of safety could be identified.
A multistage, clustered survey of persons residing in South Australia (2001), using household interviews (weighted n = 2,884).
A total of 67% of respondents aged over forty years reported having at least one member of their household hospitalised in the past five years; with the average being two hospital admissions in five years. Respondents stated that 7.0% (95%CI: 6.2% to 7.9%) of those hospital admissions were associated with an adverse event; 59.7% of respondents (95% CI: 51.4% to 67.5%) rated the adverse event as really serious and 48.5% (95% CI: 40.4% to 56.8%) stated prolonged hospitalisation was required as a consequence of the adverse event. Perception of safety in hospitals was largely affected by the experience of an adverse event; really serious events were the most significant predictor of lack of safety in those aged 40 years and over (RR 2.38; p<0.001).
The experience of adverse events negatively impacted on public confidence in hospitals. The consumer-reported adverse event rate in hospitals (7.0%) is similar to that identified using medical record review. Based on estimates from other studies, self-reported claims of adverse events in hospital by consumers appear credible, and should be considered when developing appropriate treatment regimes.
An adverse event is defined as an unintended injury or complication which results in death, disability or prolonged hospitalisation, and is caused by healthcare management . Studies over the previous two decades have used various strategies to investigate the epidemiology of adverse events; most relate to hospitalised patients and are undertaken from a medical perspective .
Traditionally, the patient perspective on adverse events is obtained through complaints and litigation, which provide a somewhat biased picture, and likely underestimates the number of people dissatisfied with medical care . For example, the elderly who are most at risk of adverse events  are also the least likely to complain . Although patient surveys are increasingly being developed as valid tools to assess many facets of care provision , they are rarely used in investigating adverse events in hospitals.
Consumer surveys undertaken in the US and Australia have canvassed the opinions of adults regarding patient safety issues in health care and experiences of medical error [7–10]. However limitations in survey design have prevented comparison with rates determined from medical record review, the method most often cited to determine adverse event rates. We do not know whether the adverse event rate determined by consumers is congruent with that identified through medical record review undertaken by medical and nursing staff.
The aims of this study were to seek public opinion on:
1. the rate and severity of adverse events experienced in hospitals, using a lay definition, and
2. the perception of safety in hospitals
The data for this study were collected by household-based personal interview between September and November, 2001 . The survey consisted of a multistage, systematic, clustered area sample (based on collector districts used by the Australian Bureau of Statistics in the 1996 Census ) of people aged 18 years or older living in metropolitan Adelaide, South Australia and country centres with a population exceeding 1000 (unweighted n = 2,945, weighted n = 2,884). The person in each household who had most recently had a birthday was interviewed. The survey was designed to have sufficient numbers to achieve a minimum of ± 1.75% accuracy with 95% confidence for any questionnaire item. Consent to participate in the survey was voluntary; no financial incentives were offered and interviewers obtained verbal consent prior to asking any questions of respondents.
To determine the rate and severity of adverse events experienced in hospitals, respondents were asked, 'In the last five years, how many times have you and members of your current household been admitted to hospital?'. If there had been a hospitalisation they were then asked, 'With regard to those hospitals stays, did anything ever go wrong that you thought might have been due to the way the health care was carried out?'. If the respondent answered in the affirmative, they were then directed to rate the severity of the adverse event(s) on a three-point Likert scale of (1) not serious, (2) a little serious and (3) really serious, and whether or not they thought it required extra time in hospital. Details of the total household size were collected from respondents to calculate a household hospital admission rate.
To ascertain public confidence in hospitals, respondents were asked, 'With regard to mistakes made in medical treatment, how safe would you feel being admitted to a public hospital?'. Responses were rated on a four-point Likert scale of (1) very safe, (2) pretty safe, (3) a little unsafe and (4) very unsafe. Respondent demographic details obtained included age, gender, metropolitan/country residence, annual household income, country of birth and Indigenous status (Aboriginal and/or Torres Strait Islander origin).
A descriptive analysis was used to determine the adverse event rate and severity of the adverse event, with categorical variables reported as counts (percentages). To identify those most likely to have experienced an adverse event in their household and predictors of perceived lack of healthcare safety, univariate analyses were undertaken using weighted log binomial generalized linear modelling, followed by multivariate analysis aimed at determining the best joint predictors of safety. The conventional level of p ≤ 0.05 was taken to represent statistical significance.
Demographic profile of the respondent sample (weighted n = 2884), which was weighted by age, sex and geographical region to be comparable with the total population of South Australia in 2000 (n = 1,497,600) .
Annual Household Income (AUD)
Country of birth
From the initial 4,308 households selected randomly, 552 households were not contactable, 590 refused to be surveyed, 158 were either not available/too sick and 63 spoke no English. A total of 2,945 interviews were conducted (weighted n = 2,884), a participation rate of 78.4%. Table 1 shows the demographic profile of the respondents.
1. Consumer-reported adverse event rate and severity
Of the 1,704 households surveyed where the respondent was aged 40 years or more, there were 1,137 (66.7%) where the respondent reported at least one hospital admission for any household member over the previous five years. This equated to 3,410 hospital admissions for all household members over the five year period. There were 11 respondents (6.5% of respondents aged 40 years and over) who did not know whether a household member had been admitted to hospital in the previous five years. Overall, 170 respondents (15.0%) reported that 240/3,410 or 7.0% (95%CI: 6.2% to 7.9%) of hospital admissions were associated with an adverse event over the five year period. When asked to rate the seriousness of the adverse event, 101 respondents (59.7%, 95% CI: 51.4% to 67.5%) rated the adverse event as really serious, and 82 (48.5%, 95% CI: 40.4% to 56.8%) indicated that extra time in hospital was required.
Respondents aged 40 years and over who perceived that an adverse event had occurred to themselves or a household member – univariate analysis.
Adverse event (%)
0.52 – 0.96
0.88 – 1.63
0.80 – 1.69
Country of birth
1.17 – 5.95
0.88 – 1.92
0.67 – 1.88
0.09 – 3.91
0.54 – 2.17
Annual household income (AUD)
0.73 – 1.41
0.59 – 1.69
Respondents aged 40 years and over who perceived that an adverse event had occurred to themselves or a household member – multivariate analysis.
0.40 – 0.84
0.87 – 1.64
0.79 – 1.71
Country of birth
1.02 – 5.53
0.77 – 1.76
0.60 – 1.78
0.09 – 3.64
0.53 – 2.21
Annual household income (AUD)
0.57 – 1.20
0.42 – 1.29
2. Predictors of perceived lack of safety for respondents
Public perceptions of lack of safety in public hospitals – univariate analysis.
Feel unsafe (%)
1.09 – 1.52
0.85 – 1.23
1.04 – 1.38
1.2 6 – 1.87
Country of birth
0.52 – 1.94
0.81 – 1.22
0.88 – 1.50
0.53 – 1.99
0.86 – 1.57
Annual household income
0.88 – 1.22
1.04 – 1.62
Previous hospital-acquired adverse event †
1.89 – 2.67
Severity of that hospital-acquired adverse event †
No adverse event
0.49 – 2.23
A little serious
.1.36 – 2.36
2.27 – 3.25
Public perceptions of lack of safety in public hospitals (respondents aged 40 years and over) – multivariate analysis.
0.61 – 1.03
1.02 – 1.60
1.06 – 1.95
Country of birth
0.18 – 1.40
0.60 – 1.14
0.54 – 1.26
0.03 – 1.47
0.63 – 1.80
Annual household income (AUD)
1.04 – 1.78
0.80 – 1.81
Severity of that hospital-acquired adverse event
No adverse event
0.67 – 2.76
A little serious
1.12 – 2.51
1.85 – 3.07
When people were asked to comment on how safe they felt going to hospital, one in four respondents felt either a little or very unsafe. Respondents aged forty years and over were asked how many times they or household members had been hospitalised in the previous five years. In each household there were on average two hospital admissions over the previous five years. Seven percent of those hospitalisations were associated with an adverse event. People most likely to report an adverse event in the household were aged less than sixty years. Over half of respondents regarded the adverse event as being really serious, and a third indicated that the adverse event had delayed discharge from hospital.
Individual experience of an adverse event or knowledge of a household member who had suffered one while hospitalised had a deleterious impact on consumer confidence in hospitals. The severity of the adverse event was the key factor in determining the extent to which respondents felt unsafe, with serious adverse events leading to approximately a two-fold increase in the likelihood that a person would feel unsafe in public hospitals.
The finding that a significant proportion of respondents felt unsafe attending hospitals may be attributable to a number of factors; people generally present to hospitals in the acute stage of their illness, are usually unfamiliar with the surroundings and personnel, and often receive complex and numerous procedures in a short period of time. People feeling less safe when aware of an adverse event having occurred in their household during a hospital admission is likely due to them having gained a greater understanding of the inherent risks associated with being hospitalised. The finding that people aged less than sixty years were more likely to report an adverse event compared to older respondents is contrary to findings in the literature . It may be that older respondents were less aware of an adverse event occurring than younger people, or more accepting of adverse events as expected complications of their increasingly complex health problems or less likely to complain because they fear recrimination . Results may be biased by the fact that young people are more likely than elderly people to have a larger household size.
Perceived or real past experience of an adverse event occurring to a household member may impact upon the patient-healthcare worker relationship, particularly in terms of patient confidence, and this may, in turn, negatively impact on attendance at follow-up appointments and treatment compliance. Recognising those people most likely to feel unsafe, particularly those who have experienced an adverse event, should assist healthcare providers in understanding human behaviour, thereby enabling management strategies to be developed and individually customised to address these concerns. This might include strategies such as providing hospital in the home services and focusing on early discharge with community support, where appropriate.
The adverse event rate of seven percent identified in this study is within the range of that identified by medical record review, which has estimated that between 2.9%  and 16.6%  of hospital admissions were associated with adverse events. Even the higher rate likely underestimates the true incidence, given that many adverse events are not recorded in medical records , and prospective studies have identified high incidences [17, 18]. Although our survey was applied specifically to hospital-acquired adverse events, other consumer studies have found that adverse events in any setting leads to diminished perceived safety in the healthcare environment [7, 9]
There were several limitations to the study. Firstly, the survey represents self-reported experiences by the public, using lay judgement of what constitutes an adverse event based on their interpretation of the definition provided. Respondents may not have construed this definition in the same way as medical reviewers, who used strict criteria. Secondly, there are inherent risks when using data based on a person's recall, namely limitation of the amount and type of information retained by people over time (recall bias). While respondents might have experienced more than one adverse event for the household, they were only asked to rate one of them. It may be the case that, for those who reported multiple adverse events, only the most severe adverse event was cited, resulting in an overestimate of severity and an underestimate of the adverse event rate. Thirdly, adverse event rates might be underestimated through respondents being unfamiliar with household members' medical history or because errors may have been concealed from them [19, 20].
The findings of this survey are of interest to public health professionals. Given that our consumer estimates of adverse events rates are similar to medical record review, claims of past adverse events by consumers would appear to be credible. If those who feel unsafe attending hospitals are themselves required to be hospitalised, strategies such as pre-admission hospital orientation and early discharge with hospital-in-the home services may assist in allaying fear. These and other strategies need to be considered when developing treatment regimes which best meet consumers' needs.
The authors would like to acknowledge the work of Harrison Health Research and the South Australian Department of Human Services Centre for Population Studies in Epidemiology in conducting the SA Health Omnibus survey. We would also like to thank staff of the Clinical Epidemiology and Health Outcomes Unit, Mr Adrian Heard and Mr Colin McIver for their contribution to the project.
- Wilson RM, Runciman WB, Gibberd RW, Harrison BT, Newby L, Hamilton JD: The Quality in Australian Health Care Study. Med J Aust. 1995, 163 (9): 458-71.PubMedGoogle Scholar
- Karson AS, Bates DW: Screening for adverse events. J Eval Clin Pract. 1999, 5 (1): 23-32. 10.1046/j.1365-2753.1999.00158.x.View ArticlePubMedGoogle Scholar
- Allsop J, Mulcahy L: Doctors' responses to patient complaints. Medical Mishaps: Pieces of the Puzzle. Edited by: Rosenthal MM, Mulcahy L, Lloyd-Bostock S. 1999, Buckingham, UK: Open University PressGoogle Scholar
- Thomas EJ, Brennan TA: Incidence and types of preventable adverse events in elderly patients: population based review of medical records. BMJ. 2000, 320 (7237): 741-4. 10.1136/bmj.320.7237.741.View ArticlePubMedPubMed CentralGoogle Scholar
- Allsop J, Mulcahy L: Dealing with clinical complaints. Clinical Risk Management. Edited by: Vincent CE. 2001, London: BMJ Publishing GroupGoogle Scholar
- Cleary PD: The increasing importance of patient surveys. Now that sound methods exist, patient surveys can facilitate improvement. BMJ. 1999, 319 (7212): 720-1.View ArticlePubMedPubMed CentralGoogle Scholar
- National Patient Safety Foundation at the AMA: Public Opinion of Patient Safety Issues Research Findings. 1997, Louis Harris and Associates, [http://www.npsf.org/download/1997survey.pdf]Google Scholar
- Kaiser Family Foundation/Agency for Healthcare Research and Quality: National Survey on Americans as Health Care Consumers: An update on the role of quality information. 2000, Rockville, MD: Henry J Kaiser Family FoundationGoogle Scholar
- Clark R, Australian Patient Safety Survey: Final Report to the Commonwealth Department of Health and Aged Care. 2001, Canberra, Australia: Commonwealth of Australia, [http://www.participateinhealth.org.au/clearinghouse]Google Scholar
- Blendon RJ, DesRoches CM, Brodie M, Benson MA, Rosen AB, Schneider E, Altman DE, Zapert K, Herrmann MJ, Steffenson AE: Views of practicing physicians and the public on medical errors. N Engl J Med. 2002, 347 (24): 1933-40. 10.1056/NEJMsa022151.View ArticlePubMedGoogle Scholar
- Wilson D, Wakefield M, Taylor A: The South Australian Health Omnibus Survey. Health Promotional J Aust. 1992, 2: 47-9.Google Scholar
- Australian Bureau of Statistics: How Australia takes a census collection. 2001, Canberra, Australia: ABS, (Catalogue no. 2903.0)Google Scholar
- Australian Bureau of Statistics: Estimated Resident Population by Age and Sex in Statistical Local Areas, South Australia. 2001, Canberra, Australia: ABS, (Catalogue no. 3235.4)Google Scholar
- Stata statistical software, Version Release 8.0. 2001, College Station, TX: Stata Corporation
- Thomas EJ, Studdert DM, Burstin HR, Orav EJ, Zeena T, Williams EJ, Howard KM, Weiler PC, Brennan TA: Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000, 38 (3): 261-71. 10.1097/00005650-200003000-00003.View ArticlePubMedGoogle Scholar
- O'Neil AC, Petersen LA, Cook EF, Bates DW, Lee TH, Brennan TA: Physician reporting compared with medical-record review to identify adverse medical events. Ann Intern Med. 1993, 119 (5): 370-6.View ArticlePubMedGoogle Scholar
- Andrews LB, Stocking C, Krizek T, Gottlieb L, Krizek C, Vargish T, Siegler M: An alternative strategy for studying adverse events in medical care. Lancet. 1997, 349 (9048): 309-13. 10.1016/S0140-6736(96)08268-2.View ArticlePubMedGoogle Scholar
- Bellomo R, Goldsmith D, Russell S, Uchino S: Postoperative serious adverse events in a teaching hospital: a prospective study. Med J Aust. 2002, 176 (5): 216-8.PubMedGoogle Scholar
- Leape LL: Error in medicine. JAMA. 1994, 272 (23): 1851-7. 10.1001/jama.272.23.1851.View ArticlePubMedGoogle Scholar
- McIntyre N, Popper K: The critical attitude in medicine: the need for a new ethics. Br Med J (Clin Res Ed). 1983, 287 (6409): 1919-23.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/6/41/prepub