Predictors of refusal to participate: a longitudinal health survey of the elderly in Australia
© Jacomb et al; licensee BioMed Central Ltd. 2002
Received: 30 October 2001
Accepted: 13 March 2002
Published: 13 March 2002
The loss of participants in longitudinal studies due to non-contact, refusal or death can introduce bias into the results of such studies. The study described here examines reasons for refusal over three waves of a survey of persons aged ≥ 70 years.
In a longitudinal study involving three waves, participants were compared to those who refused to participate but allowed an informant to be interviewed and to those who refused any participation.
At Wave 1 both groups of Wave 2 non-participants had reported lower occupational status and fewer years of education, had achieved lower verbal IQ scores and cognitive performance scores and experienced some distress from the interview. Those with an informant interview only were in poorer physical health than those who participated and those who refused. Depression and anxiety symptoms were not associated with non-participation. Multivariate analyses found that verbal IQ and cognitive impairment predicted refusal. Results were very similar for refusers at both Waves 2 and 3.
Longitudinal studies of the elderly may over estimate cognitive performance because of the greater refusal rate of those with poorer performance. However, there is no evidence of bias with respect to anxiety or depression.
Non-participation in epidemiological studies has the potential to introduce bias into the results of such studies. Lack of participation can come about through noncontact, refusal or death of the respondent. This problem becomes accentuated in longitudinal studies in which non-random attrition can be expected at each wave. In studies of elderly samples, the problem of attrition is accentuated by the increased rate of deaths. Also, such samples may have reasons for refusal which are specific to older age groups. Therefore, it is important to determine the differences between those who take part in survey research and those who do not.
Often, very little is known about those who do not participate in the initial phase of any study although a number of studies have been able to determine sociodemographic differences and even health differences using hospital records. Romans-Clarkson et al. have reviewed the literature on initial non-responders prior to 1988. They found that non-responders are usually older, more often male, of lower socioeconomic status and have less education. They are more likely to smoke, live in urban areas, to have a negative attitude to health surveys and have higher mortality in subsequent years. Their own study, of a random sample of community residing women, found similar results and, by examining hospital records, found no difference in occurrence of physical or psychiatric illness. Similar results for initial refusals have been found in more recent studies [2, 3].
In longitudinal studies much more is known about those who do not participate in second and subsequent waves. Although non-response can be due to death of the respondent, no contact or refusal, not all studies examining non-response at follow-up have made this distinction. Lui & Anthony  found that non-response in an elderly sample one year after initial interview was associated with lower Mini Mental State Examination (MMSE) scores, being older and having fewer years of education. Schaie et al found that non-response in a three wave study over 14 years was associated with lower scores on a number of IQ measures. In a study by Clark et al. of depression in people aged 18 and above, non-response was not associated with depression after accounting for demographic variables. However, only one third of non-responders were refusals, most being no contacts.
Looking specifically at refusals, Eaton et al., in a follow-up of 18–64 year olds from the Epidemiologic Catchment Area (ECA) Program, found that refusers were older, more likely to be married and had lower educational levels than those interviewed. Psychopathology (assessed by either diagnoses or symptoms) was not significantly associated with refusal. Bucholz et al examined refusers amongst an 18–49 year old community sample followed up after 11 years. Refusers were more likely to be male and to have a history of barbiturate abuse or dependence, but were no more likely to be in the problem-drinking, minimal alcoholic group than responders. Studies of elderly refusers have found that they are more likely to be cognitively impaired, to be in poor physical health and to have lower levels of education [9–14].
Of the possible reasons for non-response, refusal is of particular interest because it is amenable to change. The more we know about those who are alive and have been contacted, but refuse to take part, the more likely we are to be able to improve our approach and hopefully lower our refusal rates. The aim of this paper was to examine the relationship of non-response, particularly refusal, to the physical, psychological and cognitive state of elderly participants at subsequent waves of a longitudinal survey.
In 1990–91 a sample of 945 (of 1377 selected) persons drawn from the Electoral Rolls of Canberra and the nearby town of Queanbeyan and representative of the age distribution of this community were interviewed using the Canberra Interview for the Elderly (CIE) . An additional sample of 100 (of 145 selected) residents of Nursing homes and sheltered accommodation were also interviewed. Interviews were sought from both the subject and informant, usually a close relative. The structured interview was administered to the participant by a trained lay interviewer. It was undertaken in the participant's home, taking 1.5 to 2 hours to complete. All interviewing and tests were completed in one visit.
Wave 2 of the study was undertaken at a mean of 3.6 (range 3.3–4.2) years later and Wave 3, at a mean of 4.0 (range 3.7–4.4) years after Wave 2. Refusers at Waves 2 and 3 were divided into two types: those who refused all participation and those who were not interviewed themselves but an interview was achieved with a relative or friend. In most cases where only an informant interview was possible, the respondent was approached, initially, to ask if they would take part. However, in some cases, a spouse or child intercepted the interviewer, decided that the respondent was unable to carry out the interview but offered to be interviewed themselves.
For the purposes of this study, those subjects for whom only an informant interview was obtained at Wave 1 were excluded from the analysis of refusals at Wave 2, while Informant Only interviews at Wave 2 were excluded from analysis of refusal at Wave 3. No attempt was made at Wave 3, to interview anyone who had refused outright at Wave 2.
Physical health was assessed using 1) an Activities of Daily Living (ADL) scale  which asks the participant to rate their ability to perform a range of everyday activities, with answers ranging from "no difficulty" to "unable to do", 2) a measure of the number of chronic illnesses suffered by the respondent, and 3) self-reported measures of sight and hearing impairment. The sight impairment scale and the hearing impairment scale were each comprised of 5 questions, including a general question on how they rated their sight or hearing and 4 questions on sight or hearing problems in 4 different situations. Higher scores mean higher impairment. The Goldberg anxiety and depression scales  were used as indicators of mental health. This scale contains 18 questions, 9 on depression and 9 on anxiety with answer options being "yes" or "no". Cognitive impairment was assessed using the MMSE , a test covering a range of cognitive abilities including orientation for place and time, memory and spatial ability. A higher score for this test indicates better cognitive function. Premorbid IQ was measured by the National Adult Reading Test (NART) . The NART is a measure of verbal IQ and is commonly used to estimate IQ in elderly subjects because it is highly resistant to the effects of ageing and dementia . It involves the participant reading a list of words of increasing difficulty and being assessed on their pronunciation. Personality was assessed only at Wave 1 by extraversion and neuroticism scales from the short form of the Eysenck Personality Questionnaire-Revised , a measure consisting of 24 questions, 12 on extraversion and 12 on neuroticism. DSM-III-R dementia diagnosis was able to be determined from the interview.
At the end of the Wave 1 interview only, participants were asked by the interviewer "Was the questionnaire at all distressing – did some of the questions upset you or make you feel anxious?" with options being "yes", "no" or "don't know". Five percent answered "don't know" or the question had not been asked. This 5% was treated as missing data.
Sociodemographic variables included age, sex, living alone (in community sample only), years of education and previous occupation status (white collar versus blue collar / manual).
Univariate analyses on continuous variables were performed using one way analysis of variance followed by post hoc modified-Least Significant Difference (LSD) tests to compare the participants and refusers. Categorical variables were analysed using chi-square tests. Multivariate analyses were performed using logistic regression with simultaneous entry of predictor variables.
The response rate at Wave 1 was 69%. The only information available on non-responders was their age and sex. Those who refused participation were not significantly different from participants in age. However, significantly more women than men refused to take part. In the community sample the response rate for males was 76% and for females, 62%. In the nursing home sample, the response rates were 75% and 65% for males and females respectively.
Response rates at Wave 2 of those respondents interviewed at Wave 1 and response rates at Wave 3 of those interviewed at Wave 2.
Respondent interviews at previous wave
Informant only interviews
Died since previous wave
Those who were not contacted were people who either could not be found or had moved too far away to be followed up. This group plus those who had died have been omitted from all further analysis.
Refusal at Wave 2
Comparison of participants, those respondents who refused but allowed an informant interview, and those who refused all participation at Wave 2: Means (and SDs) or percentages
Wave 1 variables
Participants n = 560–638
Refused but informant interview n = 22–36
Refused all Participation N = 60–78
Age at Wave 1
Sex (% male)
Years of education
Occupational status (% white collar)
Lives alone (%) *
DSM-III dementia (%)
Distressed by interview (%)
Odds ratios (ORs) (and 95% confidence intervals) from logistic regression where the OR of being 1) a refuser or 2) an informant-only respondent at wave 2 is associated with an increase in the predictor.
Wave 1 Variables
Refusers compared to Participants n-716
Informant-only groups compared to Participants n-674
Sex (males = 1 females = 2)
Years of education *
Occupational status (white collar)
0.95 (0.92 0.98)
Activities of daily living *
Sight impairment scale *
Distressed by interview (no = 1, yes = 2)
Refusal at Wave 3
Refusal at Wave 3 was examined using the same analyses as for refusal at Wave 2. Significant differences between the three groups were found for age, years of education, NART, MMSE and ADL scores. Differences in years of education, NART and ADL scores were essentially the same as for the three Wave 2 groups, while MMSE scores were no different between participants and those refusing any participation but significantly lower in those for whom there was only an informant interview. This latter group was significantly older than the other two groups. Logistic regression comparing participants to outright refusers showed that the only significant predictor was years of education. No individual measure predicted refusal when participants were compared to the Informant Only group, although the block of variables did make a significant contribution.
Change in physical and mental health and cognitive function between Waves 1 and 2 were examined as predictors of refusal at Wave 3. Changes in ADL showed the only significant association, with those providing an informant interview having a greater increase in ADL problems compared to respondents who were interviewed and those who refused any participation.
At the third wave of this longitudinal study of an elderly sample, respondent interviews were achieved for 39% of those originally interviewed. Another 39% had died since Wave 1.
At Wave 2, refusal, for both those who allowed an informant to be interviewed and those who refused any participation, was significantly associated with lower occupational status, fewer years of education, lower verbal IQ scores and poorer cognitive function than participants. These results confirm those of other studies which have examined refusal in the elderly [4, 5, 7, 12, 13]. A number of these studies also report poorer physical health in refusers. However, in this study, only those with an Informant Only interview showed significantly higher disability (ADL) than participants. Also, the Informant Only group were more likely to have had a diagnosis of dementia at the Wave 1 interview. These findings suggest that including an informant interview in the study has enabled us to gather information on those who were too physically frail or cognitively impaired to participate themselves. These are groups that are important to include in any studies of health in the elderly. Unfortunately, those who refused were also more likely to have had a dementia diagnosis.
It is interesting also to consider those characteristics that were not associated with refusal. It has been suggested that psychological state may contribute to non-participation in community studies . While the data presented here can say nothing about initial refusal, at subsequent waves we found no association between depression and anxiety scores at previous waves and refusal. As the measures of current anxiety and depression were taken 4 years prior to refusal at subsequent waves, it may be reasonable to expect no association. However, the trait measure of neuroticism, which is relatively stable over time and highly correlated to depression and anxiety was also found to have no association. Similarly, Baton et al, Norris  and Clark et al did not find any association between non-response and depression symptoms, while Launer  found that non-responders had reported more psychiatric symptoms.
Refusers at Wave 2 were no different in age to those who participated. Some other studies  have found similar results, while refusers in the study by von Strauss et al. were significantly older. This latter study, however, was interviewing people in their mid eighties. At Wave 3 of our study, when the average age of the sample was 84 years, those for whom only an informant interview was achieved were significantly older than those who participated. This present study also found no difference in the proportion of males and females refusing at Waves 2 and 3, although more women refused at the initial approach. Other studies examining refusal at initial approach have found that males are more likely to refuse[1, 8], however these tend to be samples covering the adult age range. Studies of older samples [10, 11] have found little difference in the gender of initial refusers. It is difficult to know why more women than men refused at the initial approach in this study. Reports of follow-up of older samples [4, 9, 13, 22] have found no differences in gender, as was found here.
Multivariate analysis comparing those who refused any participation to those who participated showed that the verbal IQ score was the only significant predictor of refusal. Comparison of those who either refused or had an Informant Only interview found that both IQ and cognitive impairment contributed. However, the ADL score did not contribute significantly in this analysis. This was somewhat surprising as the ADL score, for those with an informant only interview, was more than double that of those who participated.
Of the 44 people who said they felt some distress during the Wave 1 interview, 34 gave reasons; 17 (50%) gave the cognitive section as the reason for their distress, while a further five felt distressed by their inability to understand or answer the questions. A possible limitation of this measure is that some respondents may have been reluctant to admit to any distress to the interviewer and so the results may not be an adequate indicator of distress or discontent about the interview. Nevertheless, people who refused any participation at Wave 2 were more likely to have experienced distress. Von Strauss et al., in a study of attitudes to a longitudinal study, found that those with impaired cognitive functioning and lower education showed the least positive attitude and that the first contact and the cognitive testing were the most stressful part of the study. Similarly, Levin et al.  examined refusal on follow-up in a sample of Parkinson's Disease patients and found that the only significant predictor was cognitive impairment. These authors commented that participants and their spouses were concerned about the development of dementia when contacted at follow-up. As with other studies, this one also found that those who refused had had lower MMSE scores and fewer years of education. One plausible interpretation is that those people who perform poorly on the cognitive tests are aware of this and become distressed by it.
Non-response is a serious issue for survey research, in particular, longitudinal studies in which each wave results in further loss and the possibility of sample bias. In studies of the elderly, loss through death of respondents is inevitable. Kessler et al and, more recently, Dunn , have examined statistical methods to adjust for non-response. These methods depend on the predictors of missingness and the purpose here has been to identify these predictors. These data can then be used for such methods as multiple imputation or Full Information Maximum Likelihood (FIML) estimation. An examination of the predictors of mortality in this sample  found physical ill health, cognitive functioning and being male to be significant predictors. This report has concentrated on those who are alive, have been contacted but refuse to participate.
In conclusion, refusal was predicted by low scores on a verbal IQ test and cognitive impairment, possibly because of distress caused by cognitive testing. It is important that cognitive testing be presented in a non-threatening manner and that participants in the initial wave of such studies be reassured about their performance. However, bias may be reduced by including an informant interview in the study.
This work was supported by grant 973302 from the National Health and Medical Research Council and by a grant from the Australian Rotary Health Research Fund. Help in various phases of the study was provided by Suzanne Dee, Ruth Scott, Susan Lindsay, Colleen Doyle, Karen Maxwell, Andrew Mackinnon and Bryan Rodgers.
- Romans-Clarkson SE, Walton VA, Herbison GP, Mullen P: A study of women who refused to participate in a community survey of psychiatric disorder. Aust N Z J Psychiatry. 1988, 22: 19-29.View ArticlePubMedGoogle Scholar
- Jay GM, Liang J, Liu X, Sugisawa H: Patterns of non-response in a national survey of elderly Japanese. J Gerontol. 1993, 48: S143-152.PubMedGoogle Scholar
- Hébert R, Bravo G, Korner-Bitensky N, Voyer L: Refusal and information bias associated with postal questionnaires and face-to-face interviews in very elderly subjects. J Clin Epidemiol. 1996, 49: 373-381. 10.1016/0895-4356(95)00527-7.View ArticlePubMedGoogle Scholar
- Lui IY, Anthony JC: Using the "Mini-Mental State" examination to predict elderly subjects' completion of a follow-up interview. Am J Epidemiol. 1989, 130: 416-422.Google Scholar
- Schaie KW, Labouvie GV, Barrett TJ: Selective attrition effects in a fourteen-year study of adult intelligence. J Gerontol. 1973, 28: 328-334.View ArticlePubMedGoogle Scholar
- Clark VA, Aneshensel CS, Frerichs RR, Morgan TM: Analysis of non-response in a prospective study of depression in Los Angeles county. Int J Epidemiol. 1983, 12: 193-198.View ArticlePubMedGoogle Scholar
- Eaton WW, Anthony JC, Tepper S, Dryman A: Psychopathology and attrition in the Epidemiologic Catchment Area surveys. Am J Epidemiol. 1992, 135: 1051-1059.PubMedGoogle Scholar
- Bucholz KK, Shayka JJ, Marion SL, Lewis CE, Pribor EF, Rubio DM: Is a history of alcohol problems or of psychiatric disorder associated with attrition at 11-year follow-up?. Ann Epidemiol. 1996, 6: 228-234. 10.1016/1047-2797(96)00002-6.View ArticlePubMedGoogle Scholar
- Mihelic AH, Crimmins EM: Loss to follow-up in a sample of Americans 70 years of age and older: The LSOA 1984–1990. J Gerontol B Psychol Sci Soc. 1997, 52: S37-48.View ArticleGoogle Scholar
- Norton MC, Breitner JCS, Welsh KA, Wyse BW: Characteristics of non-responders in a community survey of the elderly. J Am Geriatr Soc. 1994, 42: 1252-1256.View ArticlePubMedGoogle Scholar
- Launer LJ, Wind AW, Deeg DJH: Non-response pattern and bias in a community-based cross-sectional study of cognitive functioning among the elderly. Am J Epidemiol. 1994, 139: 803-12.PubMedGoogle Scholar
- Hoeymans N, Feskens EJM, Van Den Bos GAM, Kromhout D: Non-response bias in a study of cardiovascular diseases, functional status and self-rated health among elderly men. Age Ageing. 1998, 27: 35-40.View ArticlePubMedGoogle Scholar
- Von Strauss E, Fratiglioni L, Jorm AF, Viitanen M, Winblad B: Attitudes and participation of the elderly in population surveys: data from a longitudinal study on aging and dementia in Stockholm. J Clin Epidemiol. 1998, 51: 181-187. 10.1016/S0895-4356(97)00242-4.View ArticlePubMedGoogle Scholar
- Levin BE, Katzen HL, Klein B, Llabre ML: Cognitive decline affects subject attrition in longitudinal research. J Clin Exp Neuropsychol. 2000, 22: 580-586. 10.1076/1380-3395(200010)22:5;1-9;FT580.View ArticlePubMedGoogle Scholar
- Social Psychiatry Research Unit: The Canberra Interview for the Elderly: a new field instrument for the diagnosis of dementia and depression by ICD-10 and DSM-III-R. Acta Psychiatr Scand. 1992, 85: 105-113.View ArticleGoogle Scholar
- Korten AE, Jorm AF, Jiao Z, Letenneur L, Jacomb PA, Henderson AS, Christensen H, Rodgers B: Health, cognitive, and psychological factors as predictors of mortality in an elderly community sample. J Epidemiol Community Health. 1999, 53: 83-88.View ArticlePubMedPubMed CentralGoogle Scholar
- Goldberg D, Bridges K, Duncan-Jones P, Grayson D: Detecting anxiety and depression in general medical settings. BMJ. 1988, 297: 897-899.View ArticlePubMedPubMed CentralGoogle Scholar
- Folstein MF, Folstein SE, McHugh PR: "Mini-Mental State":A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975, 12: 189-198. 10.1016/0022-3956(75)90026-6.View ArticlePubMedGoogle Scholar
- Nelson HE: National Adult Reading Test (NART): Test Manual. Windsor: NFER-Nelson;. 1982Google Scholar
- Eysenck SBG, Eysenck HJ, Barrett P: A revised version of the psychoticism scale. Pers lndivid Differ. 1985, 6: 21-29. 10.1016/0191-8869(85)90026-1.View ArticleGoogle Scholar
- Henderson AS, Jorm AF, Mackinnon A, Christensen H, Scott LR, Korten AE, Doyle C: The prevalence of depressive disorders and the distribution of depressive symptoms in later life: a survey using draft ICD-10 and DSM-III-R. Psychol Med. 1993, 23: 719-729.View ArticlePubMedGoogle Scholar
- Norris FH: Characteristics of older nonrespondents over five waves of a panel study. J Gerontol. 1985, 40: 627-636.View ArticlePubMedGoogle Scholar
- Kessler RC, Little RJ, Groves RM: Advances in strategies for minimizing and adjusting for survey nonresponse. Epidemiological Rev. 1995, 17: 192-204.Google Scholar
- Dunn G: Compensating for missing data in psychiatric surveys. Epidemiol Psichiatr Soc. 1997, 6: 159-162.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/2/4/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.