Less healthy, but more active: Opposing selection biases when recruiting older people to a physical activity study through primary care
BMC Public Health volume 8, Article number: 182 (2008)
Physical activity studies in older people experience poor recruitment. We wished to assess the influence of activity levels and health status on recruitment to a physical activity study in older people.
Comparison of participants and non-participants to a physical activity study using accelerometers in patients aged ≥ 65 years registered with a UK primary care centre. Logistic regression was used to calculate odds ratios (OR) of participants in the accelerometer study with various adjustments. Analyses were initially adjusted for age, sex and household clustering; the health variables were then adjusted for physical activity levels and vice versa to look for independent effects.
43%(240/560) participated in the physical activity study. Age had no effect but males were more likely to participate than females OR 1.4(1.1–1.8). 46% (76/164) of non-participants sent the questionnaire returned it. The 240 participants reported greater physical activity than the 76 non-participants on all measures, eg faster walking OR 3.2(1.4–7.7), or 10.4(3.2–33.3) after adjustment for health variables. Participants reported more health problems; this effect became statistically significant after controlling for physical activity, eg disability OR 2.4(1.1–5.1).
Physical activity studies on older primary care patients may experience both a strong bias towards participants being more active and a weaker bias towards participants having more health problems and therefore primary care contact. The latter bias could be advantageous for physical activity intervention studies, where those with health problems need targeting.
Physical activity studies on older people often recruit through primary care, such studies usually report low participation, both for surveys (46% , 57% ) and more markedly for intervention studies (26% , 32% , 35% ). Information about non-participants is lacking, but higher activity levels have been associated with increased recruitment [4, 5], leading to potential selection bias and difficulties in generalizing results . Unfortunately, these studies did not report on non-participants' health status. Whilst older people with higher activity levels tend to be healthier , recruiting through primary care could encourage those with more illnesses and primary care contact to respond, leading to bias in an opposing direction. Our objective was to compare the self-reported health status and physical activity levels of participants and non-participants in a primary care based physical activity study.
As part of a randomized controlled trial of different recruitment strategies to a physical activity study, 560 patients ≥ 65 years registered with a primary health care centre (general practice) in Oxfordshire, UK were randomly selected by household . Those living in care homes, those with dementia, terminal illness, poorly controlled cardiac failure or unstable angina and those housebound due to disability were first excluded by computer record search and by general (family) practitioner and district (community) nurse examination of registered patient lists. All 560 patients were invited to take part in a study measuring customary physical activity levels objectively for a 7-day period using motion sensors (accelerometers and pedometers). A random half (280) also received a 12-page questionnaire with their study information, asking details about physical health (general health, limiting longstanding illness , disability , pain , chronic disease , smoking status, weight and height), depressive symptoms , self-reported physical activity levels [14, 15] and attitudes towards physical activity  (See Additional file 1). Subjects were encouraged to return the questionnaire, whether or not they participated in the physical activity study, thus allowing a comparison of participants and non-participants. Those participating who had not been randomized to receive a questionnaire, completed one at their baseline assessment.
Ethical approval & informed consent
Ethics committee approval for the study was given by Oxfordshire REC A (reference no. 06/Q1604/94). The patient information sheets sent to all 560 individuals explained the study in detail, including the use of questionnaire information provided by those returning questionnaires, but not wanting to participate further. Full informed written consent was obtained from the 240 participating in the physical activity study.
Logistic regression was used to estimate odds ratios for participating in the accelerometer study, adjusting for age and sex as appropriate and household clustering, using the cluster option in STATA 9 . For age and sex comparisons the analyses were based on all 520 subjects. For analyses examining health and physical activity from the brief questionnaire, the comparison was based on all participants to the accelerometer study and those non-participants who received a questionnaire and returned it. Analyses were adjusted for age, sex and household clustering. Health measures were adjusted additionally for the effect of physical activity (walking pace and number of hours walked in the last week) and physical activity measures for the effect of health (limiting long-standing illness, number of chronic diseases, disability, falls and chronic pain) in order to see whether any effects were independent. To check that it was reasonable to combine postal questionnaires on participants with those completed at baseline assessment, a comparison of participants and non-participants as above was repeated, restricted to those randomised to postal questionnaires.
Recruitment rate to the physical activity study was 43%(240/560). Comparison overall of participants (n = 240) and non-participants (n = 320), adjusted for age, sex and household clustering, showed that males were more likely to participate OR 1.4(95% C.I. 1.1–1.8). There was no statistically significant association between age and participating, baseline age 65–69 OR = 1, age 70–79 OR 0.8(95% C.I. 0.5–1.1), age = 80 OR 0.8(95% C.I. 0.5–1.4).
Of the 280 people sent a postal questionnaire, 116 were recruited to the study and 164 were not, of these non-participants 76/164(46%) completed the questionnaire (see Figure 1). Table 1 shows the comparison of participants (n = 240) (116 from the postal questionnaire group, 124 who completed the questionnaire at baseline assessment) and non-participants (n = 76) who returned the questionnaire. The results for age and sex are very similar to those for participants and non-participants overall.
After adjusting for age, sex and household clustering, participants tended to report more health problems than non-participants for most variables, (but no differences were statistically significant at p = 0.05). The exceptions were: use of a walking aid which showed a non-significant effect in the opposite direction; and depression score which was unrelated to participation. Adjusting for self-reported physical activity levels strengthened the associations between poorer health and participating such that those reporting limiting longstanding illness, disability, chronic pain, chronic disease and a fall in the last year were more likely to participate.
After adjusting for age, sex and household clustering, participants reported more physical activity than non-participants for all measures and more positive attitudes towards physical activity. Apart from cycling and dog-walking, where numbers were small, these differences were all statistically significant and several showed dose-response effects. Adjusting these estimates for self-reported health strengthened these effects still further.
Analyses restricted to participants (116) and non-participants (76) who returned the postal questionnaire showed very similar findings in terms of effect estimates to those presented, based on all questionnaire completers. Although the confidence intervals were wider due to smaller numbers, several associations with participation reached statistical significance at p = 0.05 for both health, e.g. disability, adjusted OR 2.4 (05% C.I. 1.1–5.5) and physical activity variables, e.g. higher activity levels than others, adjusted OR 3.1 (95% C.I. 1.1–8.7).
Recruitment to our motion sensor activity study was 43%, higher than for physical activity intervention studies in this age group [2–4], but lower than for surveys [1, 2]. With this recruitment level, estimation of potential non-response bias is important.
Our findings suggest two separate issues leading to potential bias. Firstly, participants were more physically active than non-participants (consistent with men being more likely to participate). This has been reported in other physical activity studies in older people [3–5]. Secondly, participants reported more health problems than non-participants. This effect opposes the physical activity effect, and was much clearer after controlling for self-reported physical activity. At first, these findings seem counter-intuitive. Other studies in older people have reported that participants have better health than non-participants [18–20], suggesting a "healthy volunteer" effect, although Ives et al found participants were more likely to have a disease history and use health services more . However, it seems plausible that recruiting older people to studies through primary care may lead to those with increased contact with primary care (ie more illnesses) to be more likely to take part. This fits with other work showing that older primary care patients with poorer physical and psychological health and greater primary care service use were more likely to give consent for their health records to be accessed for research . Unfortunately, the other primary care based studies showing differences in physical activity levels between participants and non-participants did not report on health or functional ability [3–5].
An important weakness of our study was that self-reported health and physical activity details were only available on those non-participants who completed the questionnaire. The similarities seen in age and sex comparisons between participants and non-participants overall and in those responding to the questionnaire is reassuring and suggests that the non-participant questionnaire responders are representative of non-participants, at least in terms of age and sex, although they could still differ in other important ways (such as activity level or health) that we lack information on. The similarities found when restricting analyses to only those sent postal questionnaires, confirms that it was reasonable to include participants in the analysis who completed the questionnaire at their baseline assessment.
Physical activity studies on older people recruited from primary care settings may be biased by two opposing issues which need consideration when generalizing the results: a strong bias towards participants being more physically active, and a weaker bias towards participants having more health problems and therefore likely primary care contact. This latter bias could be used to advantage when considering interventions to increase physical activity, where those who are least active and those with more physical health problems need targeting most.
Crombie IK, Irvine L, Williams B, et al: Why older people do not participate in leisure time physical activity: a survey of activity levels, beliefs and deterrents. Age Ageing. 2004, 33: 287-92. 10.1093/ageing/afh089.
Stevens W, Hillsdon M, Thorogood M, McArdle D: Cost-effectiveness of a primary care based physical activity intervention in 45–74 year old men & women: a randomised controlled trial. Br J Sports Med. 1998, 32: 236-41.
Munro JF, Nicholl JP, Brazier JE, Davey R, Cochrane T: Cost effectiveness of a community based exercise programme in over 65 year olds: cluster randomised trial. J Epidemiol Community Health. 2004, 58: 1004-10. 10.1136/jech.2003.014225.
Halbert JA, Silagy CA, Finucane P, Withers RT, Hamdorf PA: Recruitment of older adults for a randomized, controlled trial of exercise advice in a general practice setting. J Am Geriatr Soc. 1999, 47: 477-81.
Crombie IK, McMurdo ME, Irvine L, Williams B: Overcoming barriers to recruitment in health research: concerns of potential participants need to be dealt with. BMJ. 2006, 333: 398-10.1136/bmj.333.7564.398.
Tai SS, Gould M, Iliffe S: Promoting healthy exercise among older people in general practice: issues in designing and evaluating therapeutic interventions. British Journal of General Practice. 1997, 47: 119-22.
Ettinger WH: Physical activity and older people: a walk a day keeps the doctor away. J Am Geriatr Soc. 1996, 44: 207-8.
Harris TJ, Victor CR, Carey IM, Adams R, Cook DG: Optimising recruitment into a study of physical activity in older people: a randomised controlled trial of different approaches. Age & Ageing. 2008,
Joint Health Surveys Unit: Health Survey for England 1998. Methodology and Documentation. 1999, London, The Stationery Office, 2:
McGee MA, Johnson A, Kay D: The Medical Research Council Cognitive Functioning and Ageing Study (MRC CFAS). The description of activities of daily living in five centres in England and Wales. Age & Ageing. 1998, 27: 605-13. 10.1093/ageing/27.5.605.
Ware JE, Sherbourne CD: The MOS 36-item short form health survey: conceptual framework and item selection. Med Care. 1992, 30: 473-83. 10.1097/00005650-199206000-00002.
Roberts RE, Kaplan GA, Shema SJ, Strawbridge WJ: Prevalence and correlates of depression in an aging cohort: the Alameda County Study. J Gerontol B Psychol Sci Soc Sci. 1997, 52: S252-S258.
D'Ath P, Katona P, Mullan E, Evans S, Katona C: Screening, detection and management of depression in elderly primary care attenders. I: The acceptability and performance of the 15 item Geriatric Depression Scale (GDS15) & the development of short versions. Fam Pract. 1994, 11: 260-6. 10.1093/fampra/11.3.260.
Caspersen CJ, Bloemberg BP, Saris WH, Merritt RK, Kromhout D: The prevalence of selected physical activities and their relation with coronary heart disease risk factors in elderly men: the Zutphen Study, 1985. Am J Epidemiol. 1991, 133: 1078-92.
Washburn RA, Smith KW, Jette AM, Janney CA: The Physical Activity Scale for the Elderly (PASE): development and evaluation. J Clin Epidemiol. 1993, 46: 153-62. 10.1016/0895-4356(93)90053-4.
Jette AM, Rooks D, Lachman M, Lin TH, Levenson C, Heislein D, et al: Home-based resistance training: predictors of participation and adherence. Gerontologist. 1998, 38: 412-21.
STATA 9.0 Statistics/Data Analysis. 2005, College Station, Texas, USA, Statacorp
van Heuvelen MJ, Hochstenbach JB, Brouwer WH, de Greef MH, Zijlstra GA, van Jaarsveld E, et al: Differences between participants and non-participants in an RCT on physical activity and psychological interventions for older persons. Aging Clin Exp Res. 2005, 17: 236-45.
Hebert R, Bravo G, Korner-Bitensky N, Voyer L: Refusal and information bias associated with postal questionnaires and face-to-face interviews in very elderly subjects. J Clin Epidemiol. 1996, 49: 373-81. 10.1016/0895-4356(95)00527-7.
Wagner EH, Grothaus LC, Hecht JA, LaCroix AZ: Factors associated with participation in a senior health promotion program. Gerontologist. 1991, 31: 598-602.
Ives DG, Traven ND, Kuller LH, Schulz R: Selection bias and non-response to health promotion in older adults. Epidemiology. 1994, 5: 456-61.
Harris T, Cook DG, Victor C, Beighton C, DeWilde S, Carey I: Linking questionnaires to primary care records: factors affecting consent in older people. J Epidemiol Community Health. 2005, 59: 336-8. 10.1136/jech.2004.025296.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/8/182/prepub
We are grateful to all the partners, staff and patients of Sonning Common Health Centre, Oxfordshire, UK for their support with this study. Funding for the study was provided by the Thames Valley Primary Care Research Partnership (WCRM03). The sponsors played no role in the design, execution, analysis & interpretation of data or in the writing of the manuscript or the decision to submit the manuscript for publication.
The authors declare that they have no competing interests.
TJH, CRV and DGC designed the study. TJH and RA collected data. TJH, IMC and DGC were involved in analysis and interpretation of data. All authors were involved in drafting the manuscript and revising it critically for important intellectual content. All authors have given final approval of the version to be published.
Electronic supplementary material
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Harris, T.J., Victor, C.R., Carey, I.M. et al. Less healthy, but more active: Opposing selection biases when recruiting older people to a physical activity study through primary care. BMC Public Health 8, 182 (2008). https://doi.org/10.1186/1471-2458-8-182
- Physical Activity
- Primary Care
- Physical Activity Level
- Postal Questionnaire
- Primary Care Patient