Randomised controlled trial of welfare rights advice accessed via primary health care: pilot study [ISRCTN61522618]
© Mackintosh et al; licensee BioMed Central Ltd. 2006
Received: 01 February 2006
Accepted: 21 June 2006
Published: 21 June 2006
Little research has directly evaluated the impact of increasing financial or material resources on health. One way of assessing this lies with assisting people to obtain full welfare benefit entitlements. In 2000–1, 2.3 million pensioners were living in poverty in the UK and estimates suggest that around one million do not claim the financial support to which they are entitled. The effectiveness of welfare rights advice services delivered via primary health care to promote health and reduce health inequalities is unknown.
The main objectives of this study were to assess the feasibility and acceptability of a randomised controlled trial of welfare rights advice in a community setting and identify appropriate health and social outcome measures in order to plan a definitive trial.
This was a single blind, community-based, pilot randomised controlled trial. 126 men and women aged 60 years and over, recruited from 4 general practices in Newcastle upon Tyne, UK, participated. The intervention comprised a structured welfare rights assessment followed by active assistance with welfare benefit claims over the following 24 months. The control group received the intervention after a six month delay. A range of socio-economic, health, behavioural and psycho-social outcomes were measured.
126 out of 400 people invited agreed to participate and 109 were followed up at 24 months. Both the intervention and research procedures were feasible and acceptable to participants and professionals involved. 68 (58%) of all participants received a welfare benefit award (31 financial, 16 non-financial and 21 both). Median time to receipt of benefits from initial assessment was 14 (range 1 to 78) weeks and median financial award was £55 (€81, $98) per household per week. There was little evidence of health-related differences between groups or over time, which could be due to limitations of the study design.
Modification of the study design, including selection of study participants, timing of interventions and length of follow up are recommended for a definitive trial. More appropriate health and psycho-social outcome measures relevant to the elderly population should be sought, particularly focussing on those issues highlighted in the accompanying qualitative study.
Major inequalities in health result from differences in socio-economic position between individuals, families and population groups. Whilst the link between resources and health is well established[1–4], there has been little conclusive research evaluating the impact of increasing resources on health. In the UK large amounts of welfare benefits are unclaimed, particularly amongst vulnerable groups such as older people. It has been estimated that only around 40–60% of those eligible actually claim the health-related benefits to which they are entitled. Appropriate targeting and active assistance with benefit claims can result in substantial increases in financial and non-financial resources (e.g. parking permits, household aids and adaptations) for eligible non-claimants[8–10]. In the UK welfare rights advice is offered through local government social services departments, Citizens Advice Bureaux (one of the UK's largest voluntary organisations, providing free advice and information on money, legal or other problems) or primary care, with clients accessing the services either through self-referral, referral from another agency or both. However, these services are not available to everyone.
Evaluating the health impact of complex social interventions poses ethical and methodological challenges. In particular, the ethical acceptability of withholding welfare advice or benefits from control group participants has been questioned. Pilot studies play an important role in health research and are a necessary prerequisite for definitive randomised controlled trials[13, 14]. Evaluations of the health effects of social interventions are essential to identify effective ways to reduce health inequalities[10, 12].
We report the results of a pilot randomised controlled trial of welfare rights advice in a primary care setting, whilst Moffatt et al, in an accompanying paper, report the findings of an embedded qualitative study. We aimed to evaluate the methods, including a range of potential outcome measures, estimate effect sizes and sample size for a definitive trial.
We conducted a single blind RCT with individuals randomly allocated to intervention (receipt of immediate welfare rights assessment, advice and active assistance with claims) or control condition (receipt of the intervention after a six month delay).
Four practices working from five premises in Newcastle upon Tyne participated. Three premises were in the top ten per cent of the most deprived wards in England and two were in the top one per cent, measured using the Index of Multiple Deprivation.
A random sample of 400 patients aged 60 years or over was generated using participating practices' computer systems, and invited to participate. Patients likely to have received full welfare assessments, such as the permanently hospitalised or those in residential or nursing care homes, were excluded. The sample size was pragmatic and aimed to enable us to estimate sample size for a future definitive trial.
Within 3 weeks of the baseline assessment, a welfare rights officer from Newcastle City Council Social Services undertook a structured assessment of current welfare status and benefits entitlement, including a full assessment of household income and expenditure. Participants were then offered active assistance with making benefit and other welfare claims where appropriate over the following months. Advice was offered either at home or at the GP surgery, but all participants preferred a domiciliary service.
Participants in the control group were given an appointment for a follow up interview with the researcher six months after their baseline assessment. Following this second interview, the control group were offered an appointment with the welfare rights officer, who offered a full welfare benefits assessment and active assistance with claims as appropriate, following the same procedure as the intervention group.
Randomisation and blinding
Following the baseline assessment, participants were randomly allocated to the intervention or control group by the project secretary using a sequential allocation table independently generated from random number tables prior to recruitment. The researcher conducting the assessments was blind to the randomisation group.
Baseline assessment and outcome measures
Written informed consent was obtained at baseline assessment. The following outcomes were collected in a structured, face-to-face interview at baseline, 6, 12 and 24 months:
Short Form 36 (SF36), Hospital Anxiety and Depression Scale (HADS), activity limiting long term illness, symptoms inventory, the Pittsburgh Sleep Quality Index, and self-reported height and weight (used to calculate Body Mass Index (weight in kg/height in m2)).
Health related behaviours
In addition data were collected at baseline on age, sex, ethnicity and educational attainment. The salary, travel and administrative costs of providing welfare rights advice were estimated.
Participants were contacted by telephone for repeat welfare assessments at 6, 12 and 24 (intervention) or 6 and 18 months (control) from the initial welfare assessment. When an application for benefits was made, the Welfare Rights Officer asked participants to notify her when a decision letter arrived, so that an accurate record could be kept of benefits received. Participants who had not notified her were followed up with telephone calls.
Intervention cost per case was estimated by recording the number of minutes spent on each participant's case by the Welfare Rights Officer, including advice sessions, telephone calls and letter writing, and recording the number of miles travelled. Travel was costed at £0.404 (€0.595, $0.716) per mile, and staff time at £0.934 (€1.374, $1.656) per minute. Household income and major expenditure (housing costs, council tax, loan repayments and energy costs) were used to estimate household disposable income.
Initial analyses were conducted on an 'intention-to-treat' basis, without regard to whether participants had received benefits as a result of the intervention. Explanatory analyses then compared outcomes in the intervention at different time points.
The differences between mean changes from baseline in each outcome measure for the intervention and control groups are reported along with 95% confidence intervals for those differences. Bootstrap methods were used when the distributions were markedly non-normal. ANOVA was used to compare outcomes at different time points.
The protocol for the study was approved by Newcastle upon Tyne joint universities and NHS research ethics committee.
Participant flow and follow-ups
Baseline characteristics of intervention and control groups
Intervention (n = 64)
Control (n = 62)
SF36 – Physical (Range* 0–100, higher score = better health)
SF36 – Mental (Range 0–100, higher score = better health)
HAD – Anxiety (Range 0–21, lower score = less anxiety)
HAD – Depression (Range 0–21, lower score = less depression)
Sleep quality (PSQI) (Range 0–21, lower score = better sleep quality)
Symptom inventory (Range 0–21, lower score = fewer symptoms)
Health related behaviours
Fruit and vegetable intake (Range 0–42, high score = higher intake)
Protein intake (Range 0–36, high score = higher intake)
Starch intake (Range 0–18, high score = higher intake)
Fat intake (Range 0–24, high score = higher intake)
Alcohol (units, high score = higher intake)
BMI (weight (kg)/height (m)2)
Physical activity (PASE) (Range 0–3503, high score =more physical activity)
Social interaction (Range 0–30, high score = high level of social interaction)
Strength of confiding relationships (Range 2–10, high score = strong relationships)
Self Esteem Inventory** (Range 10–40, high score = high self esteem)
Personal Mastery Scale** (Range 7–28, high score = high personal mastery)
Life Events Inventory (Range 0–32, high score = more stressful life events)
Financial vulnerability (Range 6–28, lower score = less financially vulnerable)
Standard of Living Index (Range 0–23, high score = better standard of living)
Education post 16 yrs
Ethnic group – White
Use of car
Long term limiting illness
Material and financial outcomes
Distribution of household income, welfare benefit variables and type of award by group allocation
Intervention (n = 59)
Control (n = 58)
Total (n = 117)
Distribution of household income and welfare benefit variables
Median (Min, Max)
Median (Min, Max)
Median (Min, Max)
Initial weekly disposable household Income in £
190 (40, 782)
195 (-12*, 711)
190 (-12*, 782)
Amounts of additional benefits received per week in £
60 (10, 118)
38 (4, 137)
55 (4, 137)
Total arrears received as a lump sum per household in £†
563 (50, 3627)
338 (70, 3935)
483 (50, 3935)
Time between welfare assessment and start of financial benefit in weeks
16 (1, 78)
10 (1, 39)
14 (1, 78)
Time between start of financial benefit and first follow-up health questionnaire after welfare assessment in weeks **‡
11 (-26, 24)
8 (-15, 23)
Type of Award
Received only financial award(s)
Received only a non-financial award(s)
Received both a financial and non-financial award
Received some type of award
Received no award(s)
Eligibility for financial benefits and median amount awarded by general practice
% eligible for financial benefits
Median amount of benefit awarded/week (£)
The mean intervention cost per case was £120.18 (€172.34, $209.94). This comprised salary of £115.24 (€165.20, $201.21) and travel of £4.94 (€7.08, $8.62). The mean cost was £161.23 (€231.14, $281.46) for those who received benefits and £63.62 (€91.21, $111.07) for those who did not.
Health, behavioural and psychosocial outcomes
Changes in continuous outcome measures# from baseline to 6 months for intervention and control groups
Intervention (n = 61)
Control (n = 59)
Difference between means (95% CI)
Mean Change (6m-baseline) (SD)
Mean Change (6m-baseline) (SD)
SF36 – Physical
1.4 (-1.0 to 3.8)
SF36 – Mental
1.4 (-1.1 to 3.9)
HAD – Anxiety *
0.7 (-0.3 to 1.7)
HAD – Depression *
0.1 (-0.8 to 1.0)
Sleep quality (PSQI)
0.3 (-0.6 to 1.2)
-0.5 (-1.4 to 0.4)
Health related behaviours
Fruit and vegetable intake
0.0 (-2.3 to 2.3)
0.6 (-0.7 to 2.0)
0.6 (-0.6 to 1.8)
0.5 (-1.3 to 2.3)
-0.8 (-4.3 to 2.8)
0.1 (-0.4 to 0.6)
Physical activity (PASE)
-0.1 (-16 to 16)
0.1 (-1.0 to 1.2)
Strength of confiding relationships
0.1 (-0.5 to 0.6)
Self Esteem Inventory *
-0.8 (-1.9 to 0.3)
Personal Mastery Scale*
-0.4 (-1.2 to 0.4)
Financial vulnerability **
-1.6 (-2.6 to -0.7)
Standard of Living Index
-0.1 (-0.5 to 0.2)
Comparison of mean outcome measure scores# at 6, 12 & 24 months – Intervention group (n = 57)
SF36 – Physical
SF36 – Mental
HAD – Anxiety
HAD – Depression
Sleep Quality (PSQI)
Strength of Confiding Relationships
Self Esteem Inventory
Personal Mastery Scale
This is the first pilot RCT to measure a broad range of health and social outcomes in relation to a welfare rights advice intervention accessed via a health care setting. Both the intervention and research procedures proved feasible and acceptable to participants and professionals involved.
Around 60% of participants were eligible for some benefits and 40% for financial benefits, confirming that offering welfare advice to older people via primary care is an effective way of identifying those entitled to benefits who would otherwise be unlikely to claim[8, 9, 30]. However, there was little evidence of differences in health outcomes between those who did or did not receive the advice at 6 months, or within the intervention group over time. These could reflect a genuine lack of effect, or limitations in the study design; this was a pilot study and not powered to detect small differences. Previous studies examining the impact of welfare rights advice on health have been observational and therefore provide only weak evidence[10, 31]. Our qualitative study suggests that those in receipt of extra benefits were more able to participate in society and experienced greater 'peace of mind', but this was not evident using scales such as Social Interaction or HAD-Anxiety in this pilot trial.
Strengths and weaknesses
The study was conducted in the UK and the findings should therefore be interpreted with caution in relation to the health and welfare systems of other countries. Nevertheless, most of the implications are methodological in nature and thus widely applicable.
The methodological and ethical challenges in evaluating an intervention of this type have been discussed before, but the low drop-out rate suggests that participants found our study procedures acceptable, a finding corroborated by the accompanying qualitative study. This was a single blind RCT and the letter arranging the follow up appointment specifically asked the participant not to tell the researcher whether or not they had seen the welfare adviser. Only one participant told the researcher conducting follow-up interviews (JM) that she had received benefits, but this was an isolated incident and we do not believe that it affected the results. Furthermore, the main analyses were conducted by independent statisticians (DH, TC) who were blind to this information.
Although the health and social assessment interview covered a wide range of outcome measures, taking between 30 and 90 minutes to complete, participants did not report feeling this was too onerous a task for them.
Whilst the intervention in this study was the provision of a welfare rights assessment, in 40% of the sample this did not result in any welfare benefits because of ineligibility. This will have diluted any resultant health improvements in the intention to treat analysis. Using practice deprivation scores to target the poorest areas would increase the proportion of participants eligible for welfare benefits in a future trial. Further exploration of individual predictors of eligibility using GP data (e.g. morbidity indicators) in this study was hindered by the small sample size. It may be possible in future work to improve recruitment materials to persuade others likely to gain from a welfare rights assessment to participate. Thirty nine percent of those giving a reason for non-participation said that it was because they were too old, ill or frail. Whilst this is not uncommon in research with the elderly, these are likely to be people who could benefit from a welfare rights assessment. In contrast, the embedded qualitative study indicated that some participants agreed to take part in this research study out of a sense of altruism, rather than because they thought they might qualify for welfare benefits. All participants reported their ethnic group to be white British. Whilst Newcastle overall has a small ethnic population, one of the study practices has a sizeable proportion of patients from the South Asian community. It is not known how many people from this community were invited to participate and either did not respond or declined. However, the invitation to participate was only available in English and this is likely to have affected recruitment of people for whom English was not their first language.
The potential health-related impact of additional benefits is hard to quantify. Some concerns were raised about the standard scales used to assess health related outcomes. Interviewer feedback suggested that some of the questions on the scales we used may have been inappropriate for this population; most were not designed specifically for use with older people and, additionally, some may not be sufficiently responsive to small changes in health which would be of interest. A related issue arose in interviews with the 14 (out of the sample of 25) people in the qualitative study who had received financial benefits. A positive and wide-ranging impact on a number of aspects of quality of life such as 'maintaining independence' or 'peace of mind' was reported. These are all factors relevant to an older population but not specifically measured by the scales used in the RCT.
The optimum time at which to measure any health benefits was unclear at the trial outset. The six month delay prior to the control group's benefit assessment was thought to be a reasonable compromise between impeding the receipt of benefit entitlements and allowing time for any health improvements to appear. This was justified ethically on the grounds that the intervention is presently rationed and recipients would not have been identified within the welfare rights officer's normal caseload. However, 14% of those eligible for financial benefits did not receive them until after the six month follow up assessment, and the average time between receipt of financial benefits and the next assessment was only two months. Health improvements resulting from increased benefits may not be detectable after such a short time. The time lapse needed for additional resources to have any effect on health is unclear, but there is a methodological argument for delaying the welfare rights advice longer in the control group in a future trial. However, this remains ethically contentious, as it is hard to justify withholding an intervention that is known to be beneficial in financial terms.
Our trial design was feasible and acceptable. The study found a large proportion of participants in the sample was eligible for welfare benefits but not claiming them. However, there was little evidence of differences in health outcome measures between groups or over time. If there was a real effect, possible reasons for a lack of evidence include: the small sample size; inadequate lengths of time for additional welfare benefits to have health and psycho-social effects; many participants did not qualify for any benefits; and the outcome measures used may not have been the most appropriate. These factors combined would have reduced the observed strength of any possible effects.
Modification of the study design to reduce the dilution effects described above, including selection of study participants, timing of interventions and length of follow up will be necessary for a definitive trial. There is also a need to look at some alternative or additional measures of health outcomes relevant to an older population, particularly those highlighted by the accompanying qualitative study, such as maintenance of independent living : however many of the outcome measures used in this pilot RCT would remain relevant. This study provides an example of how a pilot RCT with an embedded qualitative study identified unforeseen problems that will inform the design of a definitive evaluation.
We thank Terry Lisle, Pat Barker, Debbie Jones, Janice Armstrong and Eileen Coope for data entry and clerical support; Ruth Wood for database construction; Laura Stokoe, who provided secretarial support throughout and administered many aspects of the trial; Rosemary Bell, Jenny Dover and Nick Whitton of Newcastle City Council Welfare Rights Service for developing and delivering the intervention and for help with many other aspects of the study; Paul Bullars, Dianne Moran, Veronica Christie and Donna Aydon, practice managers, for sampling and accessing patient records; GPs of the four practices that agreed to participate in the study; Jean Adams, for help with data analysis; Christine McGuire, for providing helpful liaison with the Department of Health Policy Research Programme; all participants, their partners and families, whose unstinting support was invaluable. Elaine McColl, Robbie Foy, Alicia O'Cathain and Katie Brittain made helpful comments on the manuscript. The research was funded by the Department of Health Policy Research Programme and supported by the University of Newcastle upon Tyne, Newcastle Primary Care Trust and Newcastle City Council Social Services Directorate. The views expressed in this paper are those of the authors and not necessarily those of the Department of Health.
- Acheson D: Independent inquiry into inequalities in health. 1998, London, HMSOGoogle Scholar
- Department of Health: Reducing health inequalities: an action report. 1999, London, Department of HealthGoogle Scholar
- Secretary of State for Health: Our Healthier Nation. 1998, London, The Stationery OfficeGoogle Scholar
- Townsend P, Davidson N, Whitehead M: Inequalities in Health: the Black Report and the Health Divide. 1988, London, Penguin, 356-Google Scholar
- Connor J, Rodgers A, Priest P: Randomised studies of income supplementation: a lost opportunity to assess health outcomes. J Epidemiol Community Health. 1999, 53: 725-730.View ArticlePubMedPubMed CentralGoogle Scholar
- Sandell A: Oxford Handbook of Patients' Welfare. A Doctor's Guide to Benefits and Services. 1998, Oxford, Oxford University PressGoogle Scholar
- Craig P, Greenslade M: First findings from the disability follow-up to the Family Resources Survey. Research Summary No. 5. 1998, London, Analytical Services Division Social Research Branch, Social Security ResearchGoogle Scholar
- Jarman B: Giving advice about welfare benefits in general practice. BMJ. 1985, 290: 522-524.View ArticlePubMedGoogle Scholar
- Coppel DH, Packham CJ, Varnam MA: Providing welfare rights advice in primary care. Public Health. 1999, 113: 131-135. 10.1016/S0033-3506(99)00137-7.View ArticlePubMedGoogle Scholar
- Abbott S, Hobby L: Welfare benefits advice in primary care: evidence of improvements in health. Public Health. 2000, 114: 324-327.PubMedGoogle Scholar
- Greasley P, Small N: Welfare advice in primary care. 2002, Bradford, University of LeedsGoogle Scholar
- Thomson H, Hoskins R, Petticrew M, Ogilvie D, Craig N, Quinn T, Lindsay G: Evaluating the health effects of social interventions. BMJ. 2004, 282-285. 10.1136/bmj.328.7434.282.Google Scholar
- Lancaster GA, Dodd S, Williamson PR: Design and analysis of pilot studies: recommendations for good practice. J Eval Clin Pract. 2004, 10: 307-312. 10.1111/j..2002.384.doc.x.View ArticlePubMedGoogle Scholar
- Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2005, 321: 694-696. 10.1136/bmj.321.7262.694.View ArticleGoogle Scholar
- Moffatt S, Mackintosh J, White M, Howel D, Sandell A: The acceptability and impact of a randomised controlled trial of welfare rights advice in primary care: a qualitative study. BMC Public Health. 2006Google Scholar
- Department for the Environment Transport and the Regions: Measuring Multiple Deprivation at the Small Area Level: The Indices of Deprivation 2000. 2000, London, Department for the Environment Transport and the RegionsGoogle Scholar
- Ware JE, Kosinski M, Keller SK: SF-36® Physical and Mental Health Summary Scales: A User's Manual. 1994, Boston, MA, The Health InstituteGoogle Scholar
- Zigmond AS, Snaith RP: The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983, 67: 361-370.View ArticlePubMedGoogle Scholar
- Office for National Statistics: Census 2001 - Factsheet 9: the Census questions (Pub G9). 2000, London, Office for National StatisticsGoogle Scholar
- Marmot MG, Davey Smith G, Stansfeld SA, Patel C, North F, Head J: Health inequalities among British Civil Servants: the Whitehall II study. Lancet. 1991, 337: 1387-1393. 10.1016/0140-6736(91)93068-K.View ArticlePubMedGoogle Scholar
- Buysse DJ, Reynolds III CF, Monk TH, Berman SR, Kupfer DJ: The Pittsburgh Sleep Quality Index: a New Instrument for Psychiatric Practice and Research. J Psychiatr Res. 1989, 28: 193-213. 10.1016/0165-1781(89)90047-4.View ArticleGoogle Scholar
- Roe L, Strong C, Whiteside C: Dietary intervention in primary care: validity of the DINE method for dietary assessment. Fam Pract. 1994, 11: 375-381.View ArticlePubMedGoogle Scholar
- Washburn RA, Smith KW, Jette AM, Janney CA: The Physical Activity Scale for the Elderly (PASE): development and evaluation. J Clin Epidemiol. 1993, 46: 153-162. 10.1016/0895-4356(93)90053-4.View ArticlePubMedGoogle Scholar
- Department of Health: Health Survey for England: preliminary results tables. 2000, London, Department of HealthGoogle Scholar
- Sarason IG, Levine HM, Basham RB, Sarason BR: Assessing social support: the social support questionnaire. J Pers Soc Psychol. 1983, 44: 127-139. 10.1037/0022-3518.104.22.168.View ArticleGoogle Scholar
- Ward R: The impact of subjective age and stigma on older persons. Journal of Gerontology. 1977, 32: 227-232.View ArticleGoogle Scholar
- Pearlin LI, Schooler C: The Structure of coping. J Health Soc Behav. 1978, 19: 2-21. 10.2307/2136319.View ArticlePubMedGoogle Scholar
- Ford G, Ecob R, Hunt K, Macintyre S, West P: Patterns of class inequality in health through the lifespan: class gradients at 15, 35 and 55 years in the west of Scotland. Soc Sci Med. 1994, 39: 1037-1050. 10.1016/0277-9536(94)90375-1.View ArticlePubMedGoogle Scholar
- Walker A, Maher J, Coulthard M, Goddard E, Thomas M: Living in Britain. Results from the 2000 General Household Survey. 2001, London, The Stationery OfficeGoogle Scholar
- Abbott S, Hobby L: Who uses welfare benefits advice services in primary care?. Health and Social Care in the Community. 2003, 11: 168-174. 10.1046/j.1365-2524.2003.00414.x.View ArticlePubMedGoogle Scholar
- Adams J, White M, Moffatt S, Howel D, Mackintosh J: A systematic review of the health, social and financial impacts of welfare rights advice delivered in healthcare settings. BMC Public Health. 2006, 6: 81-10.1186/1471-2458-6-81.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/6/162/prepub