This article has Open Peer Review reports available.
An evaluation of the effectiveness of a community mentoring service for socially isolated older people: a controlled trial
© Dickens et al; licensee BioMed Central Ltd. 2011
Received: 8 September 2010
Accepted: 8 April 2011
Published: 8 April 2011
Social isolation affects a significant proportion of older people and is associated with poor health outcomes. The current evidence base regarding the effectiveness of interventions targeting social isolation is poor, and the potential utility of mentoring for this purpose has not previously been rigorously evaluated. The purpose of this study was to examine the effectiveness of a community-based mentoring service for improving mental health, social engagement and physical health for socially isolated older people.
This prospective controlled trial compared a sample of mentoring service clients (intervention group) with a matched control group recruited through general practice. One hundred and ninety five participants from each group were matched on mental wellbeing and social activity scores. Assessments were conducted at baseline and at six month follow-up. The primary outcome was the Short Form Health Survey v2 (SF-12) mental health component score (MCS). Secondary outcomes included the SF-12 physical health component score (PCS), EuroQol EQ-5D, Geriatric Depression Score (GDS-10), social activity, social support and morbidities.
We found no evidence that mentoring was beneficial across a wide range of participant outcomes measuring health status, social activity and depression. No statistically significant between-group differences were observed at follow-up in the primary outcome (p = 0.48) and in most secondary outcomes. Identifying suitable matched pairs of intervention and control group participants proved challenging.
The results of this trial provide no substantial evidence supporting the use of community mentoring as an effective means of alleviating social isolation in older people. Further evidence is needed on the effectiveness of community-based interventions targeting social isolation. When using non-randomised designs, there are considerable challenges in the recruitment of suitable matches from a community sample.
SCIE Research Register for Social Care 105923
In the United Kingdom, people aged 60 years or above currently account for approximately 20% of the population , and this proportion is expected to rise to 24% by 2030 . By 2025 the number of people in the UK over the age of 80 is forecast to increase by almost a half, whilst those over 90 years will double . This demographic shift has resulted in importance being placed on health status trends for older people and how these trends may change in future, due to the anticipated increase in demand for health and social care services . More recently, longer life expectancy has led to discussion of the likely quality of life associated with these additional years [5, 6]. 'Quality of ageing' is rapidly becoming one of the most important social, political and health priorities of the early 21st century. The development of strategies for promoting quality of ageing for older people has been a major component of recent UK Government policy [3, 7–12]. Emphasis in many of these policies [7, 10–12] was placed on 'active ageing', referring to enhancing quality of life by optimising older people's health, security and social participation in terms of learning, leisure, volunteering and employment.
As the proportion of older people in the population increases, more are living alone. A recent longitudinal UK study of people aged 50 or over reported that 22% (1363/6164) lived alone, of whom 13% experienced long periods of detachment from society . Thus the challenge of addressing social isolation in this age group is a growing concern. A UK study  with a nationally representative sample of 999 people aged 65 years or over, found that between 11 and 17% of this age group reported being 'socially isolated'; defined as not being in direct contact with family, friends or neighbours on a weekly or monthly basis respectively.
A recent meta-analysis of 148 longitudinal studies (308,849 participants, mean age of 64 years) reported a 50 per cent reduction in the likelihood of mortality for individuals with strong social relationships . A limitation of this review was that 'strong social relationships' was a composite variable that combined conceptually distinct measures of an individual's social context (e.g. loneliness, social isolation, perceived social support). Notwithstanding this, the authors observed that the impact of social relationships on mortality risk is comparable with major, well-established risk factors such as smoking and alcohol consumption, and exceeds that of physical inactivity and obesity. Studies focusing specifically on the measurement of social isolation and health report similar relationships. For example, nationally representative cross-sectional US survey data (n = 2910) reveal an association with poor self-rated physical health  and a three-year longitudinal study in Sweden (n = 1203) reported those who were socially isolated having increased susceptibility to dementia . Both studies were based on the general population of older people, while a three-year Danish longitudinal study (n = 2,697) reported an association between social isolation and disability onset among older males that live alone . In a separate analysis of data from our current study, we found that social isolation was negatively associated with health status and health-related quality of life of older people . The wide-reaching implications of social isolation make targeting the problem a public health concern. In recent years, models of preventive joined-up local services have been developed to address social isolation and to promote wellbeing. Furthermore, one objective of current mental health policy  is to develop 'sustainable, connected communities' that promote social networks and environmental engagement.
In the UK, a model was devised ('Link Age') to offer older people one-stop access to services and advice through a single gateway. A 'Link Age Plus' service was subsequently introduced in pilot sites across the country in 2006, offering a fully integrated service with a specific focus on tackling social exclusion in older people . However, little policy guidance or research evidence is available to define precisely how such services should be configured to optimise their effectiveness .
Cattan et al  conducted a systematic review to assess the effectiveness of interventions targeting social isolation and loneliness among older people. Thirty studies were included, targeting a variety of groups such as caregivers, those living alone and general populations of community-dwelling older people. The authors judged nine studies to be of high methodological quality, four studies to be high/moderate quality, with the remaining 17 studies being of lower quality. The authors characterise interventions that effectively alleviate social isolation as being those delivered at the group level, offering education or social activity and targeting specific groups of older people. One-to-one interventions such as home visiting or befriending were reported to be not effective [22, 23]. The latter finding has been supported by two more recent studies. Charlesworth et al  conducted a randomised controlled trial (RCT) examining the effectiveness of befriending for carers of people with dementia (n = 236). The authors reported no intervention effect on mood or health-related quality of life at 15 months. A systematic review of eight RCTs evaluating home visiting programmes for older people with poor health  reported no beneficial effects on mortality or health status. Despite the above generic characteristics of effective services, Cattan et al  and Findlay  acknowledge that there remain many more questions than answers, due in part to the poor quality of the evidence base limiting interpretation of results.
An alternative intervention proposed for tackling social isolation is mentoring. The purpose of a mentor is to provide support within a given context, with the level of support offered being variable and responsive to the perceived needs of the recipient . Mentoring has been defined as a 'unique learning partnership' offering either emotional or instrumental support .
Early Mentoring service development and evaluation
Healthy Living Centres (HLC) were introduced to local communities in 1999 with the aim of reducing health inequalities . The Upstream HLC was specifically designed to increase social participation of older people at risk of social isolation living in a rural county of South West England, through the provision of a mentoring service. The intervention involved training mentors to facilitate older people's participation in individually-tailored creative and social activities with mentors reducing the level of support over time as appropriate. The aim of the intervention was to restore older people's self-confidence, self-esteem and social identity, and to support their participation and re-engagement in community-based activities.
An observational study of this intervention assessed clients at baseline, six months and 12 months post intervention . Baseline scores indicated poor mental and physical health compared with age-matched population norms and low levels of social support. At six months, there were significant improvements in self-reported mental wellbeing (SF-12 mental health component score ) and depression scores, but not in physical health or social support. At 12 months, the improvement in SF-12 mental health component scores was not maintained although there were significant improvements in mental health status (depression) and social support and a trend towards improvement in SF-12 physical health component scores  (p = 0.06).
Qualitative data showed that the intervention was well-received by participants. Key mediators of beneficial outcomes appeared to be the individual tailoring of the intervention to clients' needs and overcoming barriers relating to confidence, transport and venues. Key processes underlying improved outcomes were the development of a positive group identity, and the building of confidence and self-efficacy. The model appeared to provide a practical way of engaging socially isolated older people and generating social networks. Although there are limitations in attributing causality in uncontrolled observational studies, the data indicated that the use of mentoring for social isolated older people merited further investigation.
On the basis of findings from the pilot study, funding was secured to sustain and develop the mentoring service and to expand the model across the county of Devon by commissioning new providers to implement a 'Devon Community Mentoring service'.
Devon has a population of approximately 1.1 million, with a high proportion of older people compared with the UK. Forty one percent are 50 years of age or above and 20% are at least 65, in comparison with 34% and 16% of the UK population respectively . Devon is a largely rural county with a population density of less than a third that of England, and half that of the UK .
Description of the Devon Community Mentoring Model
The underlying principles and definitions guiding the implementation and operationalisation of the Community Mentoring service have been documented in a manual . Community Mentoring was delivered by two main voluntary organisations, through operational clusters across Devon. Mentoring teams worked to identify older people (aged 50 or over) who were, or were at risk of becoming socially isolated and who, they believed, might benefit from mentoring. The intervention was intended for those with substantial psychological or physiological morbidity, depression, chronic illness, disability, poor quality of life or substantial caring burden. Exclusion criteria included a history of violence, alcohol dependency, psychosis or more than mild dementia. Potentially eligible clients were identified via referrals from health and social care professionals, family and friends, or self-referral. Individuals were assigned a mentor who worked with them for up to 12 weeks; in rare cases the support could be offered for longer. By working closely with clients, mentors aimed to build clients' self-confidence and engage them in personally meaningful social activities. A key goal was to provide clients with the necessary skills and abilities to ensure sustainable change once the service was withdrawn.
Purpose of the study
The aim of the study was to examine the effectiveness of the community-based mentoring intervention compared with usual care, in improving mental health, social engagement and physical health.
Study design and ethical considerations
A prospective controlled trial was conducted. Potential participants were identified from a population of individuals who were currently in receipt of mentoring (intervention), or who were receiving usual care through routinely available health, social and voluntary care services (control). Intervention and control group participants were matched on two variables associated with the anticipated effect of the intervention (mental wellbeing and social activity) to minimise potential confounding effects.
The study sample size was calculated to detect a significant between-group difference on the primary outcome measure (SF-12 MCS). The previous observational study  reported a change in SF-12 MCS from baseline to follow-up of 3.8 points (95% CI: 0.89 to 6.68, p < 0.02). An improvement of ≥3 points on the SF-12 summary scores was deemed to be clinically meaningful . Were this effect to be replicated and assuming that the between-group difference would be three points or more in this study, a minimum of 140 participants per group were required (two-sided alpha = 0.05, 85% power). To account for likely loss to follow-up in this age group [36, 37] an additional 25% was needed, resulting in a target sample size of 187 participants per group.
Formal approval for this study was granted by Devon & Torbay NHS Research Ethics Committee (REC number 07/Q2102/9) and the appropriate NHS trusts and social care providers across Devon.
Participant recruitment and outcome measures
Participant recruitment took place between March 2007 and June 2008.
Intervention and control group participants were required to meet the study inclusion criteria of being 50 years of age or above, being socially isolated or at risk of becoming socially isolated, being able to provide informed consent, and being able to complete a questionnaire with or without assistance. Potential participants were excluded from the study if they had dementia, psychosis or alcohol dependency, or lived in a nursing home.
Community Mentoring teams were requested to invite all new clients to participate in the study. Mentors were asked to mention the study and offer clients a study information pack. The pack consisted of a brief study flyer, a participant information sheet, an invitation from the research team and a response form. Interested clients were invited to return the response form directly to the research team using a pre-paid envelope. On receipt of completed response forms, interested clients were contacted to arrange a home visit to discuss the study further before providing consent and completing the baseline questionnaire. Intervention participant baseline assessments were conducted as quickly as possible after the mentoring team's initial assessment, but before the mentor began actively working with the client.
Potential control participants were sampled from areas of Devon where the mentoring service was not currently available. The sample was recruited through three general practices covering areas with similar population demographics to the mentoring service catchment areas. Surgery staff identified the patients on the practice lists that were aged 50 or above. Clinical staff then excluded patients who did not meet the study inclusion criteria or who were diagnosed with a terminal illness or were classed as temporary residents. The latter exclusions were for ethical and pragmatic reasons, as screening surveys were to be sent out un-invited, requesting people's involvement over a considerable period of time.
Study information and screening surveys were sent to a random sample (approx 20%) of the remaining patients who were eligible for the control group. The brief screening survey included participant socio-demographic information and a selection of outcome measures (SF-12, social activity, social support) that were used in the study assessments. Since the aim of the trial was to examine the effectiveness of the mentoring intervention, only those outcome measures required for matching purposes or for describing our samples were included in the screening survey. The rationale for the selection of matching criteria is described subsequently. Non-respondents were sent a second screening survey and accompanying material approximately two weeks later. All recipients were given the option to complete the survey only, or to complete the survey and express an interest in taking part in the study as a control group participant. If the respondent was willing to take part and they were selected as a suitable match with an intervention participant, the researcher telephoned the person to discuss the study further and to arrange a home visit for consent and baseline data collection.
Matching was performed on a case-by-case basis, so that each intervention group participant was matched with one person from the community sample who returned the screening survey and was willing to participate in the trial. Data used to match pairs were obtained from intervention participants' baseline assessments and from control participants' completed screening surveys. Matching was therefore an ongoing process throughout the recruitment phase of the trial. Selection of matching variables was informed by the anticipated effects of the intervention as well as the observed improvement in MCS (derived from the SF-12) in the earlier observational study. Pairs were matched using mental health status and social activity scores, both reflecting one of five categories. Using the mean and standard deviation (SD) for the sample of intervention group participants available (n = 49), the five categories were: 'low outlier' (> -2 SD from mean), 'poor' (> -1 SD from mean), 'medium' (within ±1 SD), 'good' (> +1 SD from mean) and 'high outlier' (> +2 SD from mean). Pairs of participants were matched to be in the same category of mental health status and social activity scores. Where this was not possible, pairs were matched on one criterion and within one category shift on the other. The described matching process therefore intended to ensure that matched pairs had comparable levels of 'baseline risk'  in respect of mental health and social activity.
There was a trade-off between the number of matching criteria applied and the ability to identify suitable controls within the time frame. The two matching criteria used in this study both had five categories, meaning that all participants were allocated to one of 25 categories (5 × 5) prior to matching. An additional matching category might have been desirable (e.g. gender or marital status [widowed/not widowed]), and could potentially have reduced the disparity between groups observed at baseline. However, the availability of suitable matches (participants would have been allocated into 5 × 5 × 2 = 50 groups) may have diminished to a point where the trial was not achievable in the time frame available .
Baseline assessments for matched pairs were conducted within as short a time period as possible, up to a maximum of three months apart, to minimise the possible impact of seasonal variation on mental health . Study participants completed a follow-up assessment six months after baseline data collection. This length of follow-up was chosen to capture any benefits maintained after mentoring services had been withdrawn.
The measures taken at baseline and follow up were selected to reflect areas where the intervention might be expected to impact on health and well-being. We selected instruments that have been widely used in previous research, or that were seen to be both acceptable to the population group and sensitive to change in the previous observational study . The primary outcome was mental health status, as measured by the SF-12 mental health component score (MCS) . Secondary outcome measures included the SF-12 physical health component score (PCS), health status (EuroQol EQ-5D) , Geriatric Depression Scale (GDS-10) , and social health including social activities (four items from the RAND Social Health Battery ), social support (six items from the Medical Outcomes Study Social Support Survey [MOS-SSS] ), and levels of social participation (one item from the General Household Survey).
The social support items used were selected and validated during the preceding observational study, following reports from participants that the 19-item Social Support Survey was repetitive and tedious . The authors derived a single scale (referred to as MOS-6) from these items, with scores ranging from one to five, where higher scores reflected more positive assessments of the functional support available. The items were found to have good internal consistency (α = 0.93), and formed a single factor with loadings ≥0.76. The MOS-6 explained 81% of the variance in the 19-item MOS-SSS. Furthermore, the MOS-6 demonstrated criterion validity, being sensitive to change in the context of a social isolation intervention  and having moderate correlations with both the SF-12 MCS (r = 0.41) and the GDS (r = 0.48).
Analysis plan & reporting
The study was reported according to the STROBE statement, specifying the minimum required information for good quality reporting of observational studies .
Data were analysed on an intention to treat basis. Pre-specified between-group comparisons at 6-months follow up were undertaken using regression analyses. In spite of the matching process used, given the lack of comparability of groups at baseline (see Results) an unpaired approach to analysis was undertaken. Statistical models included adjustment for baseline scores and for employment status, living arrangements and accommodation type. Further statistical models including the additional covariates of age and gender were also run, though results from these models are not reported as the additional adjustment did not change the between-group inferences (data not presented).
Whether or not P-values should be adjusted for multiple comparisons is controversial . We elected not to adjust for multiple comparisons because of the increased likelihood of Type II errors. We considered all statistical tests as significant at a two-sided P of less than 0.05 and results are expressed as 95% confidence intervals.
The main reason for missing data was anticipated to be loss to follow up. Missing values were imputed using last observation carried forward , assuming that missing data were randomly distributed. The results of regression modelling, with and without imputation, were compared to assess the potential impact of using this method.
All statistical analyses were conducted using STATA version 10.
There were 16070 potentially eligible patients on the lists of the three control practices. Researchers identified a random sample of patients (n = 3700) that was then screened by practice staff for exclusions (n = 154), resulting in the final patient sample approached (n = 3546). A total of 2057 responses were received, of whom 901 (25.4% of those approached) were interested in participating in the trial. The interested community respondents appeared to have a similar profile to the broader random sample of older people approached through practice lists in terms of their age, gender and IMD deprivation scores (data not presented).
Representativeness of participants
The recruitment target of 187 participants per group was achieved. Although we encouraged mentoring teams to offer their clients entry to the trial, we found evidence of selection bias. Community Mentoring clients who were not offered study entry by mentors were from more deprived backgrounds and reported significantly lower levels of social activity than those offered trial entry. There was also evidence of recruitment bias, as clients who were offered trial entry but who declined to take part were also significantly older, were less socially active than individuals who agreed to take part, and were from more deprived backgrounds (p < 0.05 in all cases, data not presented).
Adequacy of matching
A cross-tabulation of matching criteria scores for control and intervention groups at the point of matching (control group screening survey and intervention group baseline assessments) demonstrated that the groups were comparable on both matching criteria (MCS: z = -1.22, p = 0.22; social activity: z = -1.28, p = 0.20). However, when this analysis was repeated on baseline data for both groups, the intervention group reported lower scores on both SF-12 MCS (z = -5.76, p < 0.001) and social activity scores (z = -4.12, p < 0.001) compared with controls. The average time (SD) between receipt of a completed screening survey and a control participant's baseline assessment was 61.9 (24.8) days. The majority of control group participants completed baseline assessments within three months of returning their screening surveys, with only six (3.1%) participants being assessed outside this period.
Characteristics of participants
Baseline characteristics of trial participants
Intervention participants (n = 200)
Control participants (n = 195)
Age - mean (SD)
-1.7; p = 0.1a
Gender - n (% male)
2.8; p = 0.1b
Ethnicity - n (%)
4.7; p = 0.2b
Other ethnic group
Ethnicity not disclosed
Lives alone - n (%)
36.2; p < 0.001b
Marital status - n (%)
42.7; p < 0.001b
Single, never married
Separated or divorced
Married, or living as married
Accommodation type - n (%)
72.6; p < 0.001b
Employment status - n (%)
56.9; p < 0.001b
Long term sick or disabled
Baseline outcome scores for participants
Baseline outcome scores
SF-12 MCS - mean (SD)
6.1; p < 0.001a
SF-12 PCS - mean (SD)
6.6; p < 0.001a
EQ-5D - mean (SD)
7.5; p < 0.001a
GDS-10 - mean (SD)
-9.3; p < 0.001a
MOS-6 - mean (SD)
8.3; p < 0.001a
No. friends/family - median (IQR)
5 (2, 10)
5 (3, 10)
0.9; p = 0.38a
No. clubs/groups - median (IQR)
1 (0, 2)
1 (0, 2)
1.4; p = 0.15a
Get together with friends/family - n (%)
-0.9; p = 0.36b
Several days a week
Once a week
2-3 times a month
Once a month
5-10 times a year
Less than 5 times a year
Getting along with others - n (%)
-1.6; p = 0.11b
Work around the house - n (%)
9.5; p < 0.01c
Transport/errands - n (%)
16.3; p < 0.001c
Child care - n (%)
5.7; p < 0.05c
Practical advice - n (%)
3.7; p = 0.06c
Emotional support - n (%)
34.7; p < 0.001c
Other - n (%)
3.1; p = 0.08c
None of the above - n (%)
26.1; p < 0.001c
Angina - n (%)
6.1; p < 0.05c
Arthritis - n (%)
0.001; p = 1.0c
Cancer - n (%)
0.9; p = 0.33c
Diabetes - n (%)
2.7; p = 0.10c
Heart failure - n (%)
8.1; p < 0.01c
High blood pressure - n (%)
3.4; p = 0.07c
Sight/hearing problems - n (%)
15.2; p < 0.001c
Stroke - n (%)
8.2; p < 0.01c
Depression or anxiety - n (%)
34.7; p < 0.001c
Memory/concentration problems - n (%)
15.8; p < 0.001c
Chronic respiratory conditions - n (%)
1.2; p = 0.28c
Sleeping difficulties - n (%)
9.4; p < 0.01c
Due to the imbalance in the characteristics and baseline outcome scores between intervention and control group participants, the modelling framework for our primary and secondary analysis strategy was altered. Covariates were included reflecting key differences in employment status (employed versus not), living arrangements (living alone versus not), accommodation type (home owner versus not), as well as the baseline score for the outcome of interest.
Six month follow-up data
Most study participants who completed a baseline interview also completed a follow-up interview, with only 9% (37/395) dropping out across the six month period.
Between-group regression model comparing outcomes at six months
SF-12 MCS - mean (SD)
n = 168
n = 182
0.8 (-1.5, 3.2); p = 0.48
SF-12 PCS - mean (SD)
n = 168
n = 182
0.1 (-1.9, 2.1); p = 0.90
EQ-5D - mean (SD)c
n = 172
n = 186
-0.09 (-0.14, -0.03); p < 0.01
GDS-10 - mean (SD)
n = 165
n = 185
0.2 (-0.2, 0.7); p = 0.29
Nos. friends/family - median (IQR)
n = 172
5 (3, 8)
n = 183
6 (4, 10)
0.1 (-1.4, 1.6); p = 0.89
Nos. clubs/groups - median (IQR)
n = 172
1 (0, 2)
n = 186
1 (0, 2)
0.3 (-0.1, 0.6); p = 0.15
Get together with friends/family- median (IQR)d
n = 172
3 (2, 5)
n = 186
3 (2, 4)
1.5 (0.7, 3.2); p = 0.25
Getting along with others- median (IQR)e
n = 172
2 (2, 2)
n = 186
2 (2, 2)
0.6 (0.4, 0.9); p < 0.01
MOS-6 - mean (SD)
n = 170
n = 184
0.03 (-0.2, 0.2); p = 0.75
Work around the house- n (%)
n = 171
n = 186
1.2 (0.5, 2.9), p = 0.72
Transport/errands - n (%)
n = 171
n = 186
1.5 (0.8, 3.0); p = 0.24
Child care - n (%)
n = 171
n = 186
1.2 (0.4, 3.5); p = 0.79
Practical advice - n (%)
n = 171
n = 186
1.1 (0.5, 2.5); p = 0.79
Emotional support - n (%)
n = 171
n = 186
1.2 (0.7, 2.2); p = 0.46
Other - n (%)
n = 171
n = 186
1.1 (0.6, 2.2); p = 0.76
None of the above - n (%)
n = 171
n = 186
0.7 (0.4, 1.2); p = 0.19
Depression or anxiety - n (%)
n = 172
n = 185
1.0 (0.6, 1.9); p = 0.92
Memory/concentration problems- n (%)
n = 171
n = 186
0.9 (0.5, 1.7); p = 0.69
Sleeping difficulties - n (%)
n = 172
n = 186
1.2 (0.6, 2.3); p = 0.61
The effect of imputation was examined, with no qualitative differences observed between the imputed and non-imputed regression models except for one social activity item ('getting along with others'). While a significant between-group difference was reported for 'getting along with others' in Table 3 the imputed analysis produced a marginally non-significant difference (odds ratio 0.6; 95% CI 0.4 to 1.0; p = 0.06). Data from the non-imputed analyses, adjusted for the three covariates of employment status, living arrangements and accommodation were therefore reported for the purposes of interpreting the trial results.
Summary of findings
At follow-up there was no evidence of a between-group difference for the primary outcome measure (SF-12 MCS) and for the majority of secondary outcome measures. These data suggest that there were no robust improvements in the health and wellbeing of individuals using the Community Mentoring service compared with controls at six months.
This study was the first controlled trial of a mentoring service for community-dwelling socially isolated older adults. While there is no comparable effectiveness data regarding the use of mentoring with socially isolated older people, the between-group trial data did not reflect improvements in mental health status and in depressive symptoms that were reported in the earlier observational study . It should be noted that data from the previous study represented within-group changes due to the uncontrolled design. While the within-group change in SF-12 MCS in our controlled trial was comparable with that observed in the previous study (3.5 vs 3.8), this should be interpreted cautiously due to substantive methodological differences in data collection and attrition. In the observational study, mentors collected data as opposed to independent researchers, and there was a 47% loss to follow-up as opposed to 9% in the controlled trial.
Our findings contrast with studies evaluating the effect of mentoring on health outcomes in other contexts, although the differences in populations studied should be noted. For example, a randomised controlled trial reported that patients aged 60 or above who were diagnosed with ischaemic heart disease demonstrated improved physical activity following mentor-led monthly meetings over a one-year period . An uncontrolled, before and after study found that overweight adults with developmental disabilities reported improved lifestyle and weight loss following participation in a peer mentor-led health promotion programme over a seven month period . The intervention consisted of twice-weekly education and exercise sessions, focusing on health, nutrition and fitness. A qualitative study suggested that mentoring adults with prior artistic interests in the uptake of creative activities promoted psychological wellbeing .
This trial has contributed to methodological considerations in the use of matched trial designs to evaluate a social intervention. Deterioration in the comparability of groups on matching criteria scores between the point of matching and the baseline assessment demonstrated the difficulty of matching participants using different time points, based on data collected via different modes of administration. Using baseline scores from both groups to match participants would have improved comparability, though this would have required substantial over-sampling of the potential control group to identify a subgroup whose baseline scores closely matched those of the intervention group.
Strengths and limitations
In addition to its controlled design, this study had two particular strengths. Firstly, participant recruitment exceeded the sample size target (n = 187 per group, with 85% power) required to demonstrate potentially important between-group differences on the primary outcome measure (SF-12 mental health component score). Secondly, participant retention was also better than anticipated, with only nine percent of participants being lost to follow up. Hence, we feel confident that the follow-up data are unlikely to be substantially affected by attrition bias .
However, the study also has potential limitations. Firstly, the selection and recruitment bias in the intervention group suggested that mentoring clients contributing to the study may not have been representative of the broader pool of mentoring clients from which they were recruited. The trial findings therefore may not be generalisable to more socially isolated older people.
Secondly, the controlled trial design is inherently vulnerable to bias when compared with a randomised controlled trial. While randomised designs are considered to be methodologically superior when assessing questions of effectiveness , ethical and pragmatic challenges precluded their use in this study. The trial adopted various recruitment and matching procedures in an attempt to prevent or limit the potential for major imbalances between groups . Despite this, important imbalances were evident at baseline that required accounting for in the primary analysis. The potential for misleading estimates of effect due to the limitations of the trial design cannot be conclusively ruled out and the findings should therefore be interpreted with caution.
It could be argued that the choice of matching criteria limited the comparability of study participants, as additional or alternative criteria could have been used. The selection of matching criteria necessarily balanced theoretical and methodological considerations against pragmatic issues. While attempting to match participants on more than two criteria may have resulted in more comparable controls, it would have become increasingly difficult to match sufficient numbers of participants within the trial timeframe.
Reflections on trial results
Alternative explanations as to why no effect of mentoring was found in this study could relate either to methodological issues described previously, to intervention fidelity arising through variations in service implementation or to the targeting of clients. Although providers were commissioned to deliver the model specified within the Mentoring Manual, there was potential for considerable variation in the way that the service was implemented across operational clusters [54, 55]. For example, there could be a lack of consistency in the assessment procedures between providers, in the competency and intervention delivery skills of mentors or in the types of activities offered to service clients. In addition, judgement regarding what constituted a sufficient 'dose' of mentoring could vary between providers. Older people (aged 50 or above) were considered eligible for the intervention if they were, or were at risk of becoming socially isolated and might benefit from the support of a mentor. Such broad eligibility criteria could result in a heterogeneous client group, with some clients unlikely to benefit from the intervention who may have been deemed ineligible under tighter criteria. Such a sub-group of clients could mask any positive gains in outcomes observed in the clients for whom mentoring was best suited.
Analysis of descriptive data collected during participant recruitment into the trial found that mentoring clients appeared to be different from the sample of community residents responding to the screening survey. Mentoring clients were more likely to be living alone and to report lower levels of social activities; suggesting that mentoring providers were targeting a potentially 'at risk' group within the community. Additionally, their mental and physical health status (SF-12) scores were substantially lower than UK normative data for similar age groups .
The results of this trial provide no substantial evidence supporting the use of community mentoring as an effective means of alleviating social isolation in older people. While the Community Mentoring service did include some components of effective interventions (participatory, group-based) identified in previous literature [21, 22], other components may not have been sufficiently addressed. Further work is required to develop and more rigorously evaluate interventions that target specific groups of socially isolated older people, deliver high quality training of facilitators and involve older people in intervention development.
There is a need for service providers to clearly define the characteristics of interventions, both in terms of their content and their target population, and to ensure intervention fidelity. Researchers will then be able to better specify details of the intervention being studied; improving the ability to interpret findings through process analyses , and to determine their generalisability to other populations and their implications for wider public health. In combination with the adoption of high quality, preferably randomised trial designs, such research would provide a valuable contribution to the evidence base on the effectiveness of complex, community-based interventions for socially isolated older people.
We would like to acknowledge the considerable input and collaboration of Community Mentoring teams and control general practices across Devon, as well as the tremendous support and enthusiasm of the study participants. We also acknowledge the help of Sue Blake and Alice Moseley in the collection of study data.
This article presents independent research commissioned by Devon County Council in partnership with NHS Devon with funding from the Department of Work and Pensions; and the Department of Health. The views expressed in this publication are those of the authors and not necessarily those of the research commissioners.
- United Nations: Profiles of ageing by country or area. World Population Ageing 2007. 2007, New York: United Nations, 133-517.Google Scholar
- Age structure of United Kingdom, 1971-2083. [http://www.statistics.gov.uk/populationestimates/flash_pyramid/UK-pyramid/pyramid6_30.html]
- Department of Health: National service framework for older people. 2001, DoH, LondonGoogle Scholar
- Jacobzone S, Cambois E, Chaplain E, Robine JM: The health of older persons in OECD countries: is it improving fast enough to compensate for population ageing?. 1999, Paris, full_text.View ArticleGoogle Scholar
- Daviglus ML, Liu K, Pirzada A, Yan LL, Garside DB, Feinglass J, Guralnik JM, Greenland P, Stamler J: Cardiovascular risk profile earlier in life and Medicare costs in the last year of life. Arch Intern Med. 2005, 165: 1028-1034. 10.1001/archinte.165.9.1028.View ArticlePubMedGoogle Scholar
- Christensen K, Doblhammer G, Rau R, Vaupel JW: Ageing populations: the challenges ahead. Lancet. 2009, 374: 1196-1208. 10.1016/S0140-6736(09)61460-4.View ArticlePubMedPubMed CentralGoogle Scholar
- Department of Work and Pensions: Link-Age: developing networks of services for older people. 2004, LondonGoogle Scholar
- Department of Health: The NHS Plan: a plan for investment, a plan for reform. 2000, DoH, LondonGoogle Scholar
- Department of Health: Modernising social services. 1998, DoH, LondonGoogle Scholar
- World Health Organisation: Active ageing: a policy framework. 2002, WHO, GenevaGoogle Scholar
- Department of Work and Pensions: Opportunity age: meeting the challenges of ageing in the 21st century. 2005, LondonGoogle Scholar
- HM Government: Building a society for all ages. 2009, LondonGoogle Scholar
- Tomaszewski W, Barnes M: Investigating the dynamics of social detachment in old age. Living in the 21st century: older people in England. The 2006 English Longitudinal Study of Ageing (wave 3). Edited by: Banks J, Breeze E, Lessof C, Nazroo J. 2008, London: Institute of Fiscal Studies, 150-185.Google Scholar
- Loneliness, social isolation and living alone in later life. [http://www.shef.ac.uk/uni/projects/gop/ChristinaVic_F17.pdf]
- Holt-Lunstad J, Smith TB, Layton JB: Social relationships and mortality risk: a meta-analytic review. Public Library of Science Medicine. 2010, 7: e1000316-PubMedPubMed CentralGoogle Scholar
- Cornwell EY, Waite LJ: Social disconnectedness, perceived isolation, and health among older adults. Journal of Health and Social Behavior. 2009, 50: 31-48. 10.1177/002214650905000103.View ArticlePubMedPubMed CentralGoogle Scholar
- Fratiglioni L, Wang HX, Ericsson K, Maytan M, Winblad B: Influence of social network on occurrence of dementia: a community-based longitudinal study. Lancet. 2000, 355: 1315-1319. 10.1016/S0140-6736(00)02113-9.View ArticlePubMedGoogle Scholar
- Lund R, Nilsson CJ, Avlund K: Can the higher risk of disability onset among older people who live alone be alleviated by strong social relations? A longitudinal study of non-disabled men and women. Age Ageing. 2010, 39: 319-326. 10.1093/ageing/afq020.View ArticlePubMedGoogle Scholar
- Hawton A, Green C, Dickens AP, Richards SH, Taylor RS, Edwards R, Greaves CJ, Campbell JL: The impact of social isolation on the health status and health-related quality of life of older people. Quality of Life Research. 2010, 1-11.Google Scholar
- Department of Health: Confident communities, brighter future. A framework for developing well-being. 2010, DoH, LondonGoogle Scholar
- Findlay R: Interventions to reduce social isolation amongst older people: where is the evidence?. Ageing Soc. 2003, 23: 647-658. 10.1017/S0144686X03001296.View ArticleGoogle Scholar
- Cattan M, White M, Bond J, Learmouth A: Preventing social isolation and loneliness among older people: a systematic review of health promotion interventions. Ageing Soc. 2005, 25: 41-67. 10.1017/S0144686X04002594.View ArticleGoogle Scholar
- Cattan M, White M: Developing evidence based health promotion for older people: a systematic review and survey of health promotion interventions targeting social isolation and loneliness among older people. Internet Journal of Health Promotion. 1998Google Scholar
- Charlesworth G, Shepstone L, Wilson E, Thalanany M, Mugford M, Poland F: Does befriending by trained lay workers improve psychological well-being and quality of life for carers of people with dementia, and at what cost? A randomised controlled trial. Health Technology Assessment. 2008, 4:Google Scholar
- Bouman A, van Rossum E, Nelemans P, Kempen G, Knipschild P: Effects of intensive home visiting programs for older people with poor health status: a systematic review. BMC Health Services Research. 2008, 8: 74-10.1186/1472-6963-8-74.View ArticlePubMedPubMed CentralGoogle Scholar
- Bearman S, Blake-Beard S, Hunt L, Crosby FJ: New directions in mentoring. The Blackwell Handbook of Mentoring: a multiple perspectives approach. Edited by: Allen TD, Eby LT. 2007, Oxford: Blackwell Publishing, 375-396.Google Scholar
- Eby LT, Rhodes JE, Allen TD: Definition and evolution of mentoring. The Blackwell Handbook of Mentoring: a multiple perspectives approach. Edited by: Allen TD, Eby LT. 2007, Oxford: Blackwell Publishing, 7-20.Google Scholar
- Department of Health: Healthy living centres. 1999, DoH, LondonGoogle Scholar
- Greaves C, Farbus L: Effects of creative and social activity on the health and well-being of social isolated older people: outcomes from a multi-method observational study. Journal of the Royal Society for the Promotion of Health. 2006, 126: 134-142. 10.1177/1466424006064303.View ArticlePubMedGoogle Scholar
- Ware JE, Kosinski M, Turner-Bowker DM, Gandek B: How to score SF-12 items. SF-12 v2: how to score version 2 of the SF-12 Health Survey. 2002, Lincoln, RI: QualityMetric Incorporated, 29-38.Google Scholar
- Mid-2008 population estimates. [http://www.statistics.gov.uk/statbase/Product.asp?vlnk=15106]
- Population density, 2002: regional trends 38. [http://www.statistics.gov.uk/STATBASE/ssdataset.asp?vlnk=7662]
- Devon County Council: Community mentoring manual. 2007, ExeterGoogle Scholar
- Farbus L, Greaves CJ: The Upstream Healthy Living Centre: research on the processes and outcomes of an intervention to promote health and quality of life in a socially isolated elderly population. 2005, ExeterGoogle Scholar
- Ware JE, Snow KK, Kosinski M, Gandek B: SF-36 health survey manual and interpretation guide. 1993, BostonGoogle Scholar
- Campbell JL, Winder R, Richards SH, Wyatt K, Hobart J: The FAB study: final report. 2004, ExeterGoogle Scholar
- Richards S, Coast J, Gunnell D, Peters T, Pounsforth J, Darlow M: A randomised controlled trial comparing the effectiveness and acceptability of an early discharge hospital at home scheme with acute hospital care. BMJ. 1998, 316: 1796-1801.View ArticlePubMedPubMed CentralGoogle Scholar
- Wang H, Boissel JP, Nony P: Revisiting the relationship between baseline risk and risk under treatment. Emerging Themes in Epidemiology. 2009, 6: 10.1186/1742-7622-6-1.Google Scholar
- Oleckno WA: An overview of epidemiologic study designs. Epidemiology: concepts and methods. 2008, Illinois: Waveland Press, Inc, 55-84.Google Scholar
- Harmatz MG, Well AD, Overtree CE, Kawamura KY, Rosal M, Ockene IS: Seasonal variation of depression and other moods: a longitudinal approach. Journal of Biological Rhythms. 2000, 15: 344-350. 10.1177/074873000129001350.View ArticlePubMedGoogle Scholar
- Ware J, Kosinski M, Turner-Bowker D, Gandek B: How to score version 2 of the SF-12 Health Survey (with a supplement documenting version 1). 2002, Lincoln, RI: QualityMetric IncorporatedGoogle Scholar
- Hurst NP, Kind P, Ruta D, Hunter M, Stubbings A: Measuring health-related quality of life in rheumatoid arthritis: validity, responsiveness and reliability of EuroQol (EQ-5D). Rheumatology. 1997, 36: 551-559. 10.1093/rheumatology/36.5.551.View ArticleGoogle Scholar
- D'ath P, Katona P, Mullan E, Evans S, Katona C: Screening, detection and management of depression in elderly primary care attenders. I: the acceptability and performance of the 15 item Geriatric Depression Scale (GDS15) and the development of short versions. Fam Pract. 1994, 11: 260-266.View ArticlePubMedGoogle Scholar
- Donald C, Ware J: The measurement of social support. Research in Community and Mental Health. 1984, 4: 325-370.Google Scholar
- Sherbourne C, Stewart A: The MOS social support survey. Soc Sci Med. 1991, 32: 705-714. 10.1016/0277-9536(91)90150-B.View ArticlePubMedGoogle Scholar
- von Elm E, Altman D, Pocock S, Gotzsche P, Vandenbroucke J: Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007, 335: 806-808. 10.1136/bmj.39335.541782.AD.View ArticlePubMedPubMed CentralGoogle Scholar
- Rothman KJ: No adjustments are needed for multiple comparisons. Epidemiology. 1990, 1: 43-46. 10.1097/00001648-199001000-00010.View ArticlePubMedGoogle Scholar
- Little RJA, Rubin DB: Introduction. Statistical Analysis with Missing Data. 2002, New Jersey: John Wiley & Sons, 3-23. 2Google Scholar
- Coull A, Taylor V, Elton R, Murdoch P, Hargreaves A: A randomised controlled trial of senior lay health mentoring in older people with ischaemic heart disease: the Braveheart project. Age Ageing. 2004, 33: 348-354. 10.1093/ageing/afh098.View ArticlePubMedGoogle Scholar
- Bazzano AT, Zeldin AS, Diab IR, Garro NM, Allevato NA, Lehrer D: The Healthy Lifestyle Change Program: a pilot of a community-based health promotion intervention for adults with developmental disabilities. American Journal of Preventive Medicine. 2009, 37: S201-S208. 10.1016/j.amepre.2009.08.005.View ArticlePubMedGoogle Scholar
- Bennetts C: The traditional mentor relationship and the well-being of creative individuals in school and work. International Journal of Health Promotion and Education. 2000, 38: 22-27.View ArticleGoogle Scholar
- Juni P, Altman DG, Egger M: Systematic reviews in health care: assessing the quality of controlled clinical trials. BMJ. 2001, 323: 42-46. 10.1136/bmj.323.7303.42.View ArticlePubMedPubMed CentralGoogle Scholar
- Petticrew M, Roberts H: Evidence, hierarchies, and typologies: horses for courses. J Epidemiol Community Health. 2003, 57: 527-529. 10.1136/jech.57.7.527.View ArticlePubMedPubMed CentralGoogle Scholar
- Hawe P, Shiell A, Riley T, Gold L: Methods for exploring implementation variation and local context within a cluster randomised community intervention trial. J Epidemiol Community Health. 2004, 58: 788-793. 10.1136/jech.2003.014415.View ArticlePubMedPubMed CentralGoogle Scholar
- Oakley A, Strange V, Bonell C, Allen E, Stephenson J, RIPPLE Study Team: Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006, 332: 413-416. 10.1136/bmj.332.7538.413.View ArticlePubMedPubMed CentralGoogle Scholar
- Gandek B, Ware J, Aaronson N, Apolone G, Bjorner J, Brazier J, Bullinger M, Kaasa S, Leplege A, Prieto L, et al: Cross-validation of item selection and scoring for the SF-12 health survey in nine countries: results from the IQOLA project. Journal of Clinical Epidemiology. 1998, 51: 1171-1178. 10.1016/S0895-4356(98)00109-7.View ArticlePubMedGoogle Scholar
- Craig D, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: new guidance. 2008Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/11/218/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.