This article has Open Peer Review reports available.
Evaluation of a brief anti-stigma campaign in Cambridge: do short-term campaigns work?
© Evans-Lacko et al; licensee BioMed Central Ltd. 2010
Received: 25 November 2009
Accepted: 14 June 2010
Published: 14 June 2010
In view of the high costs of mass-media campaigns, it is important to understand whether it is possible for a media campaign to have significant population effects over a short period of time. This paper explores this question specifically in reference to stigma and discrimination against people with mental health problems using the Time to Change Cambridge anti-stigma campaign as an example.
410 face-to-face interviews were performed pre, during and post campaign activity to assess campaign awareness and mental health-related knowledge, attitudes and behaviours.
Although campaign awareness was not sustained following campaign activity, significant and sustained shifts occurred for mental health-related knowledge items. Specifically, there was a 24% (p < 0.001) increase in persons agreeing with the statement: If a friend had a mental health problem, I know what advice to give them to get professional help, following the campaign. Additionally, for the statement: Medication can be an effective treatment for people with mental health problems, there was a 10% rise (p = 0.05) in the proportion of interviewees responding 'agree' or 'strongly agree' following the campaign. These changes, however, were not evident for attitudinal or behaviour related questions.
Although these results only reflect the impact of one small scale campaign, these preliminary findings suggest several considerations for mass-media campaign development and evaluation strategies such as: (1) Aiming to influence outcomes pertaining to knowledge in the short term; (2) Planning realistic and targeted outcomes over the short, medium and long term during sustained campaigns; and (3) Monitoring indirect campaign effects such as social discourse or other social networking/contact in the evaluation.
In January 2009, Time to Change launched a national social marketing campaign aiming to reduce stigma and discrimination against people with mental health problems[1–3]. The key campaign messages are: 'There is something you can do to help'; 'Mental illness is one of our last taboos'; and 'Mental illness is far more common than you think'. Preceding the launch of the national campaign, a smaller scale local campaign took place in Cambridge, England over a 4-week period in 2008. Compared with the subsequent national campaign, the Cambridge intervention was more localised, shorter in duration (4 weeks vs. 3 years) and had fewer financial resources (£55,000/$91,000 vs. £8.1 million/$13.4 million). Specific campaign activities in Cambridge included: advertising at bus stops, on the local radio and in the local paper; advertising using beer mats and postcards; street art in the city centre; 'talking points' around town including public sofas staffed by people with experience of mental health problems; and a one day 5-a-side football tournament.
While it might be expected that social marketing campaigns need both high intensity and long duration of exposure in order to maximise their impact, there is little evidence for this. Indeed, the effect of campaign intensity and duration may be complicated by length of follow-up period or events occurring in the social/political context which coincide with the campaign. Consequently, the results of such longer term programmes are often unclear and the evidence available regarding type of effects associated with longer duration or how to optimise campaign duration is mixed [4, 5]. A Cochrane review of mass media interventions for smoking cessation, for example, found no significant association between campaign duration and effectiveness  and other related research has shown that serial mass-media campaigns may risk becoming redundant . Other studies, however, have detected an association between longer duration and higher intensity campaigns with improved behavioural outcomes such as reductions in smoking prevalence, when compared to single interventions or short term versus long term campaigns [7, 8].
Therefore, and especially in view of the high costs of social marketing and advertising, it is important to understand whether it is possible to have a significant and sustained positive effect on stigma and discrimination against people with mental health problems over a short period of time. Specifically, this study addresses the following questions, using the Time to Change Cambridge pilot as an example: (1) Can a short term campaign play any role in positively influencing stigma and discrimination; and (2) What types of change are possible over the short term?
Characteristics of Participants in Pre and Post Campaign
n = 92
n = 198
n = 120
Full or Part time
Married/living with partner
Social Contact (i.e., knowing someone with a mental illness)
No one known
The National Institute for Health and Clinical Excellence (NICE) emphasises the importance of including knowledge, attitude and behavioural components when developing and evaluating interventions aimed at behaviour change among individuals or populations. Therefore, in addition to measuring prompted campaign awareness, our evaluation included outcome measures of mental health-related knowledge, attitudes and intended behaviour. Knowledge was measured by the Mental Health Knowledge Schedule [MAKS]). The MAKS includes 6 items which assess stigma-related mental health knowledge. Overall test-retest reliability of the MAKS is 0.71 and the overall internal consistency among items is 0.65. However, since the MAKS was not developed to function as a scale the internal consistency value is less important . Attitudes were assessed using 3 hypothesised items from the Community Attitudes towards Mental Illness [CAMI] scale. Of note, these 3 items were chosen to be in line with campaign targets and were chosen in collaboration with the campaign developers) . Specifically these items assess attitudes regarding commonality (Virtually anyone can become mentally ill); dangerousness (People with mental health problems are far less of a danger than most people suppose); and responsibility (People with mental health problems should not be given any responsibility). Although the entire CAMI scale was not used for the campaign evaluation, the 3 items chosen come from the social restrictiveness and authoritarianism subscales. The reliability of the social restrictiveness subscale is 0.80 and the authoritarianism subscale is 0.68. Intended behaviour (the level of intended future contact with people with mental health problems) was measured by the Reported and Intended Behaviour Scale (RIBS). We specifically assessed changes in 4 intended behaviour outcomes (domains included: living with, working with, living nearby and continuing a relationship with someone with a mental health problem). which were derived from the Star Social Distance Scale. Overall test-retest reliability of the RIBS is 0.75. The overall internal consistency of the scale is 0.85 [Evans-Lacko S, Rose D, Little K, Rhydderch D, Henderson C, Thornicroft G: Development and Psychometric Properties of the Reported and Intended Behaviour Scale (RIBS), submitted]. Analyses were carried out using Stata version 10 and SAS version 9.1. This study was classified as exempt by the King's College London, Psychiatry, Nursing and Midwifery Research Ethics Subcommittee.
Overall, low to moderate levels of campaign awareness were reached. Shifts in the proportion of people reporting any campaign awareness, however, changed rapidly. Our evaluation showed that prompted campaign awareness increased incrementally over the 4-week period of the campaign and peaked during the last week of the campaign at 23%. Campaign awareness, however, fell sharply to 6% two weeks following the campaign. Notably, campaign awareness was 5% before the campaign began, indicating no change in prompted campaign awareness before and after campaign activity.
Frequencies and Percents of Participants Agreeing (Strongly or Slightly) to Correct Response Among MAKS Items
n = 92
n = 120
1. Most people with mental health problems want to have paid employment (T)
2. Most people with mental health problems go to their doctor to get help (F)
3. Medication can be an effective treatment for people with mental health problems (T)
4. Psychotherapy (e.g., talking therapy or counselling) can be an effective treatment for people with mental health problems (T)
5. People with severe mental health problems can fully recover (T)
6. If a friend had a mental health problem, I know what advice to give them to get professional help (T)
Frequencies and Percents of Participants Agreeing (Strongly or Slightly) to RIBS Intended Behaviour Items
n = 92
%Agree n = 120
In the future, I would be willing to live with someone with a mental health problem
In the future, I would be willing to work with someone with a mental health problem
In the future, I would be willing to live nearby to someone with a mental health problem
In the future, I would be willing to continue a relationship with a friend who developed a mental health problem
Implications for campaign development and evaluation
Importance of Knowledge Based Outcomes
Although these results only reflect the impact of one small scale campaign, these preliminary findings suggest several considerations for mass-media campaign development and evaluation strategies. First, the data suggest that it may be easier to influence outcomes pertaining to knowledge in the short term rather than aiming to influence attitudes or behaviour. Although there may be more extensive barriers to shifting attitude or behavioural outcomes, changing knowledge around what people can do is an important outcome in itself. Much has been written as to whether improved knowledge is a useful outcome and whether public education itself is sufficient or even useful . Although it is possible that some types of knowledge, such as being able to identify certain psychiatric diagnoses, may not reduce stigma or discrimination , there is evidence that knowledge about sources of help, or ways of helping others with mental health problems, may positively influence stigma and discrimination. Several studies of the Mental Health First Aid program, which teaches members of the public skills in how to assist people developing mental disorders, have shown improvements in stigma related outcomes such as decreased social distance from people with mental disorders, increased confidence in providing help to someone with a mental disorder, and increased help provided to others [13–17].
Mechanism of Change
The disparity between sustained campaign awareness and sustained changes in other campaign outcomes is informative when thinking about campaign evaluation and for exploring the mechanism of action of population level change. For instance, it is possible that in the case of the Time to Change Cambridge campaign, this difference exists because the campaign messages are easier to recall than actual campaign activity. Alternatively, it is possible that the campaign works indirectly to influence stigma and discrimination at the population level. For instance, one of the aims of Time to Change was to promote discussion about mental health problems facilitated by "talking points" around the town which included public sofas and publicity in pubs and cafes. These points were designed to facilitate discussion about or disclosure of mental health problems. Although many individuals may not have come into contact with the campaign and therefore could not recall actual campaign activity, it is possible that they were influenced by individuals who were campaign aware and who discussed the campaign messages with them. Individuals for which the campaign was more salient (e.g. mental health service users or carers) may have been motivated to champion the cause following the campaign. These 'champions' may have discussed or shared campaign messages with others who were not campaign aware. Given the significance of social contact in other studies [18, 19], media campaigns may benefit from targeting individuals who could act as conduits of change to facilitate discussion, social contact or other activities.
While this study contributes new and important information which may inform the planning of future media campaigns, there are limitations which should be considered. Although the sample was weighted to be representative of the target population in Cambridge in terms of gender, age, and socioeconomic group, the participants were only a sample of Cambridge and may not represent the entire target population in Cambridge. Additionally, although the study used quotas to ensure equality of the target characteristics (gender, age and socioeconomic group), different individuals were interviewed at each time point. Although this reduces the potential of an effect resulting from repeating the interview, we cannot be sure that differences in attitudes were not due to sampling characteristics. Finally, although the study included 50% of confirmed press readers to allow participants a greater opportunity to see the campaign and hence examine the relationship between awareness and attitude change, we cannot extrapolate the awareness figures to the entire population.
Our evaluation demonstrated the potential of short term campaigns for achieving positive mental health-related knowledge outcomes of the type that have been shown to positively influence stigma related outcomes following a 4-week mass-media campaign. This is in line with social marketing literature which advocates targeting small and incremental changes in outcomes over an extended period of time  and health behaviour models which theorise processes involving distinct series of changes [21, 22]. Interestingly, disparities were noted between sustained campaign awareness and knowledge outcomes. Although it is likely that prolonged campaigns are necessary to achieve widespread positive change, the optimal duration of campaign activity is not yet clear . The findings of this study support the need for planning realistic and targeted outcomes over the short, medium and long term during sustained campaigns. Therefore, it may be useful to include several intermittent time points of outcome evaluation in order to track the patterns of changes as outcomes may change rapidly and may or may not be sustained. Further investigation of how effects persist or vary over time is needed. Future work will compare the effects of this short term campaign with the effects of the national campaign which is run over a longer period of time. Moreover, evaluating the costs and benefits associated with the campaign should be fully investigated. Finally, when considering mechanisms of population change, it might be important to monitor indirect campaign effects such as social discourse or other social networking in the evaluation. This is supported by other studies which have shown that campaigns most potent effects may be through interpersonal communication which may affect both ideation or support .
SEL and KL are postdoctoral researchers and JL is a researcher in the Health Service and Population Research Department at the Institute of Psychiatry, King's College London. CH is a Senior Lecturer in the Health Service and Population Research Department at the Institute of Psychiatry, King's College London. GT is Professor of Community Psychiatry and Head of the Health Service and Population Research Department at the Institute of Psychiatry, King's College London. He is a Consultant Psychiatrist and Director of Research and Development at the South London and Maudsley NHS Foundation Trust.
We are grateful for feedback provided by: Patrick Corrigan, Steven Hinshaw, Tony Jorm, Bruce Link, Jo Phelan, Vanessa Pinfold Norman Sartorius, and Ann Law We are thankful to our statistical consultant: Clare Flach and for their collaboration on the evaluation: Sue Baker, Maggie Gibbons, Paul Farmer, Paul Corry, Katherine Crawshaw and Nichola Jones. We would also like to thank Consumer Insight for their assistance with data collection.
- Eaton L: Celebrities help promote campaign to destigmatise mental illness. BMJ. 2009, 338: b309-10.1136/bmj.b309.View ArticlePubMedGoogle Scholar
- Henderson C, Thornicroft G: Stigma and discrimination in mental illness: Time to Change. Lancet. 2009, 373: 1928-1930. 10.1016/S0140-6736(09)61046-1.View ArticlePubMedGoogle Scholar
- Pinfold V: Time to change - let's end mental health discrimination: the challenges ahead. Br J Psychiatry. 2008, 193: 507-10.1192/bjp.193.6.507.View ArticlePubMedGoogle Scholar
- Bala M, Strzeszynski L, Cahill K: Mass media interventions for smoking cessation in adults. Cochrane Database Syst Rev. 2008, CD004704-Google Scholar
- McVey D, Stapleton J: Can anti-smoking television advertising affect smoking behaviour? controlled trial of the Health Education Authority for England's anti-smoking TV campaign. Tob Control. 2000, 9: 273-282. 10.1136/tc.9.3.273.View ArticlePubMedPubMed CentralGoogle Scholar
- Owen N, Bauman A, Booth M, Oldenburg B, Magnus P: Serial mass-media campaigns to promote physical activity: reinforcing or redundant?. Am J Public Health. 1995, 85: 244-248. 10.2105/AJPH.85.2.244.View ArticlePubMedPubMed CentralGoogle Scholar
- Flay BR: Mass media and smoking cessation: a critical review. Am J Public Health. 1987, 77: 153-160. 10.2105/AJPH.77.2.153.View ArticlePubMedPubMed CentralGoogle Scholar
- Friend K, Levy DT: Reductions in smoking prevalence and cigarette consumption associated with mass-media campaigns. Health Educ Res. 2002, 17: 85-98. 10.1093/her/17.1.85.View ArticlePubMedGoogle Scholar
- Evans-Lacko S, Little K, Meltzer H, Rose D, Rhydderch D, Henderson C, Thornicroft G: Development and Psychometric Properties of the Mental Health Knowledge Schedule (MAKS). Canadian Journal of Psychiatry. 2010, 55:Google Scholar
- Taylor SM, Dear MJ: Scaling community attitudes toward the mentally ill. Schizophr Bull. 1981, 7: 225-240.View ArticlePubMedGoogle Scholar
- Clement S, Barley E, Evans-Lacko S, Flach C, Slade M, Thornicroft G: Mass media interventions for reducing mental health-related stigma [Protocol]. Cochrane Database of Systematic Reviews. 2009, (forthcoming)Google Scholar
- Link BG, Phelan JC, Bresnahan M, Stueve A, Pescosolido BA: Public conceptions of mental illness: labels, causes, dangerousness, and social distance. Am J Public Health. 1999, 89: 1328-1333. 10.2105/AJPH.89.9.1328.View ArticlePubMedPubMed CentralGoogle Scholar
- Angermeyer MC, Daumer R, Matschinger H: Benefits and risks of psychotropic medication in the eyes of the general public: results of a survey in the Federal Republic of Germany. Pharmacopsychiatry. 1993, 26: 114-120. 10.1055/s-2007-1014354.View ArticlePubMedGoogle Scholar
- Angermeyer MC, Matschinger H: Lay beliefs about schizophrenic disorder: the results of a population survey in Germany. Acta Psychiatr Scand Suppl. 1994, 382: 39-45. 10.1111/j.1600-0447.1994.tb05864.x.View ArticlePubMedGoogle Scholar
- Jorm AF, Korten AE, Jacomb PA, Christensen H, Rodgers B, Pollitt P: Public beliefs about causes and risk factors for depression and schizophrenia. Soc Psychiatry Psychiatr Epidemiol. 1997, 32: 143-148.PubMedGoogle Scholar
- Jorm AF, Korten AE, Rodgers B, Pollitt P, Jacomb PA, Christensen H, Ziao J: Belief systems of the general public concerning the appropriate treatments for mental disorders. Soc Psychiatry Psychiatr Epidemiol. 1997, 32: 468-473.PubMedGoogle Scholar
- Kelly CM, Jorm AF, Wright A: Improving mental health literacy as a strategy to facilitate early intervention for mental disorders. Med J Aust. 2007, 187: S26-S30.PubMedGoogle Scholar
- Kolodziej ME, Johnson BT: Interpersonal contact and acceptance of persons with psychiatric disorders: a research synthesis. J Consult Clin Psychol. 1996, 64: 1387-1396. 10.1037/0022-006X.64.6.1387.View ArticlePubMedGoogle Scholar
- Pettigrew TF, Tropp LR: A meta-analytic test of intergroup contact theory. J Pers Soc Psychol. 2006, 90: 751-783. 10.1037/0022-3522.214.171.1241.View ArticlePubMedGoogle Scholar
- Wilde GJ: Effects of mass media communications on health and safety habits: an overview of issues and evidence. Addiction. 1993, 88: 983-996. 10.1111/j.1360-0443.1993.tb02116.x.View ArticlePubMedGoogle Scholar
- Prochaska JO, DiClemente CC: Stages and processes of self-change of smoking: toward an integrative model of change. J Consult Clin Psychol. 1983, 51: 390-395. 10.1037/0022-006X.51.3.390.View ArticlePubMedGoogle Scholar
- Weinstein ND: The precaution adoption process. Health Psychol. 1988, 7: 355-386. 10.1037/0278-6126.96.36.1995.View ArticlePubMedGoogle Scholar
- Storey D, Boulay M, Karki Y, Heckert K, Karmacharya DM: Impact of the integrated Radio Communication Project in Nepal, 1994-1997. J Health Commun. 1999, 4: 271-294. 10.1080/108107399126823.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/10/339/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.