- Research article
- Open Access
Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs
BMC Public Health volume 17, Article number: 155 (2017)
Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children’s drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings.
Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews), program evaluation questionnaires completed by children (n = 166), lesson observations completed by teachers (n = 35 observations), and reflective journal entries completed by the researcher (n = 44 entries). A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data.
Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students’ life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper-elementary school classrooms were identified. These included topic sensitivities, classroom management challenges, and fitting new programs into already busy school schedules.
Overall, the program content and individual lessons were well received by the teachers and students. The lessons learned from the development, implementation and evaluation of this program can provide health professionals with key pedagogical strategies for designing culturally responsive educational programs. Culturally responsive programs are critical for ensuring interventions are effective for their specific context.
There are significant physical, mental and social consequences that can result from underage drinking, such as impaired memory and brain functioning, accidents, injuries, violence, risky sexual behaviour and self-harm [1,2,3]. Childhood (6–12 years of age) is a critical period when alcohol expectancies begin to form , and children are most cognitively vulnerable to the persuasive appeals of advertising. Research has demonstrated a strong correlation between children’s exposure to alcohol advertising, positive alcohol expectancies, drinker identity and future drinking [5,6,7]. A presumably simple solution to reducing children’s future drinking would be to reduce their exposure to alcohol advertising. Yet this solution becomes highly improbable given the current alcohol marketing landscape, with limited and ineffective regulation in countries such as Australia, New Zealand, Canada and the UK [8, 9]. Children are exposed, and receptive, to high levels of advertising through avenues such as television [10, 11], movies , branded merchandise [7, 13] and, more recently, social media .
Media literacy education, which involves students accessing, analysing, evaluating, and creating media in a variety of forms [15, 16], is gaining momentum as an approach to substance abuse prevention in schools . A number of alcohol media literacy (AML) programs have been developed to challenge potentially harmful media messages and subsequently influence health behaviours and attitudes [18,19,20,21,22,23,24]. These programs have demonstrated positive outcomes on a range of measures including a decreased preference for alcohol branded merchandise (a precursor to drinking behaviour), increased media deconstruction skills, and lowered drinking intentions .
While AML programs have made a valuable contribution to the alcohol prevention field [18,19,20,21,22,23,24,25], the majority have been developed in the US and are therefore relevant to that specific context. There is a need for AML programs to be developed for other contexts, with specific attention to jurisdiction-specific alcohol marketing regulation and cultural nuances . This is particularly important given that youth are more likely to drink the specific alcohol brands to whose advertising they are most exposed . The critical importance of cultural considerations was demonstrated by the alcohol prevention programme Project Northland  which was highly successful with predominantly white, lower-middle class to middle-class youth , but unsuccessful when implemented with urban, low-income and multi-ethnic youth . Similarly, another study  highlighted the unique context of Northern Mexico when implementing a set of drug-resistance strategies that had been initially developed for US adolescents. The study concluded that prevention programs are more likely to be effective when they have been adapted to be relevant to the specific context.
The Australian advertising scene is replete with depictions of Australian cultural stereotypes such as the ‘larrikin’ male sharing a beer with mates at the beach or over a BBQ [31, 32]. For example, a content analysis of alcohol advertisements aired over 2 months in major Australian cities  found that approximately half of the advertisements featured the themes of humour (56.7%) or friendship/mateship (41.5%). Portrayals of friendship/mateship often included instances of belittlement, such as a series of advertisements for Victoria Bitter beer where friends ‘saved’ each other by stopping them from engaging in unmanly behaviours including using hand cream and getting a fake tan. Numerous advertisements also linked alcohol to sport such as Australian football. Similarly, female-targeted advertising increasingly portrays drinking as a way for women to bond with their friends and demonstrate their independence from men .
Existing AML programs have also focused solely or primarily on print advertisements, rather than teaching students skills in analysing the broad range of multimodal alcohol advertisements to which they are exposed in Australia and elsewhere . Multimodal advertisements utilise more than one mode, such as television advertisements which combine visual, audio, spatial and gestural information to be processed .
Given these gaps in the evidence base, Media in the Spotlight, an AML program for Australian children, was developed. While there are cultural differences within the Australian ‘context’, this study sought, as a preliminary step, to tailor the program to the broader Australian context. The program was contextually tailored through inclusion, analysis and critique of Australian alcohol advertisements, Australia media clips, and the values promoted through these advertisements, such as associating alcohol with mateship, sport and larrikinism. Unlike US based AML programs [18,19,20,21,22,23,24], the program did not include tobacco advertisements given that advertising for tobacco is completely banned in Australia. Therefore, students’ only exposure to tobacco advertising would be through the program.
Findings from a quasi-experimental trial of the ten-lesson interactive program demonstrated positive results on a range of measures including an increase in media deconstruction skills, decreased perception of social norms for teen drinking and decreased alcohol expectancies . These scales were all derived from existing scales with acceptable levels of reliability and validity. There were a few minor changes to the language used in the scales to ensure contextual relevance. For example, in some instances the word ‘beer’ was replaced with the more general word ‘alcohol’ and a statement assessing social norms was worded ‘Australians drink alcohol’ (see  for details on the measures used and quantitative evaluation).
It is critical to understand the factors that can increase uptake of such programs in schools and strengthen their sustainability. Previous evaluation research in this area has focussed primarily on quantifying the effectiveness of programs, with limited attention given to the implementation process . Process evaluations can help to explain why a program was or was not effective in a real world setting [37,38,39,40], thereby informing the improvement and sustainability of innovative programs in schools . The purpose of this paper is to examine and reflect upon the implementation process of Media in the Spotlight, and through this provide a pedagogical framework for health professionals seeking to design and implement culturally responsive programs in educational settings.
This process evaluation included semi-structured interviews with teachers before and after the program was implemented, student evaluation questionnaires, teacher lesson observations, and researcher reflective journal entries. Multiple process measures were integrated into the intervention design to obtain rich data from stakeholders including teachers, students and the program implementer; and the triangulation of data sources was employed to increase study validity .
Four primary (elementary) schools from a metropolitan area in New South Wales, Australia were allocated to either the intervention group which received the ten AML lessons (n = 83 students), or a wait-list control group (n = 82 students). The schools had relatively high indexes of community socio-educational advantage (ICSEA), with values ranging from 1040 to 1045 (1000 is the median) .
The study protocol was approved by the University Human Research Ethics Committee (HE14/361), the State Education Research Application Process (SERAP no. 2014112) and the participating schools. The program was implemented by the first author of this paper to increase implementation fidelity and delivered to the Grade 5 and 6 classes over a 10 week term, with one lesson taught each week as part of the English (Language Arts) and Personal Development and Health, Physical Education (PDHPE) school curriculum.
Semi-structured, audio-recorded face-to-face interviews were conducted with six Grade 5 and 6 teachers (n = 11 interviews) involved in the study, before and after the program was taught, to explore the teachers’ perceptions of the program. Examples of questions used to guide the interviews are: What are your overall impressions of the program? (follow-up questions were: What do you like about the program? What would you change about the program?) Does the program seem easy to implement? (follow-up questions were: What challenges do you think might arise when implementing the program? What features make the program easy to use, if any?). Five teachers participated in the pre-program interviews and six in the post-program interviews. The interview duration ranged from 10 to 36 min. The themes that arose from the teacher interviews were used to guide the coding for the teacher observations and researcher reflective journal entries. The themes were found to be consistent across the three data sources, thereby providing strong support for the themes.
Non-participant observations were completed by the classroom teachers (n = 35 observations) as they observed the researcher delivering each lesson. The 35 observations were collected from five teachers across the ten lessons taught depending on which lessons they were present for. The teachers noted how effectively the program was implemented and any classroom management issues that arose while the program was being taught in a real world setting  on an observation grid. Prompts on the observation grid included: Student engagement (classroom management issues, level of interest in discussions and questions asked, student enthusiasm), and teaching content (the extent to which the planned lesson material is covered and deviations from the planned content, lesson timing).
Program evaluation questionnaires
The students’ (n = 165) impressions of the program were obtained through a program evaluation questionnaire that was created for this study and administered at the end of the last AML lesson. The questionnaire included three open ended questions: (1) What did you like most about Media in the Spotlight? (2) What did you like least about Media in the Spotlight? And (3) What was the most important knowledge/skill you learned from Media in the Spotlight?
Researcher reflective journal
The reflective journal provided a personal perspective on how effectively the program was implemented and the challenges faced during implementation (n = 44 entries). The journal entries were largely unstructured to allow the researcher to freely record any thoughts and feelings on the lessons taught, however were focussed around pedagogical recommendations and inhibitors to implementation.
A thematic analysis approach was used to analyse all of the data sets using NVivo. The first author transcribed the teacher interviews and then imported the data into NVivo. Inductive coding was used, whereby the findings were derived from the research objectives (pedagogical recommendations and inhibitors to implementation) and multiple readings and interpretations of the data themselves rather than an existing coding framework . The coding framework derived from analysis of the interviews was then applied to the student program evaluation questionnaire, teacher observations and researcher reflective journal, thereby employing a deductive method. Credibility checks involved the research team reviewing the potential themes identified by the first author. The research team discussed the meaning of each theme, the supporting evidence, and ways to refine the themes by combining themes together or creating subthemes. The themes were then refined and further reviewed by the research team.
Brief program description
The content for Media in the Spotlight was based on the Centre for Media Literacy’s  five core media literacy concepts: understanding that all media messages are ‘constructed’ using particular techniques; created using a creative language with its own rules; have embedded values and points of view; constructed for a purpose such as to gain power or to entertain; and different people experience the same message differently . The program was also designed to meet outcomes from both the English (Language Arts) and PDHPE (health) Australian primary (elementary) school curriculum, to provide greater time and flexibility to teach the program.
The content and pedagogy for the program was developed and refined through working collaboratively with academics and professionals in education, alcohol research, and social marketing fields; drawing upon considerations from a systematic review of existing programs ; and incorporating feedback from a pilot trial . The lessons (each approximately 1 h in duration) provided opportunities for students to work individually, in groups and as a whole class. Each lesson began with an introductory activity to capture interest, elicit prior knowledge and revise concepts and skills taught in previous lessons. The lesson focus balanced explicit instruction with hands-on (practical) activities that utilised authentic texts from their real-world context. Each lesson concluded with a hands-on activity to apply the knowledge and skills learnt.
The program drew upon multimodal Australian advertising examples to ensure representation of the different facets of the advertising culture. Students analysed alcohol ads in sport; considered how alcohol sponsorship of sport can influence attitudes and behaviour; viewed forms of alcohol branded merchandise (ABM); speculated how ABM influences people to buy alcohol; were taught the range of persuasive techniques used to persuade such as colour, size, slogans, good times and attractive people; and then analysed alcohol print and TV ads, identifying specific techniques and hidden messages, and countering the hidden messages with facts about alcohol.
Assessment opportunities were embedded throughout the program. Students were distributed ‘exit slips’ at the end of each lesson; an A4 piece of paper with a question about a key concept taught (formative assessment). Students assessed their peers’ work through recording two positives (‘stars’) and one suggestion for improvement (‘a wish’) on a proforma (peer assessment). The counterad creation task required the students to produce a work sample that drew upon knowledge and skills taught throughout the 10-lesson program (summative assessment).
Of the 165 students who participated in the study, 9.7% (n = 16) identified as Aboriginal or Torres Strait Islander. The majority (64.8%, n = 107) identified as having an Australian cultural background. Other cultural backgrounds identified included European (20.6%, n = 34), Asian (8.5%, n = 14) and New Zealander (3.0%, n = 5). The participation rate across schools ranged from 72.6 to 87.5%, with an overall participation rate of 85.1%. Students ranged in age from 9 to 12 years (M = 10.81, SD = 0.65) and 52.8% were female. The six participating teachers ranged in teaching experience from 3 to 36 years (M = 18.83, SD = 12.30), with 1 to 12 years experience of teaching students in Grades 5 and 6 (M = 5.67, SD = 3.78). The six teachers gave informed written consent to participate in the study and publish the provided data.
The themes from the data are organised under two foci: 1) pedagogical recommendations and 2) inhibitors to implementation.
Connect the program to the students’ life worlds to achieve cultural significance
All of the teachers identified that the program was meaningful to the students as it connected to their life worlds. The program connected to seminal aspects of the Australian culture, through the inclusion of current and familiar advertisements across a range of advertising platforms, and references to popular sports, leisure activities, and cultural events.
The ads, they were something that they’ve seen before, it’s now, not old ads, they seem to be ads that they can connect with. [Teacher, 30 yrs experience, Female]
I liked all the videos you were showing early, the cricket where they had to count how many ads they saw. I think they enjoyed that and they were really surprised, by maybe how many, the amount of times they saw it, they thought wow, watched cricket before but hadn’t realised. [Teacher, 16 yrs experience, Male]
They were excited to create their own ads. [Teacher observation, lesson 4]
It is important to emphasise that the program did not increase the students’ exposure to, or identification with, the alcohol advertisements, but rather made them critically aware of the presence of these advertisements and their impact on shaping societal values and beliefs.
Empower students with real-world skills to ensure relevance
Related to the above-mentioned theme, all of the teachers noted that the program equipped students with skills to critically analyse the alcohol advertisements that they are surrounded by and was therefore relevant to their everyday lives. Again, the additional data sources confirmed the identified theme. About half of the students identified a media literacy skill as the most important component of the program.
I think they could now look at an ad and probably with their parents walking through a shopping centre and say look at that, what are they trying to do, and I think they’d be able to rattle off what the advertiser is trying to get you to think, which I was pretty impressed by, the level of understanding that they got throughout the 10 weeks and I think they could probably do that now without prompting. [Teacher, 18 yrs experience, Female]
[I learnt] that you always have to look for the hidden message and the techniques used and if they’re true or not. [Student, School 1, program evaluation questionnaire]
The content in this lesson was great. It really got the students thinking critically and applying their knowledge. [Teacher observation, lesson 5]
In the context of this study, the students were equipped with skills that translated to their everyday lives.
Ensure programs are well structured with strong connections to the school curriculum
In the pre-interviews, all five teachers noted that the program would be easy for a classroom teacher to implement due to its structured and detailed nature. In the post-interviews, all six teachers expressed confidence that they would be able to implement the program as is, with just a few small adjustments to suit the needs of their classes. These adjustments may include providing additional support for a student with specific learning needs to reduce the complexity of a task and aide understanding. For example, the students may be provided with a partially completed proforma for analyzing alcohol ads, where the persuasive techniques used in an advertisement are listed and the student provides examples of the techniques.
In the pre- and post-program interviews, the teachers also noted that the program aligned well with outcomes from both the English (Language Arts) and PDHPE syllabi. The teacher observations and researcher reflective journal affirmed that the program was structured in a way that made it manageable to teach.
It was really detailed which is really good and obviously very clear the connections that are being made with the syllabus which I think is really helpful as a teacher because as you probably know time is so precious because there’s not much of it and we struggle to fit everything in. [Teacher, 10 yrs experience, Female]
The way that you’ve organised it, as I said before, flows, so going from one activity to the next, each following week, I think they’ll sort of gain the knowledge as they go which will be good rather than sort of jumping around. Whereas I feel we’ve actually been involved in a few other research projects and a few of them tend to do that, they jump around a little bit rather than continually building on the information, like building the field. [Teacher, 3 yrs experience, Female]
All the lessons up until this one prepared the students for this activity. All students were able to participate and had the prior learning required to make the counter-ad. [Teacher observation of lesson 9]
In the current study, strong program alignment with the school curriculum and adequate detail were considered valuable components of a school AML program.
Create developmentally appropriate activities and provide a range of assessment opportunities
In the post-program interviews, all six teachers reported that they believed the students had achieved the intended learning outcomes due to the developmental appropriateness of the activities. The researcher’s reflective journal also noted that the majority of students appeared to be grasping the intended learning outcomes for each lesson. In either the pre or post-program interviews, four out of the six teachers commented positively about the opportunities that the assessment tasks afforded to provide feedback on student learning, refine teaching practice and report on whether learning outcomes have been met.
I think it was pitched definitely at the right level. I think they were able to understand all the concepts and everything pretty well. [Teacher, 36 yrs experience, Female]
One of the best features I liked was your exit slips, I thought that was a really good idea, for them to refocus at the end of the lesson, but also for you as an evaluation tool, ‘did they get what I was hoping to achieve?’ I really like that idea. I think I might use that myself. [Teacher, 10 yrs experience, Female]
Loved the post-it note strategy! Great assessment for learning [Teacher observation of lesson 2]
Including assessments throughout the program allowed the implementer to continually assess whether the students were grasping the key concepts and provide further scaffolding where needed.
Include hands-on and interactive activities to promote student engagement
In the pre and post-program interviews, all of the teachers noted that the students were involved in the learning experiences due to the hands-on and interactive nature of the program, providing examples from specific lessons. This was reinforced by the teacher observations and the researcher reflective journal. In the post-program interviews, five of the six teachers identified the creation of the counter-ad, where students changed aspects of an advertisement to reflect a truth about alcohol that was not shown in the original ad, as the most engaging component of the program for the students. In the student program evaluation, the majority of the students identified the hands-on activities, in particular the counter-ad creation, as the best part of the program.
The counter-ad was fun because we could expose the truth [Student, School 2, program evaluation questionnaire]
You’ve obviously tried to use a lot of teaching strategies, not just one way of doing things. The visual literacy stuff is really relevant…and anything in terms of designing stuff the kids love. [Teacher, 10 yrs experience, Female]
Because there was a lot of visual, there was a lot of discussion, speaking and listening, there was a lot of communicating going on…it covered all learning, some children like tactile, some children like visual, so it covers all those learning needs. [Teacher, 30 yrs experience, Female]
The role play was a good way to engage students. [Teacher observation of lesson 3]
The counter-ad activity was particularly engaging as it involved the students in creating text that challenged the messages presented in alcohol advertisements.
Inhibitors to implementation
In the pre-program interviews, four of the five teachers flagged the sensitive nature of the alcohol topic as an issue to be mindful of, particularly around student disclosures.
I suppose one challenge might be because it is talking about alcohol, you may get some kids saying some things…my brother likes to go out and drink, that sort of thing. [Teacher, 10 yrs experience, Female]
I’ve got one boy who’ll look to be cheeky whenever he can… like the picture of the girls towards the end there I thought was tastefully appropriate, you could get definitely worse pictures than that, but I’m sure he’ll find something funny to say about it. [Teacher, 16 yrs experience, Male]
The teacher observations and researcher reflective journal did not note any issues arising from the sensitive nature of the alcohol topic as the program was being implemented. Furthermore, alcohol topic sensitivities were not raised by any of the six teachers in the post interviews, suggesting that it was not a significant issue in the current program. The topic was approached in a way that connected to the students’ lifeworlds, using the advertisements that they are surrounded by as a springboard for exploring problematic alcohol usage. While the topic is sensitive, it is mandated in the school curriculum. The schools and teachers were therefore in agreement that the topic needed to be taught to the children. The advertisements included in the program were carefully selected and only those which students would have already been exposed to were included. For example, it was decided to not include alcohol brand pages on Facebook given that the students are below the legal age for Facebook usage.
Classroom management issues
In the pre and post-program interviews, none of the teachers foresaw any significant challenges in implementing the program, although they flagged the usual everyday classroom management challenges, and the challenge of the implementer not knowing the children. The teacher observations and researcher reflective journal also noted everyday classroom management challenges.
No [major challenges]. Probably the challenges I saw were more from the point of view of the kids not being used to your teaching style and you not knowing them as well. [Teacher, 18 yrs experience, Female]
There were a few that might have had a bit of difficulty…they struggle to pay more attention…but that’s more them, not so much the content you were teaching, because I know what their behaviour is normally like… [Teacher, 3 yrs experience, Female]
The students seemed engaged throughout the whole lesson. They were a little fidgety towards the end, maybe an “out of seats” activity could have helped engagement. [Teacher observation, lesson 2]
Classroom management issues will always be present to an extent, however they can be minimised through implementing the aforementioned pedagogical considerations. As highlighted by one of the teachers, some classroom management issues may be alleviated by the regular classroom teacher implementing the program as they have a thorough knowledge of individual student needs and capabilities.
In the post-program interviews, two of the six teachers identified lack of time as a potential barrier to implementation due to the competing demands present in elementary school.
Time. Just time, like everything else. It’s one of those things that things happen, days happen…that just take away from your time and just to get through every single thing, may or may not be an issue depending upon what else is going on in the school. [Teacher, 18 yrs experience, Female]
I think being in fourth term, there’s so much going on. In a way in Year 5 it is good because they’re a bit more mature, Year 6 maybe earlier, maybe third term heading towards high school. [Teacher, 30 yrs experience, Female]
For the current program, each lesson addressed outcomes from two curriculum areas. This integration of subject matter also afforded more time and flexibility for teaching the program.
This study evaluated the process and implementation of Media in the Spotlight, an interactive AML program created for a specific cultural context. The study aimed to provide a pedagogical framework for health professionals implementing culturally responsive programs in school settings. In a time of significant curriculum change and competing demands for elementary school teachers , it is valuable to understand what teachers consider to be important in a health program, to increase program uptake and sustainability in schools. In drug and alcohol education especially, it is critical for programs to be created in a way that is culturally responsive, to ensure program relevance and effectiveness .
Overall, the program was well received by the teachers and feedback suggested that they were open to a cross disciplinary approach to alcohol prevention in schools. The teachers did not report any significant inhibitors to implementation apart from classroom management issues and the time constraints imposed by an overcrowded curriculum. The issue of time constraints in an “overcrowded curriculum” is commonly cited as a problem for teachers [47, 48]. However, teacher uptake and sustainability of programs can be increased through developing a structured program that is easy to follow, has clear and strong connections to the school curriculum, embeds assessment opportunities within the lessons and includes achievable outcomes.
The teachers also expressed confidence in being able to implement the program themselves due to the program’s structured and comprehensive nature. A well-structured program that is achievable, interactive and relevant for students will also keep students engaged and reduce the likelihood of classroom management issues [49, 50]. Given the demanding nature of the teaching profession, teachers value having all necessary resources included within programs so that they do not have to spend time sourcing information.
The qualitative data sources indicated that the program was enjoyable and acceptable to the students, with the hands-on activities identified as a key strength of the program. This finding is supported by education learning theories such as constructivism which posits that students learn through constructing knowledge and meaning from their experiences . Further, hands-on and interactive activities that engage students in the topic, and enable them to demonstrate and apply their knowledge, are more likely to sustain student interest . The inclusion of hands-on activities are particularly important for drug and alcohol education, as the most effective programs go beyond transmitting knowledge to teaching skills and building coping strategies . Future programs could consider including related extension activities for students that grasp the concepts quickly. This may be more feasible to achieve when the regular classroom teacher is implementing the program, as they would have an understanding of the needs and capabilities of individual students in the class.
Using culturally bound advertisements as an entry point to learning about alcohol proved powerful, as it connected to the students’ life worlds  through use of authentic text from contexts they were familiar with. The media plays a significant role in young people’s lives and can therefore be an effective way of creating relevance and motivation in lessons . The media literacy skills acquired can also enable students to resist the emotional messages presented through ads and positively influence behaviour change [21, 55, 56]. Meta-analyses of school-based drug prevention programs found that skills rather than knowledge are powerful for changing behaviour . This principle, of drawing upon students’ lifeworlds and empowering them with practical skills, can be applied to other sensitive health areas such as sexual health  and body image . Of critical importance is ensuring that the stimuli selected is developmentally appropriate and specific to the children’s cultural context.
There are several limitations that should be considered when interpreting the results of this study. The teacher process evaluation data was collected from six teachers in four schools and therefore may not be representative of the wider teaching population, although opinions do represent a range of teaching experiences from early career to highly experienced teachers. Additionally, there may have been a bias against negative disclosure as the interviewer was also the intervention creator and deliverer. However this may have also helped disclosure as the interviewer had developed a rapport with the teachers. Cultural considerations may need to be more narrowly defined to specific regions within a country. Media in the Spotlight was developed, implemented and evaluated in an area with a high percentage of white Anglo-Saxon Australians. In other areas of Australia with more diverse ethnicities, the cultural considerations may differ. Nonetheless, the principles from the pedagogical framework can be applied to other contexts.
There are significant benefits in early prevention , where issues such as underage drinking are prevented before the problem occurs. In order for these programs to be effective, they must be tailored to the cultural context in which they are being implemented. This paper describes the development and implementation of a school-based AML program for Australian upper-elementary school students, and provides a pedagogical framework for health educators when developing programs for different cultural contexts. Key principles include connecting to the students’ life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Potential inhibitors to implementation include topic sensitivities, classroom management challenges, and fitting programs into busy school schedules. However these inhibitors can be minimised through applying the above pedagogical considerations.
Alcohol branded merchandise
Alcohol media literacy
Personal Development and Health, Physical Education
Bellis MA, Morleo M, Hughes K, Downing J, Wood S, Smallwaite LA, et al. Cross-sectional survey of compliance with national guidance for alcohol consumption by children: measuring risk factors, protective factors and social norms for excessive and unsupervised drinking. BMC Pub Health. 2010;10(1):547–54.
McKay MT, Dempster M, Cole J. Abstinence from alcohol may indeed be the best policy: 32 month longitudinal outcomes among adolescents in the United Kingdom. Int J Child Adolesc Health. 2015;8(2):221–30.
Australian Government National Health and Medical Research Institute (NHMRC). Australian guidelines to reduce health risks from drinking alcohol. Canberra: Commonwealth of Australia; 2009.
Mares SHW, Stone LL, Lichtwarck-Aschoff A. Alcohol expectancies in young children and how this relates to parental alcohol use. Addictive Behav. 2015;45:93–8.
Collins RL, Ellickson PL, McCaffrey D, Hambarsoomians K. Early adolescent exposure to alcohol advertising and its relationship to underage drinking. J Adolescent Health. 2007;40(6):527–34.
De Bruijn A, Tanghe J, de Leeuw R, Engels R, Anderson P, Beccaria F, et al. European longitudinal study on the relationship between adolescents’ alcohol marketing exposure and alcohol use. Addiction. 2016;111(10):1774–83.
McClure AC, Stoolmiller M, Tanski SE, Engels RCME, Sargent JD. Alcohol marketing receptivity, marketing-specific cognitions, and underage binge drinking. Alcoholism. 2013;37(S1):404–13.
Jones SC, Gordon R. Regulation of alcohol advertising: policy options for Australia. Evid Base. 2013;2(1):1–37.
Howard SJ, Gordon R, Jones SC. Australian alcohol policy 2001–2013 and implications for public health. BMC Public Health. 2014;14(848):1–13.
Chen Y, Chiu Y, Ting T, Liao H, Chen W, Chen C. Television viewing and alcohol advertising. Drug Alcohol Depend. 2016;162:219–26.
Fielder L, Donovan RJ, Ouschan R. Exposure of children and adolescents to alcohol advertising on Australian metropolitan free-to-air television. Addiction. 2009;104(7):1157–65.
Dal-Cin S, Worth KA, Gerrard M, Gibbons FX, Stoolmiller M, Wills TA, et al. Watching and drinking: expectancies, prototypes, and friends’ alcohol use mediate the effect of exposure to alcohol use in movies on adolescent drinking. Health Psychol. 2009;28(4):473–83.
Jones SC. Alcohol-branded merchandise ownership and drinking. Pediatrics. 2016;137(5):1–12.
White V, Faulkner A, Coomber K, Azar D, Room R, Livingston M, et al. How has alcohol advertising in traditional and online media in Australia changed? Trends in advertising expenditure 1997–2011. Drug Alcohol Rev. 2015;34(5):521–30.
Jeong SH, Cho H, Hwang Y. Media literacy interventions: a meta-analytic review. J Commun. 2012;62(3):454–72.
Bergsma LJ, Carney ME. Effectiveness of health-promoting media literacy education: a systematic review. Health Educ Res. 2008;23(3):522–42.
Scull TM, Kupersmidt JB, Erausquin JT. The impact of media-related cognitions on children’s substance use outcomes in the context of parental and peer substance use. J Youth Adolescence. 2014;43(5):717–28.
Austin EW, Johnson KK. Effects of general and alcohol-specific media literacy training on children’s decision making about alcohol. J Health Commun. 1997;2(1):17–42.
Austin EW, Johnson KK. Immediate and delayed effects of media literacy training on third grader’s decision making for alcohol. J Health Commun. 1997;9(4):323–49.
Kupersmidt JB, Scull TM, Austin EW. Media literacy education for elementary school substance use prevention: study of media detective. Pediatrics. 2010;126(3):525–31.
Kupersmidt JB, Scull TM, Benson JW. Improving media message interpretation processing skills to promote healthy decision making about substance use: the effects of the middle school media ready curriculum. J Health Commun. 2012;17(5):546–63.
Goldberg ME, Niedermeier KE, Bechtel LJ, Gorn GJ. Heightening adolescent vigilance toward alcohol advertising to forestall alcohol use. J Public Policy Mark. 2006;25(2):147–59.
Sivaithamparam J. Evaluation of the effectiveness of the Expectancy Challenge Alcohol Literacy Curriculum (ECALC) in reducing alcohol use among high school students. [cited 2016 March 18]; no date. Available from: http://etd.fcla.edu/CF/CFE0003617/Sivasithamparam_Janani_201105_PhD.pdf.
Chen YCY. The effectiveness of different approaches to media literacy in modifying adolescents’ responses to alcohol. J Health Commun. 2013;18(6):723–39.
Gordon CS, Jones SC, Kervin L. Effectiveness of alcohol media literacy programs: a systematic literature review. Health Educ Res. 2015;30(3):449–65.
Ross CS, Maple E, Siegel M, DeJong W, Naimi TS, Padon A, et al. The relationship between population-level exposure to alchol advertising on television and brand-specific consumption among underage youth in US. Alcohol Alcoholism. 2015;50(3):358–64.
Perry CL, Anstine PS, Williams CL, Forster JL, Wolfson M, Wagenaar AC, et al. Background, conceptualization and design of a community-wide research program on adolescent alcohol use: Project Northland. Health Educ Res. 1993;8(1):125–36.
Perry CL, Wagenaar AC, Wolfson M, Williams CL, Veblen-Mortenson S, Toomey TL, et al. Project Northland: outcomes of a communitywide alcohol use prevention program during early adolescence. Am J Publ Heal. 1996;86(7):956–65.
Komro KA, Williams CL, Perry CL, Veblen-Mortenson S, Farbakhsh K, Toomey TL, et al. Outcomes from a randomized controlled trial of a multi-component alcohol use preventive intervention for urban youth: Project Northland Chicago. Addiction. 2008;103(4):606–18.
Marsiglia FF, Kulis S, Rodriguez GM, Becerra D, Castillo J. Culturally specific youth substance abuse resistance skills: applicability across the U.S.–Mexico border. Res Social Work Practice. 2009;19(2):152–64.
Jones SC, Reid A. The use of female sexuality in Australian alcohol advertising: public policy implications of young adults’ reactions to stereotypes. J Publ Affairs. 2010;10(1/2):19–35.
Mckay J, Emmison M, Mikosza J. Lads, larrikins and mates: hegemonic masculinities in Australian beer advertisements. In: Wenner LA, Jackson SJ, editors. Sport, beer, and gender: promotional culture and contemporary social life. New York: Peter Lang Publishing; 2009. p. 163–79.
Pettigrew S, Roberts M, Pescud M, Chapman K, Quester P, Miller C. The extent and nature of alcohol advertising on Australian television. Drug Alcohol Rev. 2012;31(6):797–802.
Gill R. Empowerment/sexism: figuring female sexual agency in contemporary advertising. Fem Psychol. 2008;18(1):35–60.
Kress G. Multimodality: a social semiotic approach to contemporary communication. Hoboken: Taylor and Francis; 2009.
Gordon CS, Howard SJ, Jones SC, Kervin LK. Evaluation of an Australian alcohol media literacy program. J Stud Alcohol Drugs. 2016;77(6):950–57.
Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18(2):237–56.
Holliday J, Audrey S, Moore L, Parry-Langdon N, Campbell R. High fidelity? How should we consider variations in the delivery of school-based health promotion interventions? Health Educ J. 2009;68(1):44–62.
Melde C, Esbensen F-A, Tusinski K. Addressing program fidelity using onsite observations and program provider descriptions of program delivery. Evaluation Rev. 2006;30(6):714–40.
Medeiros PFP, Cruz JI, Schneider DR, Sanudo A, Sanchez ZM. Process evaluation of the implementation of the Unplugged Program for drug use prevention in Brazilian schools. Substance Abuse Treatment, Prevention & Policy. 2016;11(2):1–11.
Creswell JW. Research design. 3rd ed. California: SAGE publications; 2009.
Australian Curriculum and Reporting Authority (ACARA). Guide to understanding 2013 Index of Community Socio-educational Advantage (ICSEA) values. Australia: ACARA; 2014.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.
Thoman E, Jolls T. MediaLit Kit—literacy for the 21st Century: an overview and orientation guide to media literacy education. 2005. [cited 2016 March 18]; Available from: http://www.medialit.org/sites/default/files/mlk/01_MLKorientation.pdf.
Gordon CS, Jones SC, Kervin L, Lee JK. Empowering students to respond to alcohol advertisements: results from a pilot study of an Australian media literacy intervention. Aust NZ J Publ Heal. 2016;40(3):231–2.
Dilkes J, Cunningham CJG. The new Australian curriculum, teachers and change fatigue. Aust J Teacher Educ. 2014;39(11):45.
Harris A, Ammermann M. The changing face of creativity in Australian education. Teaching Educ. 2016;27(1):103–13.
Guérin LJF, Sins PHM, van der Ploeg PA. Citizenship education: the feasibility of a participative approach. Educ Res. 2013;55(4):427–40.
Institute of Education Sciences (IES). Reducing behaviour problems in the elementary school classroom. 2008 [24.8.16]. Available from: http://principals.in/uploads/pdf/Classroom_Management/Reducing_Behavior.pdf
Simonsen B, Fairbanks S, Briesch A, Myers D, Suagi G. Evidence-based practices in classroom management: considerations for research to practice. Educ Treat Children. 2008;31(3):351–80.
Pritchard A, Woollard J. Psychology for the classroom: constructivism and social learning. Abingdon, Oxon: Routledge; 2010.
Lemstra M, Bennett N, Nannapaneni U, Neudorf C, Warren L, Kershaw T, et al. A systematic review of school-based marijuana and alcohol prevention programs. Addiction Research & Theory. 2010;18(1):84–96.
Parry B. Popular culture, participation and progression in the literacy classroom. Literacy. 2014;48(1):14–22.
Primack BA, Fine D, Yang CK, Wickett D, Zickmund S. Adolescents’ impressions of antismoking media literacy education: qualitative results from a randomized controlled trial. Health Educ Res. 2009;24(4):608–21.
Austin EW, Miller AC-R, Silva J. The effects of increased cognitive involvement on college students’ interpretations of magazine advertisements for alcohol. Commun Res. 2002;29(2):155.
Hobbs R. The seven great debates in the media literacy movement. J Commun. 1998;48(1):16–32.
Wilson DB, Gottfredson DC, Najaka SS. School-based prevention of problem behaviors: a meta-analysis. J Quant Criminol. 2001;17(3):247–72.
Pinkleton BE, Austin EW, Cohen M, Chen Y-CY, Fitzgerald E. Effects of a peer-led media literacy curriculum on adolescents’ knowledge and attitudes toward sexual behavior and media portrayals of sex. Health Commun. 2008;23(5):462–72.
Wilksch SM, Tiggemann M, Wade TD. Impact of interactive school-based media literacy lessons for reducing internalization of media ideals in young adolescent girls and boys. Int J Eat Disorder. 2006;39(5):385–93.
Gauntlett E, Hugman R, Kenyon P, Logan P. A meta-analysis of the impact of community-based prevention and early intervention. Canberra: Commonwealth Department of Family and Community Services; 2001.
We thank the teachers and students in the school study sites for assistance with this project.
No funding was secured for this project.
Availability of data and materials
Data and materials are available by contacting the corresponding author.
CG conceptualised and designed the study, conducted data collection at all of the sites, carried out the initial analyses, and drafted the initial manuscript. KL has expertise in literacy, specifically media literacy education. She conceptualised and designed the study, provided feedback on the identified themes, and reviewed and revised the manuscript. SJ has expertise in health, specifically alcohol prevention and critical marketing. She conceptualised and designed the study, provided feedback on the identified themes, and reviewed and revised the manuscript. SH reviewed and revised the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
The teachers, students (and students’ parents) gave informed written consent to publish the provided data.
Ethics approval and consent to participate
The study protocol was approved by the University of Wollongong Human Research Ethics Committee (ethics number: HE14/361), the State Education Research Application Process (SERAP no. 2014112) and the participating schools. The teachers, students (and students’ parents) gave informed written consent to participate in the study.
About this article
Cite this article
Gordon, C.S., Kervin, L.K., Jones, S.C. et al. Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs. BMC Public Health 17, 155 (2017). https://doi.org/10.1186/s12889-017-4031-3
- Process evaluation
- Media literacy
- Cultural context