- Research article
- Open Access
- Open Peer Review
Increasing children’s physical activity through a teaching-assistant led extracurricular intervention: process evaluation of the action 3:30 randomised feasibility trial
© Jago et al.; licensee BioMed Central. 2015
- Received: 19 August 2014
- Accepted: 3 February 2015
- Published: 18 February 2015
Many children do not engage in recommended levels of physical activity (PA), highlighting the need to find ways to increase children’s PA. Process evaluations play an important role in improving the science of randomised controlled trials. We recently reported the results of the Action 3:30 cluster randomised feasibility trial illustrating higher levels of moderate to vigorous intensity PA among boys but not girls. The aim of this paper is to report the process evaluation results including intervention fidelity, implementation, context and how intervention components and trial design could be improved before proceeding to a definitive RCT.
Children’s session enjoyment was assessed every two weeks. Reasons for non-attendance were provided by questionnaire at the end of the intervention. Post intervention interviews were held with participating teaching assistants (TAs) and school key contacts (KCs), and focus groups were conducted with children in all 10 intervention schools. Interviews and focus groups examined how recruitment and session attendance might be improved and established which elements of the programme that were and were not well received.
Data indicated good intervention fidelity with TA’s adopting enjoyment-focussed teaching styles and the sessions improving children’s skills and self-esteem. Several positive aspects of implementation were identified, including high session variety, the opportunity to work in teams, the child-led sessions and the engaging leader style. In terms of context there was evidence that TA’s faced difficulties managing challenging behaviour and that further training in this area was needed. TAs and KCs felt that recruitment could be improved by providing taster sessions during PE lessons and clarifying the days that the clubs would run at the point of recruitment. The programme could be improved to enhance interest for girls, by including training for managing disruptive behaviour and making some activities more age-group appropriate.
Action 3.30 showed promise but could be improved by ensuring age appropriate activities, providing more appeal to girls and improving recruitment through taster sessions and early establishment of days of the week it is to be offered on.
- Physical activity
- Intervention process evaluation
- Focus group
Regular physical activity is associated with improved psychological well-being and lower levels of cardio-metabolic risk factors including elevated insulin, lipoproteins and blood pressure among children and adolescents . A number of studies have shown that large proportions of children and adolescents do not engage in the current recommendation of an hour of moderate-to-vigorous intensity physical activity (MVPA) per day [2-4]. Physical activity levels also decline with age, with a recent meta-analysis reporting an average decline of 7% per year during adolescence . The end of primary (elementary) school is therefore an important period in which children’s physical activity behaviours are established. Systematic reviews of physical activity interventions for children have identified that interventions typically yielded small or no improvements in levels of MVPA [6,7]. There is therefore a need to find new, more effective physical activity interventions.
The majority of physical activity interventions for children and adolescents have been delivered at school during the key contact time of the established curriculum (e.g., changes to physical education delivery) . A possible reason for the failure of these interventions is the difficulty of using curriculum time for activities that are not aligned with core educational aspirations [8,9]. The time allocated to PE in the UK curriculum is also limited to around 2 hours per week and therefore there is limited time within which to help less active children to develop the skills and confidence to be active. As such, extra-curricular interventions which harness the infrastructure of the school (buildings, location, key target audience), but do not impinge on educational time may provide a unique opportunity to facilitate physical activity behaviour change among children and young people . Teaching assistants (TA) work in the classroom setting and help teachers to support children with tasks such as reading, writing, and maths in both large groups and on a one–to-one basis, and are a group that could be trained to deliver physical activity sessions for children. A 2009 systematic review of extra-curricular interventions identified 13 papers reporting the results from 11 different studies of which only one had included objective assessments of children’s physical activity . None of the studies were conducted in the United Kingdom  and none included Teaching Assistants. A separate 2009 review highlighted the current methodological weakness of evaluations of after-school interventions and highlighted a need for more well-controlled trials . Thus, there is a need to robustly examine the viability and effectiveness of extra-curricular physical activity interventions in UK schools.
Process evaluations are integral elements of complex behaviour change interventions  which scrutinise intervention delivery, receipt and implementation [13-15]. A key goal of a process evaluation is to provide insight into whether an intervention “does” or “does not” work, that is, whether the intervention in itself is ineffective or whether the lack of effect is due to poor intervention implementation . Key features of a process evaluation are the dose delivered, the reach (or number of people who receive the intervention), fidelity (extent to which the intervention was delivered as planned), implementation (how well the programme was implemented) and context which provides critical information on the environment in which the programme was delivered . Process evaluations are also very helpful during the development and piloting of interventions [17-19]. Process evaluations can capture information on how the intervention may work in a trial setting as well as gather feedback from participants, intervention deliverers and key stakeholders on how the intervention content could be improved to maximise the potential for behaviour change. Information that can enhance the running of a trial such as feedback on maximising recruitment, increasing adherence and maximising attendance can also be obtained and used to refine, and improve the trial design prior to conducting a larger, fully powered randomised controlled trial .
We have recently reported the results of the Action 3:30 feasibility trial, which was conducted in 20 primary schools (10 intervention and 10 control schools) [20,21] and focussed on increasing the physical activity levels of Year 5 and 6 pupils (9–11 years of age). The 10 intervention schools received the Action 3:30 intervention, which consisted of a 5-day training programme for two TAs per school, who subsequently co-delivered a 40-session after-school physical activity programme (2 × 60 minute sessions per week, for 20 weeks). Up to 30 Year 5/6 children in each school opted to join the study and agreed to attend the Action 3:30 club if their school was randomised to the intervention group. The 40-sessions included adaptations of traditional team sports, small-sided games, and a session in which the children led the activities. Children attending the Action 3:30 clubs received a hand-out after every four sessions (i.e. every 2 weeks) of activities that had been taught during the sessions that they could practice at home.
The strategies that underpinned the delivery were based on the self-determination theory (SDT) principles of building confidence, autonomy and a sense of belonging . Specifically, the sessions were designed to increase the children’s interest in and enjoyment of physical activity and enjoyment was designed to have been facilitated by the TAs adopting a friendly, engaging communication style, in order to boost the children’s skills, confidence, and self-esteem. Due to space constraints, the degree to which the intervention was delivered in a way that was consistent with SDT will be presented in a separate paper and a link to the publication posted on the project website (http://www.bristol.ac.uk/sps/researchprojectpages/action330/).
The feasibility trial analysis suggested that boys in intervention schools obtained 8.6 more minutes of MVPA on weekdays than boys in the control group at the end of the program, but this was not sustained four months after the programme had ended . There was no evidence of an effect on MVPA among girls. In terms of dose delivered, all 40 sessions were delivered in five of the 10 schools, with 3 schools running 39 sessions, one 38 and one 29 . Analyses showed that the mean attendance across the sessions in the 10 intervention schools was 53%, with considerable between-school variability; one school achieved a mean attendance of 86% with all enrolled pupils attending at least half of all sessions, whereas two schools had a mean attendance of 39% and 36% . Thus, the intervention had a reasonable level of reach and a high dose of the intervention was delivered but more work is needed to increase levels of attendance. While these results add to the evidence base for the potential of extra-curricular interventions, they do not provide information on intervention fidelity, implementation, context or why the intervention appeared to be more effective for boys than girls, and how it could be improved to facilitate the desired behaviour change. Thus, the aim of this paper is to report on the results of the process evaluation of the Action 3:30 intervention, with a particular focus on how the intervention was delivered, investigating why the intervention results differed by sex, and ways in which the intervention could be improved before proceeding to a fully-powered trial.
The process evaluation included qualitative and quantitative components. The quantitative data were collected during the intervention period and focussed on intervention fidelity and dose. The qualitative data were collected at the end of the 20-week intervention and consisted of interviews with the TAs who delivered the intervention, interviews with school contacts in both intervention and control schools who facilitated the logistics of the study taking place in their school, and focus groups with intervention participants (children) in all intervention schools. In the sections below we provide an overview of these data including participants, data sources and data interpretation. The study was approved by an ethics committee at the University of Bristol, with written informed consent obtained for all adult participants. As the children were in Years 5 or 6 (9–11 years of age) written informed parental consent was obtained.
Participants in intervention schools were asked to complete a perceived enjoyment questionnaire every two weeks. The questionnaire consisted of a single item referring to their enjoyment of that day’s session (“Please circle the number that shows how much you enjoyed Action 3:30 today”). Children responded using a 5-point Likert- type scale ranging from 1 (”Not at all”) to 5 (”A lot”). The mean score at each time was computed for each school as well as an overall mean per week across the schools. A multi-level model, using school, pupil, and occasion as the levels, was used to estimate the proportion of variability in the enjoyment ratings given by each pupil on each occasion that was attributable to each level in the model. Results from this model are interpreted as the amount of variation within pupils, between pupils, and between schools.
To understand whether participation in Action 3:30 was accompanied by a reduction in other after-school activities involving physical activity, children in intervention schools were asked on five occasions (weeks 0, 5, 10, 15 and 20) to report in open-response format what they did on each day that week after-school but before tea-time (or dinner time) (“Please tell us what organised activities (or clubs) you do at the moment after school but before tea time.” Responses for each day at each of the five time points were subsequently coded into six categories: 1) Organised team sports; 2) Unstructured activities; 3) Structured PA classes; 4) Structured youth clubs; 5) Structured sedentary activities; and 6) Independent sedentary activities. The six activities were subsequently collapsed into three categories (active events, youth clubs, and sedentary events). For each activity type a total was computed for individual participants by summing the number reported each day. Finally, at the end of the intervention period all participants in intervention schools who had missed at least one club session were asked to indicate how much they agreed with 13 reasons for non-attendance (e.g., When I signed up I thought it would be different). The content of the thirteen items was informed by conversations held between project staff, school staff and pupils on reasons why children did not attend. Responses were scored from 1 (Not true for me) to 5 (Very true for me). An average rating for each reason was computed. This was subsequently collapsed into three categories by combining responses of ‘Not true for me’ with ‘Not really true for me’, and ‘Often true for me’ with ‘Sometimes true for me’.
The two TAs in each of the ten intervention schools were invited to participate in a semi-structured interview and 18 (16 female) of the 20 agreed to take part. Interviews were conducted by a researcher with qualitative research experience but no other involvement in the project. A topic guide was designed to explore the following: views on the training received, general opinions towards the intervention, participant attendance, the perceived impact of the intervention on participants, possible improvements, and the impact of the study on the TAs themselves. The interviewer also pursued any emergent issues that were not on the original interview guides and these topics were then added to all subsequent interviews in an iterative process.
Key contacts (KCs) were the member of school staff in each of the 20 schools who had responsibility for liaising with the research team about the trial (either intervention or control). Typically, KCs were a head of year or the physical education coordinator within the school. All 20 KCs were invited to take part in a semi-structured interviewed and 12 (6 intervention, 6 control) agreed to participate. The KC interview guide covered the following topics: reasons for the school participating in the study, positives and negatives of the study, the perceived impact of the intervention on participants and the TAs involved, attendance, and possible improvements.
A focus group was conducted in each intervention school (n = 10) with six children who were enrolled in the study per focus group. To ensure that data were collected from a range of participants, the focus group participants were purposively sampled to recruit a boy and a girl from each third of attendance per school (i.e. a total of 3 boys and 3 girls per school). An additional boy and girl were randomly selected from each attendance group as reserves in case of any absences on the day of the focus group. The focus group was semi-structured and the guide included the following topics: why children enrolled, activities that were/were not enjoyed, the impact of the intervention on their physical activity and interest in physical activity, and their opinions regarding the Action 3:30 Leaders.
Qualitative data analysis
Interviews and focus groups were recorded using an encrypted dictaphone and transcribed verbatim. All transcripts were read and re-read by multiple members of the research team and an initial coding frame constructed by four authors (BD, KB, SJS and RJ). Interviews and child focus groups were imported into NVivo (Version 10, QSR, Southport, UK) and coded as individual case nodes. A thematic framework approach was used for data analysis in which the initial coding framework was applied to the three data sources . Researcher triangulation was employed in which themes were identified by one author and verified by two additional authors. Themes were then developed by combining similar codes and were compared between the different sources of data to provide a rich account of the intervention within and between schools and informants. A framework matrix was then created to enable themes to be compared across different sources of data (i.e., children, TAs and key contacts). Reporting of the qualitative data is consistent with RATS guidance.
Mean number of active after school activities, youth clubs and sedentary activities reported per week by pupils attending Action 3:30 clubs overall stratified by gender
Improving recruitment and attendance
“I think if we could have given a taster beforehand, because I think the children thought it was going to be more of, “You’re going to lose weight. You’re going to do this. You’re going to do that”. I think their perception of what it was, was something slightly different. I think the take-up would have been different had they realized it was such a good after school physical activity club.” (KC, Female, School 6, Intervention).
“So we thought perhaps we could’ve, do a taster session for all of our Year 5 s. To come along, have a go, see what they think, because I think, again, people just didn’t know …” (TA, Female, School 6).
“I wish we could have chosen the children that attended. I know there was children there that didn’t really get a hundred percent out of it, but children that weren’t allowed to go [not part of the club] would have.” (TA, Female, School 4).
“That’s one other thing that could have been maybe changed; was actually involving the TAs beforehand in the actual process of thinking about what kids it would be good to get to do it. You feel like, “Oh, there’s some kids. It would be so good if we could have had that kid join in.” (TA, Male, School 16).
“…I think maybe if there had been a charge or some sort of agreed commitment that made a difference…” (TA, Female, School 19).
“…we ask the children to make a commitment… for our children at school is that we usually say that they, they need to do it for at least a term…”(KC, Female, School 4, Intervention).
“They didn’t know the days. We had to fit it around other clubs here. I was doing a course, so it couldn’t be on Thursdays. We, literally, were forced to do a Monday and a Wednesday, so some of them couldn’t come for those reasons…” (TA, Female, School 2).
“Well, I couldn’t go any of the Mondays because I was doing another club.” (Participant 6, Male, School 2)
“I had a club on one day…Fencing on a Tuesday so we couldn’t come on a Tuesday. So … we came on a Thursday.” (Participant 5, Male, School 16).
[talking about attendance] “It kind of went down. I mean, one time I had five, maybe four people…So it’s very difficult to do the session plan …” (TA, Female, School 9).
“I think the 3.30 leaders are incredible…They’re helpful, they explain things to us if we don’t actually understand, and many other things.” (Participant 6, Female, School 4).
“They ask if we don’t understand as well.” (Participant 1, Male, School 10).
“They were encouraging us to play, and when we didn’t like a game they were kind of encouraging us to like play it and even if we didn’t like it they were encouraging us to play.” (School 6, Participant 5, male).
Impact on motor skills, confidence, and self-esteem
“In terms of their confidence, their skills, I would say that that would have definitely improved. Their agility and their physical abilities have improved…” (TA, Female, School 6).
[Talking about the children’s physical skill improvement]“A couple of children in particular have, because they’re more willing to have a go; they’re not as bad as they thought they were.” (TA, Female, School 8).
“…I’m not a very sporty person… not good at sports, but I’ve improved since I’ve done it.” (Participant 6, Male, School 10).
“…and other children, you know, the other by-products have been … virtually all of them feel, or appear to feel much more confident in themselves, have joined other clubs as well. You know, we’ve got virtually a 100 percent take-up rate on, on extracurricular activities now, across the school…”(KC, Male, School 8, Intervention).
“I think definitely for some of the girls and a lot of the more sort of timid boys. I think it was brilliant for them…Development and coordination and just confidence as well for girls. Just being able to get stuck in…Their confidence comes out really well.” (TA, Female, School 12)
“It got me more confident about some of the sports that I hadn’t done much of… Because there were some sports that… I know and I’m really quite good at and there were sports that I don’t play much and it helped me get my confidence up on it.” (Participant 2, Male, School 12).
Enjoyment, teamwork and session variety
“Well, we expected it be like, like ‘do this, do this!’, but they give us choices, and we had the child- led sessions as well, which I didn’t expect.” (Participant 3, Male, School 9).
“I think it’s like, I think I’m like, it helped me like work as a team, because most of the games, like it needs like a group to play it…” (Participant 5, Female, School 12).
“I think the children understand teamwork better, and I think I do too because you don’t have to be a brilliant player at something.” (TA, Female, School 8).
“I think that it has further developed; they’ve got very good team working skills already, the children here have got really good relationships, but I’m sure it’s further developed them in a really structured programme.” (KC, Female, School 10, Intervention).
“Like if we were playing that, football, you’d … TA1 and TA2 would change the rules like every five minutes, so then there was this one time when we were playing football and then we were allowed to use our hands” (Participant 5, Male, School 10).
“…there’s tons of sports that I like and I just like the way that you play them with the different types of ways and all different rules.” (Participant 3, Male, School 19).
“I like Action 3.30 because you can try lots of different sports that you’ve never tried before.” (Participant 2, Male, School 4).
So like when the children sessions were on, I really enjoyed it because like we could choose our game.” (Participant 6, Male, School 2).
“Because we were allowed to choose what we wanted to do instead of having to follow what Miss chose for us to do.” (Participant 3, Female, School 4).
“Because you get to make up your own little discoveries and stuff. I don’t know how to pronounce it better.” (Participant 6, Female, School 4).
“I think the way it gets everyone involved worked really well and the fact that the children can be involved in planning the sessions because some of them are pupil-led, so they get involved” (TA, Female, School 19).
“The children go, ‘Oh, that was boring,’ or, ‘Oh, I don’t want to do that’…especially the girls.”(TA, Female, School 8).
“…some of the kids were, some of the girls in particular. It eludes me why they signed up in the first place … they weren’t really that interested.”(TA, Female, School 12).
“…the boys just pass to each other and not to the girls, because they don’t really think that they’ll score or anything, and they’ll just let it go to the other team. They just play with each other. It’s not really fun because all the girls just stand around, waiting for someone to … the ball to come to them, but it never does so they don’t really get to play.” (Participant 2, Female, School 10).
“Yeah, and that the boys would never pass to the girls.” (Participant 3, Female, School 16).
TA participation and involvement in the sessions
“…our leaders…they don’t mind and they join in sometimes. It just makes it quite enjoyable.” (Participant 3, Male, School 6).
“I found that they joined in with the games, which made us feel a lot more good with the games, because we knew they were not just sitting around watching us do it.” (Participant 6, Female, School 9).
“Maybe there wasn’t quite enough [training] in terms of how to…what scenarios to do when you’ve got children that are difficult, to what to do. If there’s persistent problems, what’s the … what should you do with these kind of children?”(TA, Male, School 16).
“[talking about behaviour management training] That probably would have been more beneficial than … I know we needed lots of practical stuff… we could’ve shared ideas more and I think we did in one, the booster session, but not in any great detail.“(TA, Female, School 2).
“It was like, loads of kids shouting and screaming and doing disrupting and stuff. So it was really hard to like, get on with what we’re actually doing with the sport” (Participant 2, Female, School 19)
“Sometimes they [TAs] could be not strict enough and when somebody kind of goes off, they … they kind of, um, not really know what to do that much.”(Participant 5, Male, School 16).
Key issues to consider in any revision of the intervention
“They weren’t babyish but they were … [the children] were a bit too old for them [the activities].” (Participant 5, Female, School 8).
“…we felt for year 5 and 6, a lot of the games weren’t age appropriate. It's difficult with year 5 and 6 because sometimes you can get a really mature group … a lot of them were in teams outside school as well.” (TA, Female, School 12).
“…maybe to grab them that year earlier sort of year four / five, because while they’re still that little bit more open to suggestion and they’re not as worried to look a bit silly in front of their friends, and again the hormones just aren’t there. And they haven’t got the SATs.” (TA, Female, School 8)
Considering the opinions of a range of children:
“… rather than listening to everyone or different people, it was the same people. (Participant 1, Male, School 8).
“They listened to maybe two or three and like there’s lot in the session, there’s about twenty five in the club so they would only listen to two or three and lots of people were dying to see their rule but they, they just went with the first one they heard usually.” (Participant 2, Female, School 10).
Amount of content per session
”…sometimes we’d have really fun sports that only lasts like, two minutes. And it’s just go along to something boring… I at least want to have time to get into it and start to enjoy it, instead of just doing it for like, two minutes then getting on to something that I don’t like doing.” (Participant 3, Male, School 19).
“Having it an hour long and trying to fit quite a lot into it, we realized fairly early on that you’re trying to cover too much stuff. The kids were getting a little bit agitated a lot by the changing.” (TA, Male, School 16).
“There’s things you, maybe some of the games I didn’t quite understand….So, I have to get my head around that and then I would go email [the Action 3:30 trainer]…You know, could you just describe this.” (TA, Female, School 4).
“…it would be nice to have a DVD of the different activities and how they are because…in the manual sometimes the games are not explained very clearly sometimes.” (TA, Female, School 19).
More challenging activities
“You could like add like new rules to make the game…If it’s challenging, then, it be like harder it’d be more fun.” (Participant 5, Male, School 10).
“I don’t really find the activities that hard because they were just like, once they were set they didn’t like change anything more harder, they were just not very hard.” (Participant 2, Female, School 6).
“When we done dodgeball first, it was like before we changed it, we had to sit out a little…It’s boring.” (Participant 5, Female, School 9)
“Because it wasn’t really sports that you would ever have in the Olympics because there was like …we weren’t like, doing sports that you would really do because it was just like jumping over like, these really like, small hurdles.” (Participant 4, Female, School 16).
“I thought most of them would be just for family because it said ‘teach your family and friends.’ So I thought I’d ask my family, but they all said no, so I thought, what was I going do with that on my own?” (Participant 2, Male, School 2).
“Like some of the paragraphs of the games to play didn’t have pictures. So, on one of them, I read the information and I liked it, but there was no pictures so I didn’t get the aim of the game, so I was a bit stuck.” (Participant 1, Male, School 10).
General improvements to the Action 3:30 intervention based on process evaluation findings
Reason for improvement
Identify the commitments of the children before selecting the days the club will run.
Children didn’t know which days the club would run on. This meant some children had other competing commitments and couldn’t always attend.
Identify the best days for the club to run to maximise attendance (i.e., avoiding clashing with alternative school activities)
Amend hand-outs so they can be used by children on their own in addition to with others (if possible)
The activities on the hand-outs were often designed for use with family and friends but some children said they couldn’t use them when they had no one to play with. The hand-outs could have more pictures of the game being played.
• Adjust games to include more games that can be played solo.
• Include more pictures of the game being played.
• Include more games that don’t need special equipment or suggest alternatives
TA & CFG
Revise programme to increase engagement of girls
TAs: Girls were less interested in the club and presented a greater challenge than the boys in terms of motivation. CFG: Boys tended to dominate team games
• Adapt session plans to include activities that will engage girls and identify ways to make session more appealing to girls (i.e. less direct completion and more within person goal setting and monitoring)
TA, CFG & KC
More age appropriate sessions
TAs: Some of the games were too easy (especially for those who played sports outside of school);
• Amend sessions that are too easy
• Lower age group to year 5
TA & KC
Conduct intervention in Year 5 s not 5 & 6
Year 6 s tend to be less enthusiastic (especially girls) & have SATS, & thus a younger group may have higher attendance.
Proposed changes to the Action 3:30 leaders’ manual and training programme based on process evaluation findings
Reason for improvement
Reduce the amount of content in each session
TAs: Children would become agitated when having to regularly change activities; CFG: More time should be given to one activity so it can be played properly.
• Amend individual session plans by reducing number of activities and allowing time for children to experience and master tasks as well as making them more difficult
Improve the clarity of the session plans
Some TAs found some sessions hard to understand. A DVD/video of activities could be a helpful resource.
• Review sessions plans for clarity
• Produce a DVD of activities or series of online videos that TAs can refer to.
Changes to specific activities
1) Exclusion games (e.g. dodge ball) can be boring. Children wanted activities to reflect the nature of the sports they were based on, and seemed to value these more as “sports that you would really do”
1) Include options for TAs to utilise to keep all children involved in an activity (instead of sitting out)-cover this more in training.
2) Include athletics activities that the children can relate to & avoid activities such as running laps.
Reason for improvement
TA & CFG
More behaviour management training
TA: Dealing with bad behaviour was disruptive to club but the training didn’t cover enough on behaviour management
• There should be less practical & more time allocated to behaviour management & for TAs to share ideas.
Training could allow time for TAs to share ideas
Instead of mostly practical based training, scheduling time for TAs to share their ideas on running the club would be helpful.
• TAs may want to seek an agreed behaviour policy with school, so they can act confidently.
Adapt activities to make them more challenging
Games should be made more challenging to keep them exciting to the children (add new rules & twists).
• More training on adapting games to make them more challenging
TAs should get involved with activities (if possible)
Some children said they liked it when TAs joined in with them; this made the games more enjoyable.
• Encourage TAs to join in with activities as a strategy to aid enjoyment and understanding
Consider children’s opinions & activity choices & make sure decisions are fair.
Children said that not everyone was listened to when children were given choice over activities or when offering rule changes to games.
• Training should include ways of making sure that everyone gets a fair say in the activities
The data presented in this paper have shown that the Action 3:30 intervention was implemented reasonably well but that some revisions to the content which consider the context in which it is delivered are necessary before further evaluation is warranted. Specifically, the children, KCs and TAs liked many elements of the Action 3:30 clubs. Specific elements of the intervention that were well-received included enjoyment of the sessions, the opportunity to build teamwork, the range of choice across all activities (particularly the child-led sessions), and the engaging, empowering TA leadership style. These positive elements of the sessions were perceived to have led to increases in the motor skill-level, the confidence and self-esteem of many of the children, and particularly children who were not previously active. Thus, the data presented in this paper have shown that it is possible to train TAs to deliver enjoyable and effective physical activity programmes after school.
The exit questionnaire data showed that there was a small reduction in attendance at other types of clubs among the intervention group over the period that the programme was running, and that a key reason why the children did not attend Action 3:30 clubs was that they had another after-school commitment. These findings suggest that to some extent the children who attend extra-curricular physical activity programmes will switch from one programme to another, and as a result any intervention effect that might be obtained from new interventions such as Action 3:30 is likely to be attenuated. There was also some evidence that the clubs were more difficult to lead when there were lower levels of attendance, suggesting that attendance might have adversely affected programme delivery. However, we previously reported that the boys who attended the Action 3:30 clubs were obtaining 8.6 more minutes of MVPA per day than the control group at the end of the intervention period. Thus, it is possible to use extra-curricular provision to increase activity; however, the programmes have to be superior to existing provision. Our findings are therefore consistent with previous research that has identified extra-curricular interventions as a relatively under-explored approach to increasing children’s physical activity [10,20]. However, revisions to the Action 3:30 programme are needed to maximise the potential benefit for all children, including children who may be switching from another after-school programme.
The focus group data showed that the children particularly appreciated having choice and a sense of ownership over the activities they were taught during the sessions. The quantitative data also showed children enjoyed the sessions although it is important to note that the enjoyment ratings were only completed by children attending the sessions and it seems likely that children who did not enjoy the programme would be less likely to attend. Less than 1% of the variation in enjoyment ratings was attributable to between-school differences suggesting that sessions were delivered consistently in different schools, and session leaders were comparable across schools. The Action 3:30 intervention therefore holds promise as an intervention approach.
Recruitment could have been improved by allowing potential participants to attend taster sessions, perhaps during physical education lessons as part of the recruitment process. This finding is consistent with our recent experience in which we have found that running dance taster sessions is an important route to successful recruitment of girls into an extra-curricular dance intervention [24-27]. Moreover, attendance is likely to have been enhanced by identifying at the point of recruitment, the days of the week when potential sessions would run, and agreeing attendance commitments with the children. Each of these three ideas would be consistent with standard processes for extra-curricular physical activity programmes in schools, and therefore use of these approaches would enhance the external validity of the programme. Implementing these processes into the scope of a trial is, however, more difficult. To facilitate randomisation after baseline data have been collected, it is usually necessary to conduct the recruitment process several months prior to the intervention beginning. Thus, to facilitate the research design, schools need to agree to hold time slots in their extra-curricular timetable, identify potential staff to attend sessions and to facilitate a fair test of the intervention by specifically not offering an alternative programme if their school is assigned to the control arm. All of these options are possible but they require considerable buy-in to the research process that would need to be handled sensitively within the school setting.
The three key stakeholders (participants, TAs and KCs) provided suggestions for general improvements to the Action 3:30 clubs and these are summarised in Table 2. The most significant suggestions were to increase the motivation and interest of girls, and to lower the age group to Years 4 and 5 as opposed to Years 5 and 6. The age appropriateness of the programme was highlighted in both the qualitative findings and the reasons children gave for non-attendance. The mean value for the item “the activities were too easy” was relatively high thereby suggesting that age appropriateness affected both attendance and perhaps also enjoyment and participation. The suggestion to change the programme content to increase its appeal to girls is consistent with the previously published data from this project which has shown that the intervention led to an 8.6 minute increase in the PA of the boys but no effect on PA of the girls. A body of work has shown that boys are generally more active than girls and that there is a steeper decline in the activity levels of girls as compared to boys as they approach adolescence [28-30]. A number of studies have specifically focussed on increasing the activity levels of girls [26,31] but consistent with most child-focussed interventions, the effect of these studies has been limited [6,7]. Thus, it is not clear whether sex-specific programmes or combined programmes are likely to be of greatest benefit. Conversations between the project team and local school staff suggest that it would be logistically challenging to provide separate programmes for boys and girls in UK primary schools. Identifying ways to develop extra-curricular physical activity programmes that appeal to both boys and girls is a challenge that needs to be met. Thus, we feel that the critical revisions that are required are to improve the appeal of sessions to girls and change the focus to Year 4 and 5 pupils.
The three key stakeholders suggested that the session content could be improved by reducing the number of activities per session, using videos to model session plans and finding ways to engage the children more in the activities (Table 3). There were also suggestions that the training would benefit from a renewed focus on how to manage disruptive behaviour and how to adapt the individual sessions to the needs of each particular group. This finding is consistent with our previous work in developing an after-school dance intervention for secondary school aged girls, in which we found that behaviour management is a critical issue, as disruptive students can make delivery of the sessions hard, and negatively affect the atmosphere within the sessions [26,27]. The children also suggested that the programme could be improved by engaging the children themselves in the behaviour management process, setting up agreed conduct codes and ground rules and encouraging the TAs to join in with the sessions. These are all changes that could be incorporated into a revision of the Action 3:30 programme
The findings presented in this paper show that the intervention holds promise and that several key components of the intervention such as session enjoyment, choice over the activities, leadership style and developing the skill and self-esteem of participants may well function as mediators of the intervention in a larger, cluster randomised controlled trial [13,32]. (As noted above, these issues will be addressed in a separate paper which focuses on the SDT aspects of the study). The data also suggest that results may differ for boys and girls. Including assessments of each of these constructs in a future trial would therefore be helpful in understanding intervention effectiveness. The use of process evaluations to inform revisions to complex interventions is consistent with the MRC framework for complex interventions . A number of studies have reported process evaluations of physical activity based cluster randomized controlled trials [33,34] or the use of process evaluations to refine and improve PA interventions through an iterative process . There has, however, been a relative lack of published studies that have reported on the process evaluations of feasibility trials of physical activity interventions . As such, the data presented in this paper provide a unique and valuable example of how a process evaluation can be incorporated into feasibility trials and used to inform the refinement of key intervention components before proceeding to a full trial.
Strengths and limitations
The major strength of this study is the availability of quantitative and qualitative data from all of the key stakeholders in the intervention. These various sources of information have enabled us to increase our understanding of how the intervention was received and perhaps, more importantly, how it could be improved. The major limitation of the study is that the data reflect the views of stakeholders who received a particular intervention in the Southwest of England, limiting the potential to extrapolate to other extra-curricular interventions in other contexts.
The Action 3:30 intervention holds considerable promise with the data reported in this paper showing that many children enjoyed the intervention, that the session content was well received by the children and school staff, and that the programme was perceived to have positive effects on the self-esteem and physical activity skill level of many children. The programme could be improved by making the sessions more appealing to girls and focussing on Year 4 and 5 children. In terms of trial design, recruitment into the trial could have been improved by providing taster sessions of Action 3:30 sessions during PE lessons and clarifying the days in which the clubs would run at the point of recruitment.
Availability of supplementary data
Anonymised versions of the data from the Action 3:30 project have been deposited in the University of Bristol Research Data Repository (http://data.bris.ac.uk/data/) and will be made available to external collaborators from September 2016.
This study was funded by the National Prevention Research Initiative which is supported by Alzheimer’s Research Trust; Alzheimer’s Society; Biotechnology and Biological Sciences Research Council; British Heart Foundation; Cancer Research UK; Chief Scientist Office, Scottish Government Health Directorate; Department of Health; Diabetes UK; Economic and Social Research Council; Health and Social Care Research and Development Division of the Public Health Agency (HSC R&D Division); Medical Research Council; The Stroke Association; Wellcome Trust; Welsh Assembly Government; and World Cancer Research Fund (MRC reference - MR/J000191/1).
We would like to thank all of the schools, teaching assistants and pupils who took part in this project. We would also like to thank Darren Gillett from Bristol City Council who assisted with the design of the intervention components and led the teaching assistant training programme. We thank Professor Ashley Cooper from University of Bristol for advice provided during the course of this project. Finally, we would like to thank the independent members of our local advisory group and trial advisory group for their input and guidance during this project.
- Strong WB, Malina RM, Blimkie CJ, Daniels SR, Dishman RK, Gutin B, et al. Evidence based physical activity for school-age youth. J Pediatr. 2005;146(6):732–7.View ArticlePubMedGoogle Scholar
- Riddoch CJ, Mattocks C, Deere K, Saunders J, Kirkby J, Tilling K, et al. Objective measurement of levels and patterns of physical activity. Arch Dis Child. 2007;92(11):963–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Griffiths LJ, Cortina-Borja M, Sera F, Pouliou T, Geraci M, Rich C, et al. How active are our children? Findings from the millennium cohort study. BMJ Open. 2013;3(8):e002893.View ArticlePubMedPubMed CentralGoogle Scholar
- Department of Health (UK). Start Active, Stay Active: A report on physical activity from the four home countries’ Chief Medical Officers. London: Department of Health; 2011. p. 1–59.Google Scholar
- Dumith SC, Gigante DP, Domingues MR, Kohl 3rd HW. Physical activity change during adolescence: a systematic review and a pooled analysis. Int J Epidemiol. 2011;40:685–98.View ArticlePubMedGoogle Scholar
- van Sluijs EM, McMinn AM, Griffin SJ. Effectiveness of interventions to promote physical activity in children and adolescents: systematic review of controlled trials. BMJ. 2007;335(7622):703.View ArticlePubMedPubMed CentralGoogle Scholar
- Dobbins M, Husson H, DeCorby K, LaRocca RL. School-based physical activity programs for promoting physical activity and fitness in children and adolescents aged 6 to 18. Cochrane Database Syst Rev. 2013;2:CD007651.Google Scholar
- Jago R, Baranowski T. Non-curricular approaches for increasing physical activity in youth: a review. Prev Med. 2004;39(1):157–63.View ArticlePubMedGoogle Scholar
- SPEEDNET. Primary School Physical Education - Speednet Survey makes depressing reading. Br J PE. 1999;30(3):19–20.Google Scholar
- Beets MW, Beighle A, Erwin HE, Huberty JL. After-school program impact on physical activity and fitness: a meta-analysis. Am J Prev Med. 2009;36(6):527–37.View ArticlePubMedGoogle Scholar
- Pate RR, O’Neill JR. After-school interventions to increase physical activity among youth. Br J Sports Med. 2009;43(1):14–8.View ArticlePubMedGoogle Scholar
- Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.View ArticlePubMedPubMed CentralGoogle Scholar
- Baranowski T, Jago R. Understanding mechanisms of change in children’s physical activity programs. Exerc Sport Sci Rev. 2005;33(4):163–8.View ArticlePubMedGoogle Scholar
- Baranowski T, Stables G. Process evaluations of the 5-a-day projects. Health Educ Behav. 2000;27(2):157–66.View ArticlePubMedGoogle Scholar
- Moore G, Audrey S, Barker M, Bond L, Bonell C, Cooper C, et al. Process evaluation in complex public health intervention studies: the need for guidance. J Epidemiol Community Health. 2014;68(2):101–2.View ArticlePubMedGoogle Scholar
- Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Lloyd JJ, Wyatt KM. Qualitative findings from an exploratory trial of the Healthy Lifestyles Programme (HeLP) and their implications for the process evaluation in the definitive trial. BMC Public Health. 2014;14:578.View ArticlePubMedPubMed CentralGoogle Scholar
- Jago R, Sebire SJ, Bentley GF, Turner KM, Goodred JK, Fox KR, et al. Process evaluation of the Teamplay parenting intervention pilot: implications for recruitment, retention and course refinement. BMC Public Health. 2013;13:1102.View ArticlePubMedPubMed CentralGoogle Scholar
- Jago R, Sebire SJ. Publishing pilot and feasibility evaluations of behavioural interventions: Implications for Preventive Medicine. Prev Med. 2012;55:548–9.View ArticlePubMedGoogle Scholar
- Jago R, Edwards MJ, Cooper AR, Fox KR, Powell J, Sebire SJ, et al. Action 3:30: protocol for a randomized feasibility trial of a teaching assistant led extracurricular physical activity intervention. Trials. 2013;14:122.View ArticlePubMedPubMed CentralGoogle Scholar
- Jago R, Sebire SJ, Davies B, Wood L, Edwards MJ, Banfield K, et al. Randomised feasibility trial of a teaching assistant led extracurricular physical activity intervention for 9 to 11 year olds: Action 3:30. Int J Behav Nutr Phys Act. 2014;11(1):114.View ArticlePubMedPubMed CentralGoogle Scholar
- Deci EL, Ryan RM. The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychol Inq. 2000;11:227–68.View ArticleGoogle Scholar
- Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.View ArticleGoogle Scholar
- Jago R, Davis L, McNeill J, Sebire SJ, Haase A, Powell J, et al. Adolescent girls’ and parents’ views on recruiting and retaining girls into an after-school dance intervention: Implications for extra-curricular physical activity provision. Int J Behav Nutr Phys Act. 2011;8(1):91.View ArticlePubMedPubMed CentralGoogle Scholar
- Jago R, Edwards MJ, Sebire SJ, Cooper AR, Powell JE, Bird EL, et al. Bristol girls dance project (BGDP): protocol for a cluster randomised controlled trial of an after-school dance programme to increase physical activity among 11–12 year old girls. BMC Public Health. 2013;13(1):1003.View ArticlePubMedPubMed CentralGoogle Scholar
- Jago R, Sebire SJ, Cooper AR, Haase AM, Powell J, Davis L, et al. Bristol girls dance project feasibility trial: outcome and process evaluation results. Int J Behav Nutr Phys Act. 2012;9:83.View ArticlePubMedPubMed CentralGoogle Scholar
- Sebire SJ, McNeill J, Davis L, Haase AM, Powell J, Cooper AR, et al. Designing extra-curricular dance programmes: UK Physical Education and Dance Teachers’ perspectives. Open J Prev Med. 2013;3(1):111–7.View ArticleGoogle Scholar
- Nader PR, Bradley RH, Houts RM, McRitchie SL, O’Brien M. Moderate-to-vigorous physical activity from ages 9 to 15 years. JAMA. 2008;300(3):295–305.View ArticlePubMedGoogle Scholar
- Ness AR, Leary SD, Mattocks C, Blair SN, Reilly JJ, Wells J, et al. Objectively measured physical activity and fat mass in a large cohort of children. PLoS Med. 2007;4(3):e97.View ArticlePubMedPubMed CentralGoogle Scholar
- Jago R, Anderson C, Baranowski T, Watson K. Adolescent patterns of physical activity: differences by gender, day and time of day. Am J Prev Med. 2005;28(5):447–52.View ArticlePubMedGoogle Scholar
- Webber LS, Catellier DJ, Lytle LA, Murray DM, Pratt CA, Young DR, et al. Promoting physical activity in middle school girls: trial of activity for adolescent girls. Am J Prev Med. 2008;34(3):173–84.View ArticlePubMedPubMed CentralGoogle Scholar
- Baranowski T, Klesges LM, Cullen KW, Himes JH. Measurement of outcomes, mediators, and moderators in behavioral obesity prevention research. Prev Med. 2004;38(Suppl):S1–13.View ArticlePubMedGoogle Scholar
- Hall WJ, Zeveloff A, Steckler A, Schneider M, Thompson D, Pham T, et al. Process evaluation results from the HEALTHY physical education intervention. Health Educ Res. 2012;27(2):307–18.View ArticlePubMedGoogle Scholar
- Collard DC, Chinapaw MJ, Verhagen EA, van Mechelen W. Process evaluation of a school based physical activity related injury prevention programme using the RE-AIM framework. BMC Pediatr. 2010;10:86.View ArticlePubMedPubMed CentralGoogle Scholar
- Wilson DK, Griffin S, Saunders RP, Kitzman-Ulrich H, Meyers DC, Mansard L. Using process evaluation for program improvement in dose, fidelity and reach: the ACT trial experience. Int J Behav Nutr Phys Act. 2009;6:79.View ArticlePubMedPubMed CentralGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.