Increasing community capacity to prevent childhood obesity: challenges, lessons learned and results from the Romp & Chomp intervention
© de Groot et al; licensee BioMed Central Ltd. 2010
Received: 25 January 2010
Accepted: 31 August 2010
Published: 31 August 2010
Obesity is a major public health issue; however, only limited evidence is available about effective ways to prevent obesity, particularly in early childhood. Romp & Chomp was a community-wide obesity prevention intervention conducted in Geelong Australia with a target group of 12,000 children aged 0-5 years. The intervention had an environmental and capacity building focus and we have recently demonstrated that the prevalence of overweight/obesity was lower in intervention children, post-intervention. Capacity building is defined as the development of knowledge, skills, commitment, structures, systems and leadership to enable effective health promotion and the aim of this study was to determine if the capacity of the Geelong community, represented by key stakeholder organisations, to support healthy eating and physical activity for young children was increased after Romp & Chomp.
A mixed methods evaluation with three data sources was utilised. 1) Document analysis comprised assessment of the documented formative and intervention activities against a capacity building framework (five domains: Partnerships, Leadership, Resource Allocation, Workforce Development, and Organisational Development); 2) Thematic analysis of key informant interviews (n = 16); and 3) the quantitative Community Capacity Index Survey.
Document analysis showed that the majority of the capacity building activities addressed the Partnerships, Resource Allocation and Organisational Development domains of capacity building, with a lack of activity in the Leadership and Workforce Development domains. The thematic analysis revealed the establishment of sustainable partnerships, use of specialist advice, and integration of activities into ongoing formal training for early childhood workers. Complex issues also emerged from the key informant interviews regarding the challenges of limited funding, high staff turnover, changing governance structures, lack of high level leadership and unclear communication strategies. The Community Capacity Index provided further evidence that the project implementation network achieved a moderate level of capacity.
Romp & Chomp increased the capacity of organisations, settings and services in the Geelong community to support healthy eating and physical activity for young children. Despite this success there are important learnings from this mixed methods evaluation that should inform current and future community-based public health and health promotion initiatives.
Trial Registration Number
Health promoters and public health practitioners have existing knowledge about what 'works' in health promotion, however the evidence suggests that the majority of the positive outcomes are not sustained . The focus therefore needs to be on ways to make the impacts of public health and health promotion initiatives sustainable, and community capacity building has emerged as one such approach . Community capacity building is about developing sustainable skills, organisational structures, resources and commitment to health improvement in health and other sectors, and prolonging and multiplying health gains many times over . Several resources have been developed for the integration of community capacity building into health promotion practice through project implementation (or 'action') plans (e.g. the New South Wales Health Capacity Building framework)  and this approach is now gaining ground in public health nutrition and obesity prevention [5, 6].
In the context of increasing childhood obesity [7–9] and lack of effective intervention strategies for young children, the obesity prevention demonstration project, Romp & Chomp was established. This project was a community-wide obesity intervention implemented from 2005-2008 with wide stakeholder involvement and funding from the Victorian state government (AU$ 111,200). The target group was 12,000 children aged 0-5 years in the regional City of Greater Geelong (CoGG) in Victoria, Australia. Romp & Chomp had a multi-strategy, multi-settings, community capacity building approach and the intervention program was designed, planned and implemented by several key stakeholder organisations, particularly Barwon Health, CoGG, Geelong Kindergarten Association, Leisure Networks, the Department of Human Services (DHS), Deakin University, Bellarine Community Health, Dental Health Services Victoria, and Kids-'Go for your life'. Deakin University also provided support, training and evaluation of the project. A management committee of stakeholders oversaw the implementation of the action plan and assisted the project coordinators (employed through Barwon Health and DHS) to fulfil their duties.
Romp & Chomp intervention strategies were developed with a strong focus on developing sustainable changes in areas of policy, socio-cultural, physical and economic environments. The action plan had an overarching aim (To increase the capacity of the Geelong community to promote healthy eating and active play and to achieve healthy weight in under 5s') and eight project objectives, with a number of strategies detailed to achieve the objectives. Alongside the intervention was a comprehensive and multi-level evaluation  and we have recently demonstrated that post-intervention, the prevalence of overweight and obesity was significantly lower in intervention children (prevalence declined by 2.5% and 3.4% for 2 and 3.5 year old children respectively) compared to a comparison sample of children (prevalence declined by 0.7% in both age groups) . In addition, positive differences in the diets of children from the intervention sample were also found .
The focus of this paper is the evaluation of Romp & Chomp objective 1: 'to increase the capacity of relevant Geelong organizations to promote healthy eating and active play'. In Romp & Chomp the capacity building strategies were related to increasing leadership, training and funding into the community as catalysts for a cyclic and expanding process of community and organisational change . This paper aims to determine if the capacity of the Geelong community, represented by key stakeholder organisations, to support healthy eating and physical activity for young children was increased after Romp & Chomp.
Triangulation (multiple methods of data collection) was used to increase confidence in the research findings . This involved integrating the results from three mixed methods (document analysis, interviews with key informants, and the Community Capacity Index) to determine the degree of consistency in the results. Inconsistency was not seen to weaken credibility, but rather viewed as informative and illuminative [13, 14].
All available Romp & Chomp documentation was examined for this study. The documents included steering and management committee minutes, all eight versions of the project implementation (action) plans, grant applications, protocols, formative process evaluation, focus group evaluations and project reports. The information from these documents also guided the development of the questions for the semi-structured key informant interviews.
Action Plan Assessment
The Romp & Chomp action plans listed the strategies and associated actions for the implementation of the intervention. These were developed based on stakeholder consultation , evidence available in the literature, previous experiences, knowledge within the project group and consultation with early childhood workers across the four participating early childhood services (Preschool, Family Day Care, Long Day Care and Maternal & Child Health). The action plan was revised throughout the intervention implementation period in accordance with staff turnover, level of capacity, resources available, and the perceived needs of the project management committees. For this study, all versions of the action plans were assessed against the New South Wales (NSW) Capacity Building Framework . This framework was developed to guide effective capacity building practice within health promotion and contains five domains (Partnerships, Leadership, Resource Allocation, Workforce Development and Organisational Development) . In our study this framework was used as a tool to evaluate the intervention strategies designed to build community capacity by mapping the actions documented in the Romp & Chomp action plan into the five domains of this framework. The process was performed by two researchers independently, whereupon outcomes were compared and consensus reached.
Key informant interviews
Key informant interviews (n = 16) were conducted at the end of the Romp & Chomp intervention to gain further insights into the intervention implementation and the ongoing ability of the network implementing and sustaining this project to support healthy eating and physical activity for children. Key informants were identified by the evaluation manager and included individuals from each of the partner organisations who had worked closely with Romp & Chomp or had a significant influence on the project. The key informants were invited to participate in a semi-structured interview and to complete the Community Capacity Index survey (details below). Interview questions concerned the interviewee's role and experiences within the intervention project, communication, sustainability of partnerships and advice for future similar projects. Example questions are: "What was your role within the Romp & Chomp project?"; "What were the major achievements that were made?"; and "Can you describe the communication that existed between the steering and management committees?". Of the seventeen stakeholders approached sixteen were accessible (94%) and interviewed in-person by two researchers, one acting as the primary interviewer and the other was there to act as the primary note taker and to ensure consistency across interviews. The roles were alternated for each interview and the interviews were transcribed and verified. Thematic analysis of the transcripts was conducted  and verified by a second researcher.
Community Capacity Index
The Community Capacity Index (CCI) was used to provide a quantitative assessment of the implementation network at the end of the project. It is difficult to find an instrument that fully captures changes in community capacity and can be used in program evaluation. We chose to use the CCI as one method in a mixed method evaluation of changes in community capacity, alongside the methods described above. The CCI is an evidence-based tool, developed by the University of Queensland and has been trialled in several projects and validated for use in this context . The index examines community capacity across four domains: Network Partnerships (the relationships between the organisations within the community network); Knowledge Transfer (the development, exchange and use of information within and between the organisations and groups within the community network); Problem Solving (the ability to identify and solve problems arising in the development and implementation of the program); and Infrastructure (the level of investment in the network by the organisations). For each of the first three domains there are three levels of capacity, for the remaining domain (infrastructure) there are four levels of capacity. Undertaking particular activities and the presence of specific abilities (as reported by participants) provides an indication of the level of capacity achieved. These were captured by individual and aggregated indicators. The response categories available for participants to rate the network's capacity to achieve a range of criteria were: not at all/very limited; somewhat; substantial; and almost entirely/entirely. For the first three domains, the interpretation of the results are that the higher the achieved capacity, the greater the sustainability of the network. The fourth domain (Infrastructure) has four sub-domains: Policy Investments, Financial Investments, Human/Intellectual Investments and Social Investments, and also indicates sustainability. All key informants were asked to complete the self-administered CCI questionnaire prior to their interview and a response rate of 50% was achieved.
Action Plan assessment
Romp & Chomp intervention activities mapped into the New South Wales capacity building framework
Framework domains and elements
Intervention activities; n (%)
Visioning the future
Access to information
Decision making tools and models
Professional development opportunities
Education/Under- and Postgrad degrees
Policies and procedures
Recognition and reward system
Quality Improvement systems
Total 53 (100%)
Key Informant Interview themes
Three major themes emerged from the key informant interviews. These were related to relationships, resources and project structures. Each theme is discussed below.
Relationships - The interviewees described the major positive outcomes from the project as the great achievement of bringing together the big 'players' from across the Geelong community to work together, the establishment of partnerships with other similar projects, and the sustainable relationships that arose:
"...we looked at bringing this all together in a more strategic approach and that became the basis for developing the Children's Health and Wellbeing strategy group".
There were also a number of negative reactions that may reflect the lack of processes and protocols that could have facilitated better partnerships and overcome philosophical differences between partners about the project:
"...we're dealing with large organizations and inevitably multiple personalities with different ideas about how things should be done".
There were also negative feelings about the perception that some partner organisations tried to hold onto the ownership and branding of their own projects. A frequently mentioned problem during the interviews was a lack of project leadership which may be a consequence of high staff turnover as throughout the intervention period a total of five project coordinators were employed.
Resources - There was a strong feeling of frustration related to the lack of resources and funding available for project implementation, although several key formants identified this as an advantage and closer to the real world situation:
"..trying it on a shoestring budget.."
A number of strategies were utilised to increase capacity and sustainability throughout the project. The incorporation of Active Play in the TAFE (Technical and Further Education) curriculum was, viewed as one of the positive and sustainable outcomes from the project, as were the development and adoption of healthy eating and physical activity policies in early childhood settings. The intervention strategy of training allied health professionals (dieticians, physiotherapists, dental staff, occupational therapists etc) to support the health promotion activities in the kindergartens was also viewed positively, although the sustainability of this part of the intervention was questioned. The lack of skills and knowledge of some of the committee members related to capacity building and health promotion was also mentioned during the interviews, but the involvement of experts was rated positively.
Structures - Key informants made a number of comments regarding the lack of organisational structures and management support throughout the life of the project. There was seen to be ambiguity about the roles and responsibilities of individuals, organisations and the various committees. Comments were also made about the lack of meetings of the higher level reference group and the fact that the project managers and steering committee felt kept on a tight rein and unable to make independent decisions, which was seen to have slowed down processes:
"When you've got people that are managers and are quite capable of making those decisions....are we supposed to be just steering the project and not making decisions?".
Community Capacity Index (CCI)
Romp & Chomp was a large-scale, community-wide intervention project that aimed to increase the capacity of the Geelong community to promote healthy eating and physical activity for young children. The results from this mixed methods study demonstrate that this was achieved in only some of the domains of capacity building, specifically those related to partnerships, organisational development and resource allocation. However significant areas of capacity building were not addressed during the project implementation, particularly related to high-level and ongoing leadership. There were a number of positive outcomes identified in this study related to capacity building, including the establishment of sustainable partnerships, use of specialist advice, and integration of activities into ongoing formal training for early childhood workers. A number of challenges were also identified which related predominately to budgetary constraints, staff turnover, unclear governance structures, lack of ongoing high level leadership and inadequate communication between the partnering organisations. Despite these challenges however, the capacity of the Geelong community to promote healthy eating and physical activity was increased after the Romp and Chomp intervention and although only a moderate level of capacity could be demonstrated by the end of the intervention phase, this was still regarded as substantial progress by those involved.
An essential aspect of capacity building is leadership [19, 20], and although a clear project aim and specific objectives were agreed and articulated, we have found a strong perception of lack of leadership in the project on several levels. Leadership was consistently identified as an area of capacity building that was not addressed during the project and this finding leads us to recommend an investment in leadership training and strategies to increase group cohesion, team building, succession planning, collaboration and project management across the organisations involved. This is particularly important for the implementation of complex and long-term projects, such as Romp & Chomp, involving multiple partner and stakeholder organisations.
Challenges of limited resources and funding (AU$ 111,200 in total) across multiple agencies were major points of frustration for most of the key informants and it was thought to have directly affected project implementation. The implementation team appeared to have overcome the limited finances partly with resource reallocation and an increased degree of in-kind support and personal input and commitment. Previous research identifies these as important aspects of capacity building . More transparent resource allocation and documented in-kind contributions may have reduced dissatisfaction and further enhanced collaboration between organisations.
A central intervention strategy in Romp & Chomp was professional development and workforce training (in nutrition and active play), which have been identified as important capacity building strategies in public health nutrition . Romp & Chomp facilitated the training of future childcare workers in active play through the integration of professional development into the curriculum of the TAFE program. This was viewed as a sustainable and potentially cost-effective method of capacity building. The training of allied health professionals to support child care workers and early childhood settings staff to implement health promotion programs was also identified as a good outcome from the project. Although not captured in this evaluation, this aspect of the project has now become integrated into the larger, state-wide health promotion project (Kids-'Go for your life'), increasing its reach and sustainability. During the development of future health promotion projects the sustainability of the various capacity building activities should be planned to ensure ongoing benefits to the community after the specific health promotion project is completed.
There were distinct strategies in the project action plan to enhance organisational development; however, the findings from this study demonstrate that a number of important issues related to communication, roles and responsibilities, leadership and resources were not addressed. These issues were felt to have slowed down project implementation and strained relationships. This highlights the need to establish agreed structures and protocols early on in a complex project such as this, to ensure effective communication and clear roles and responsibilities across and within partner organisations. These structures and protocols should be reviewed periodically to ensure they are still appropriate for the stage of the project, given the often long term nature of these large scale projects. It is also important to assess the performance of the partnerships throughout the life of the project through a formal process and to address issues as they arise. Inter-organisational collaboration and partnerships are often complicated and can be difficult to manage and in addition to our experience here, previous research also suggests that strategies to foster strong collaborations and addressing the ongoing needs of partnerships should be a priority in these types of health promotion projects [5, 22].
It is evident that a high performing, cohesive, clear and transparent partnership was not fully achieved through the implementation of the Romp & Chomp project. But despite the large number of barriers and challenges that were reported through this evaluation, our analysis of the qualitative data identified a genuine sense that a number of positive outcomes were achieved and that lasting attitudinal and policy changes have resulted across the Geelong community. Triangulation of the three data sources indicates that considerable improvements were made in the partnerships, knowledge transfer and problem solving domains, while the areas of capacity building related to policy, human/intellectual and social investments were not as well developed. The use of a capacity-building framework to determine the specific intervention strategies required may have avoided a number of the issues identified and highlighted the areas where there was little activity, providing an opportunity to address the gaps in the program.
There are a number of strengths and limitations of this evaluation study. One limitation was a lack of documentation for some aspects of the project implementation which means that we may have under-represented the activities in certain areas of the project. To overcome this problem however we used data triangulation rather than relying on only one method (which is a considerable strength of this study). Secondly there was no comparison group which could make it more difficult to determine if increased capacity was initiated by the project. However, this was overcome by the use of both qualitative and quantitative evaluation methods and in the interviews key informants were asked to reflect on changes over time that resulted from the intervention project specifically. Thirdly we have only assessed the impact of the project on community capacity directly after the end of the intervention and there may be additional 'spin offs' and flow-on effects from Romp & Chomp that were not identified in this evaluation or emerge in the future. Again this would result in an under-representation of the impacts of the intervention. Reassessment of community capacity in a few years will provide additional useful evidence of the sustainability of the increased community capacity in the Geelong community.
Based on our learnings we recommend the following:
• Intervention strategies and their evaluation should be guided by an appropriate theoretical framework such as a capacity building framework
• If taking a capacity building approach, ongoing activities are needed which address all aspects of capacity building with a focus on leadership skills within the implementation network
• Given the challenging nature of this approach, a commitment to long term efforts to foster and maintain collaborations and partnerships are required at all levels, from the individuals implementing the program to those high up in the stakeholder organisations involved
• Ongoing specific intervention activities are needed to foster and maintain the implementation network and partnerships
• Clarity around the roles and responsibilities of partner organisations and the recognition of their cash and in-kind contributions are important
• Ongoing evaluation of the performance of the network and partnerships is required
Romp & Chomp increased the capacity of organisations, settings and services in the Geelong community to support healthy eating and physical activity for young children. Despite this success there are important learnings related to project management, leadership, governance, communication, documentation, capacity, resources, collaboration and fostering strong partnerships that should be addressed in future long-term, community-based health promotion projects of this kind. Adopting these recommendations should strengthen the capacity of stakeholder organisations to implement efforts to improve children's health and support families in their endeavours also. As one of the interviewees stated:
"Despite the difficulties...that kind of collaboration is what we need to do more and we just need to get better at it".
We wish to thank Anne Simmons who provided expert knowledge on capacity building and developed the methodology of the action plan assessment, and the key informants, who shared their experiences. We acknowledge the support of all project coordinators, staff and partner organisations. The study was funded by the Department of Human Services, Victoria, Australia. Andrea de Silva-Sanigorski has salary support from the National Health & Medical Research Council (Capacity Building Grant) and the Jack Brockhoff Foundation.
- Altman D: Challenges in Sustaining Public Health Interventions. Health Education & Behavior. 2009, 36 (1): 24-View ArticleGoogle Scholar
- Hawe P, Noort M, King L, Jordens C: Multiplying health gains: the critical role of capacity-building within health promotion programs. Health Policy. 1997, 39: 29-42. 10.1016/S0168-8510(96)00847-0.View ArticlePubMedGoogle Scholar
- Hawe P, King L, Noort M, Jordens C, Lloyd B: Indicators to help with capacity building in health promotion. 1999, Sydney, Australia: NSW Health DepartmentGoogle Scholar
- NSW Health Department: A framework for building capacity to improve health. 2001, Sydney, Australia: NSW Health DepartmentGoogle Scholar
- Baillie E, Bjarnholt C, Gruber M, Hughes R: A capacity-building conceptual framework for public health nutrition practice. Public Health Nutr. 2009, 12 (8): 1031-1038. 10.1017/S1368980008003078.View ArticlePubMedGoogle Scholar
- Sanigorski AM, Bell AC, Kremer PJ, Cuttler R, Swinburn BA: Reducing unhealthy weight gain in children through community capacity-building: results of a quasi-experimental intervention program, Be Active Eat Well. Int J Obes (Lond). 2008, 32 (7): 1060-1067. 10.1038/ijo.2008.79.View ArticleGoogle Scholar
- Dehghan M, Akhtar-Danesh N, Merchant A: Childhood obesity, prevalence and prevention. Nutr J. 2005, 4 (1): 24-10.1186/1475-2891-4-24.View ArticlePubMedPubMed CentralGoogle Scholar
- Sanigorski A, Bell A, Kremer P, Swinburn B: High childhood obesity in an Australian population. Obesity. 2007, 15 (8): 1908-1912. 10.1038/oby.2007.226.View ArticlePubMedGoogle Scholar
- Wang Y, Lobstein T: Worldwide Trends in Childhood Overweight and Obesity. Int J Pediatr Obes. 2006, 1 (1): 11-25. 10.1080/17477160600586747.View ArticlePubMedGoogle Scholar
- Bell AC, Simmons A, Sanigorski AM, Kremer PJ, Swinburn BA: Preventing childhood obesity: the sentinel site for obesity prevention in Victoria, Australia. Health Promot Int. 2008, 23 (4): 328-336. 10.1093/heapro/dan025.View ArticlePubMedGoogle Scholar
- de Silva-Sanigorski AM, Bell AC, Kremer P, Nichols M, Crellin M, Smith M, Sharp S, de Groot F, Carpenter L, Boak R, Robertson N, Swinburn BA: Reducing obesity in early childhood: Results from Romp & Chomp, an Australian community-wide intervention program. American Journal of Clinical Nutrition. 2010, 91 (4): 831-40. 10.3945/ajcn.2009.28826.View ArticlePubMedGoogle Scholar
- Steckler A, Linnan L, Israel B: Process evaluation for public health interventions and research. 2002, Jossey-BassGoogle Scholar
- Patton MQ: Enhancing the Quality and Credibility of Qualitative Analysis. Health Serv Res. 1999, 34: 1189-1208.PubMedPubMed CentralGoogle Scholar
- Cottrell R, McKenzie J: Health promotion and education research methods: Using the five chapter thesis/dissertation model. Edited by: Sudbury MA. 2005, Jones and Bartlett, 1Google Scholar
- Simmons A, Mavoa HM, Bell AC, De Courten M, Schaaf D, Schultz J, Swinburn BA: Creating community action plans for obesity prevention using the ANGELO (Analysis Grid for Elements Linked to Obesity) Framework. Health Promot Int. 2009, 24 (4): 311-24. 10.1093/heapro/dap029.View ArticlePubMedPubMed CentralGoogle Scholar
- Liamputtong P: Qualitative research methods. 2009, Sydney, Australia: Oxford University Press, 3Google Scholar
- Bush R, Dower J, Mutch A: Community Capacity Index Manual. 2002, Brisbane: Centre for Primary Health CareGoogle Scholar
- Bush R, Dower J, Mutch A: Community Capacity Index Version 2. 2002, Brisbane: Certre for Primary HealthGoogle Scholar
- Barrett L, Plotnikoff R, Raine K, Anderson D: Development of measures of organizational leadership for health promotion. Health Educ Behav. 2005, 32 (2): 195-207. 10.1177/1090198104271970.View ArticlePubMedGoogle Scholar
- Goodman RM, Speers MA, McLeroy K, Fawcett S, Kegler M, Parker E, et al: Identifying and defining the dimensions of community capacity to provide a basis for measurement. Health Educ Behav. 1998, 25: 258-278. 10.1177/109019819802500303.View ArticlePubMedGoogle Scholar
- Hughes R: A conceptual framework for intelligence-based public health nutrition workforce development. Public Health Nutr. 2007, 6 (06): 599-605.Google Scholar
- Labonte R, Bell W, Chad K, Laverack G: Community capacity building: a parallel track for health promotion programs. Can J Public Health. 2002, 93 (3): 181-182.PubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/10/522/prepub