- Research article
- Open Access
- Open Peer Review
Whole systems approaches to obesity and other complex public health challenges: a systematic review
BMC Public Healthvolume 19, Article number: 8 (2019)
Increasing awareness of the complexity of public health problems, including obesity, has led to growing interest in whole systems approaches (WSAs), defined as those that consider the multifactorial drivers of overweight and obesity, involve transformative co-ordinated action across a broad range of disciplines and stakeholders, operate across all levels of governance and throughout the life course. This paper reports a systematic review of WSAs targeting obesity and other complex public health and societal issues, such as healthy lifestyles for prevention of non-communicable disease.
Seven electronic databases were searched from 1995 to 2018. Studies were included if there had been an effort to implement a WSA. Study selection was conducted by one reviewer with a random 20% double checked. Data extraction and validity assessment were undertaken by one reviewer and checked by a second reviewer. Narrative synthesis was undertaken.
Sixty-five articles were included; 33 about obesity. Most examined multicomponent community approaches, and there was substantial clinical and methodological heterogeneity. Nevertheless, a range of positive health outcomes were reported, with some evidence of whole systems thinking. Positive effects were seen on health behaviours, body mass index (BMI), parental and community awareness, community capacity building, nutrition and physical activity environments, underage drinking behaviour and health, safety and wellbeing of community members, self-efficacy, smoking and tobacco-related disease outcomes.
Features of successful approaches reported in process evaluations included: full engagement of relevant partners and community; time to build relationships, trust and capacity; good governance; embedding within a broader policy context; local evaluation; finance.
Systems approaches to tackle obesity can have some benefit, but evidence of how to operationalise a WSA to address public health problems is still in its infancy. Future research should: (a) develop an agreed definition of a WSA in relation to obesity, (b) look across multiple sectors to ensure consistency of language and definition, (c) include detailed descriptions of the approaches, and (d) include process and economic evaluations.
In recent years, in response to the increasing awareness of the complexity of many public health problems, there has been growing interest in the role of systems-based approaches in public health. In 2007, the UK Foresight map  presented a pioneering portrayal of the complex web of obesity causation. In the same year the American Journal of Community Psychology devoted an edition to systems-thinking. In 2008 Mabry et al.  outlined the strategic vision of the Office of Behavioural and Social Sciences Research at the National Institutes of Health, listing systems science as one of four key programmatic directions, and the importance of systems thinking was also noted in the 2011 and 2015 Lancet Series on Obesity [3, 4].
In 2010 a number of evidence reviews were undertaken for the National Institute for Health and Care Excellence (NICE) [5,6,7], intended to inform the development of NICE guidelines on the prevention of obesity using a whole system approach (WSA) (note that the scope of the work was changed and instead resulted in the development of NICE guidelines on whole of community approaches) [5, 8].
The Garside et al.  review - one of those commissioned by NICE – which aimed to identify key elements of a WSA to obesity, reported that an “authentic” WSA draws on complexity science and complex adaptive systems. Although there is no consensus on a formal definition of “complex adaptive systems”, there is broad acceptance they contain: heterogeneous interacting elements; an emergent effect that is different from the effects of the individual elements; and persisting effects over time that adapt to changing circumstances . The NICE reviews [5,6,7] did not find any “authentic” WSAs, and the definition was therefore widened to include those programmes that were designed to work at multiple levels among multiple agencies in a locality. Using this definition, they identified ten features of a WSA to tackle obesity  (Table 1).
Aims & objectives
The aim was to undertake a systematic review of national and international published evidence on WSAs targeting obesity, other public health areas and areas outside public health (such as social care, crime and justice), to understand what is known about WSAs and how they can be implemented in practice.
What has been done in terms of a WSA to obesity, and other complex public health problems, and how effective have these been?
What elements of a WSA are effective or not effective in (a) obesity (b) other areas of public health (c) areas other than public health?
What are the barriers and facilitators to implementing a WSA in (a) obesity (b) other areas of public health (c) areas other than public health?
What is the evidence on cost-effectiveness of WSAs in (a) obesity (b) other areas of public health (c) areas other than public health?
A broad, sensitive search strategy was designed. The following databases were searched from January 1995 to September 2015 using a combination of text and Medical Subject Headings (MeSH terms): MEDLINE, CINAHL, Social Science Citation Index, The Cochrane Library (includes CENTRAL, DARE, NHSEED, HTA and INAHTA databases), PsycLIT/ PsycINFO, DoPHER, TRoPHI and IDOX.
In February 2017 an additional update search was run in MEDLINE, using the same search strategy applied from January 2015 to February 2018.
Key search terms included:
“whole systems approach” and related terms such as holistic; cross-sector; systems-based approach; multi-strategy approaches etc.
Terms related to relevant initiatives such as: Healthy Cities; Healthy Towns; Together Let’s Prevent Childhood Obesity (EPODE); Change4Life etc.
We also manually searched the websites of relevant organisations such as: Department of Health; Public Health England (PHE); Local Government Association (LGA); World Health Organisation (WHO); National Institute for Health and Care Excellence (NICE); Association for the Study of Obesity (ASO); National Obesity Forum etc.
The full search strategy is available as Additional file 1.
Titles and abstracts from electronic database searches were transferred to EPPI-Reviewer 4 , and screened against the inclusion criteria (Table 2). A random 20% of titles and abstracts were screened by all the review team, and once good agreement (80% or more) was reached, the remaining 80% were allocated to a single reviewer. Any queries were discussed within the review team and if agreement could not be reached, were referred to the local steering group for decisions. Records which potentially met the inclusion criteria, including those found on organisational websites, were retrieved in full and assessed for inclusion.
Data were extracted from included articles by one reviewer into a piloted electronic form, and checked by the lead reviewer. Queries were resolved as above. We extracted data into the following fields: study details; study design; setting; population (including PROGRESS-Plus indicators ); public health or other issue; intervention; comparator (if appropriate); outcomes; findings; reviewer comments.
We also assessed all included studies against the ten features for WSAs for obesity, in the working definition prepared by Garside et al. for the NICE guidance .
Two reviewers carried out validity assessment of included articles using checklists developed for quantitative and qualitative study designs of public health interventions . These were adapted from the National Institute for Health and Care Excellence Public Health methods guidance, and the Critical Skills Appraisal Programme [16, 17]. Studies were given a quality rating based on how many criteria they met on the appropriate checklist.
Due to the substantial clinical and methodological heterogeneity of included studies, a narrative approach to synthesis was chosen . Evidence on health and non-health outcomes is presented as a descriptive thematic summary, grouped within each review question according to whether it relates to obesity, other public health or non-health issues, with the most methodologically robust evidence presented first.
We also looked at whether there was any association or pattern between the direction of reported health effects and the number of WSA features  that a study met, using the cross-tabulation function in EPPI-reviewer and carrying out a Fisher’s exact test in IBM SPSS 24 statistical software.
Qualitative evidence on barriers and facilitators to implementation and delivery of WSAs was summarised using a framework synthesis approach, allowing themes to emerge inductively from the included studies, within the framework of ‘barriers’ and ‘facilitators’. The framework was agreed within the review team, and data were aggregated according to the major themes.
Study selection process
Nine thousand seven hundred seventy-seven records were screened at title and abstract stage, 860 were retrieved in full and a total of 65 articles were included in the review [19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83]. Figure 1 depicts the study selection process and Additional file 2: Table S1 presents key characteristics of the included studies.
Description of included studies
Table 3 gives an overview of public health issues addressed by study design and country that the research was carried out in. It is important to note that some studies sought to address more than one issue and many of the included studies were assessed as having more than one study design, for example Copeland et al.  combined mixed method evaluation techniques with a case control study nested within a prospective cohort study. The majority of the evidence was from the USA and Canada, though a substantial proportion also came from the UK, and from the Global WHO Healthy Cities network. Obesity and healthy lifestyle promotion were the dominant public health issues tackled, along with alcohol, smoking and drugs.
Forty-three studies included adults [19,20,21,22, 26, 32,33,34,35,36, 38, 39, 43,44,45,46,47,48,49,50, 52, 54,55,56, 58,59,60,61,62,63,64,65,66, 69,70,71,72,73,74, 78, 80, 81, 83] and 51 included children [19,20,21,22,23, 25,26,27, 30,31,32, 34,35,36, 38,39,40, 42,43,44,45,46,47,48, 50,51,52,53, 55, 56, 58,59,60,61,62,63,64,65, 68,69,70,71,72,73, 76, 78,79,80,81,82,83]. Fourteen focused on areas of socioeconomic deprivation [23, 44, 48, 50, 58, 61, 66, 68, 69, 73,74,75,76, 83] and ten on people in black or minority ethnic groups [23, 40, 49, 50, 56, 57, 66, 74, 76, 83]. Nine studies specified that they included older people [20, 22, 24, 34, 40, 45, 61, 66, 71]. Four studies targeted socially excluded groups [24, 66, 74, 75], two looked at women only [37, 74], two targeted people with disabilities [24, 74] and one targeted a specific religious or cultural group .
Results of validity assessment
Methodological details were on the whole poorly reported. Twenty of the 44 quantitative studies did not have a comparator group. The comparator group was judged to be appropriate in 14 of the remaining 24 studies, and in 10 studies there was judged to be baseline equivalence between the groups. Eleven studies reported randomised assignment of participants to groups. Fourteen studies allocated interventions at the right level (e.g. cluster randomisation for school-level interventions); ten studies did not report sufficient information to judge allocation. Intention to treat analysis was reported in two of the three RCTs. The intervention was considered to have been described adequately in almost all the studies (n = 39). Unbiased intervention delivery (i.e. intervention and comparator groups treated the same, apart from the intervention) was reported in 20 of the 44 studies. The sample was judged to be representative of the population in 17 of the included studies, while in 28 studies the sample size was judged to be large enough. Potential confounding factors were adjusted for in 11 studies. Due to the nature of the interventions, blinded assignment to groups did not occur in any of the included studies, nor was blinded outcome assessment reported. Nine studies reported on attrition rates. In 29 studies, the analysis methods were judged to be appropriate, and a further 14 studies did not provide enough detail about the methods of analysis for the review team to assess whether they were appropriate.
Of the 30 studies with a qualitative design, the design was judged to be appropriate in 28 studies, with the remaining two providing insufficient detail. Seventeen studies provided a clear statement of findings, six provided insufficient detail, and the remaining seven did not provide a clear statement of findings. Fifteen studies used appropriate strategies for data collection (and 13 did not provide enough information), and 13 recruited participants appropriately (with 16 not providing enough information). Seven studies undertook rigorous data analysis, with three failing on this criterion and the remaining 20 providing insufficient information. Only three studies showed evidence of reflexivity regarding the relationship of the researcher to the participants, 18 failed on this criterion and the remaining 9 did not provide enough information. Nine studies provided enough information to satisfy the review team that ethical issues had been considered, while 21 did not provide enough information.
Review question 1: What has been done in terms of a WSA to obesity, and other complex public health problems, and how effective have these been?
Studies meeting all ten guidance features for WSA
Thirteen included studies met all ten of the Garside et al.  features for a WSA [25, 29, 39, 46, 47, 53, 64, 65, 67, 75,76,77, 80]. Five of these 13 studies reported health or wellbeing outcomes [25, 29, 53, 75, 80], two reported outcomes associated with the social determinants of health [29, 80], and eleven reported process outcomes [25, 29, 39, 46, 47, 64, 65, 75,76,77, 80]. Three of these were UK initiatives, which all aimed to address obesity and healthy lifestyle promotion: a poor to moderate mixed methods evaluation of Change 4 Life , which reported positive outcomes for social determinants of health and mixed outcomes for health and wellbeing; a poor quality before and after study of Health Heroes , which reported positive health and wellbeing outcomes, and a poor quality case study of Public Health England’s paths to public health and wellbeing , which reported on process outcomes. Of the remaining 10 articles, seven were about the WHO Healthy Cities initiative [29, 39, 46, 47, 64, 67, 77] and all reported on process outcomes only. One of these was of poor to moderate quality , one was of moderate to good quality , one was good quality ,and the remaining four were poor quality [29, 64, 67, 77]. The remaining three articles were: a poor quality mixed methods evaluation of the Central California Regional Obesity Prevention Program , which reported positive health outcomes; a poor quality case study of the San Diego Healthy Weight Collaborative , which reported process outcomes only, and a moderate to good quality randomised controlled trial of “Communities mobilizing for change on alcohol” , which also reported positive health outcomes.
All included studies
The following sections briefly summarise the findings of the included studies, with evidence of the highest methodological quality presented first. For further details, refer to Additional file 2: Table S1.
Positive effects on BMI and health behaviour were reported in two good quality non-RCTs of Be Active Eat Well (BAEW) in Australia, which met 7 out of the 10 WSA features [44, 69]; on BMI in a moderate to good quality non-RCT of “Shape up Somerville” in the USA , which met 8 out of the 10 NICE guidance features; on parental health behaviour & awareness in a mixed methods evaluation of moderate quality of the first year of the UK social marketing initiative Change 4 Life (C4L) , which met 8 out of the 10 WSA guidance features; on fitness and obesity in a moderate quality prospective cohort study of Healthy Living Cambridge Kids  in the USA, which met 4 of the 10 WSA guidance features; on BMI, parental awareness and community capacity building in two moderate to poor quality mixed methods evaluations of Romp and Chomp in Australia, which met 9 out of the 10 WSA guidance features [27, 31]; and on nutrition and physical activity environments in an evaluation (of unclear design or quality) of the Central California Regional Obesity Prevention Program (CCROPP) , which met all 10 WSA guidance features.
Mixed effects on health and wellbeing outcomes, with no reduction in obesity prevalence, were seen in a moderate to poor quality nested case control study of “Healthy Towns” in the UK , which met all 10 of the WSA guidance features; and mixed effects were reported for obesity prevalence in a moderate quality non-randomised trial of Travis County CATCH in the USA , which met none of the 10 WSA guidance features.
A poor quality mixed methods evaluation of LIVE 5–2–1-0 reported early indications of improvements in community awareness and action to promote healthy childhood behaviours, from stakeholder interviews.
Other public health issues
Positive effects on underage drinking behaviour and health, safety and wellbeing of community members were reported in a moderate to good quality RCT of the USA initiative Communities Mobilising for Change on Alcohol (CMCA), which met all 10 WSA guidance features ; on self-efficacy and intentions in a moderate quality non-RCT of a community-based intervention in Indigenous populations in the Canadian Arctic , which met 9 out of the 10 WSA guidance features; in smoking and tobacco-related disease outcomes in a cross-sectional survey of moderate quality, and a before and after study of poor quality, of the California Tobacco Control Program (CTCP) [56, 63], which met 2 out of the 10 WSA guidance features; on smoking prevalence in a prospective cohort study of moderate to poor quality  of the Racial and Ethnic Approaches to Community Health (REACH) project, in the USA, which met 8 out of the 10 NICE guidance features; in healthy eating behaviour in a non-RCT of moderate to poor quality of The Isfahan Healthy Heart programme evaluation in Iran , that met 6 out of 10 WSA guidance features; on smoking rates, home smoking bans and support for smoke-free policies in a repeated cross-sectional survey of poor quality of Put it Out Rockland (PIOR) in the USA , which met 3 out of the 10 WSA guidance features; and on access to health and medical services for managing diabetes, and access to fresh food in a poor quality case study on community-based participatory diabetes prevention , which met only one of the 10 WSA guidance features.
Mixed health effects were reported on risk factors for cardiovascular disease in a moderate quality prospective cohort study of a community intervention in the Netherlands , which met 7 of the 10 WSA guidance features; and on BMI in a moderate to poor quality non-RCT  of the Minnesota Heart Health Programme (MHHP), which met 4 of the 10 WSA guidance features.
Review question 2: What elements of a WSA are effective or not effective in (a) obesity (b) other areas of public health (c) areas other than public health?
Studies of interventions which met a large number (8–10) of the WSA guidance features frequently reported positive health effects when looking at the descriptive statistics (see Fig. 2 and Table 4). The Fisher’s exact test determined that the association between WSA feature categories (0–3 features, 4–7 features, or 8–10 features) and the health effects was not statistically significant (df 4, chi-square value 6.645, p = 0.094). All of the 10 individual WSA guidance features were associated with positive health outcomes (see Fig. 3) but the overall association was not statistically significant (df 40, chi-square value 45.20, p = 1.000). These statistical findings should be interpreted with caution given the small number and heterogeneous nature of the studies, and that only studies that reported on health outcomes could be included in this analysis (34 out of a total of 65 studies included in this review). Furthermore, only five of the 13 studies that met all 10 WSA guidance features reported health outcomes; the remaining nine were process evaluations and therefore not included in this analysis.
Review question 3: What are the barriers and facilitators to implementing a WSA in (a) obesity (b) other areas of public health (c) areas other than public health?
Key themes that emerged from the included process evaluations were as follows (with evidence of the highest methodological quality which met 6 or more of the WSA features (e.g. Healthy Cities) presented first):
Strong leadership and full engagement of all partners is key for success: Senior leadership buy-in was important to the effective development and delivery of a number of initiatives [65, 77]. Evaluations of the Healthy Cities initiative [39, 22] reported that effective organisational change required core principles to be integrated into an organisation’s mainstream activity, and recognised the need to have a genuine consortium of partners who were actively engaged rather than a single main driving force.
Engaging the local community is an important component of a successful approach: Several evaluations showed that projects were successful because of effective community involvement in identifying their needs and actively participating in local solutions [47, 49,50,51, 57, 74, 75, 77, 80, 82]. Capacity building through coalitions, targeted actions and community and system change were also identified as important [49, 50].
Creating successful outcomes requires time to build relationships, trust and community capacity: Local authority action built up good working relationships based on mutual trust, shared vision, aims and values, which were of central importance to developing and delivering effective work. A Public Health England report  suggested that where such partnerships were not already in place, it was worth investing time and effort to develop them.
Good governance and shared values: Distinguishing features of the WHO European Healthy Cities Network are shared vision and values and an explicit commitment to good governance by local councils and their executive arms [29, 39]. The evaluations showed that the emphasis on good governance resulted in better participation, policy-making and intersectoral action. This happened across the designated cities and was not limited to a certain class (in terms of population or geographical location) .
Appropriate partnerships are important to create sustainable multilevel environmental change: Building an effective and sustainable collaborative team was found to be key [46, 65, 76, 83]. Identifying key stakeholders and securing their early participation was considered important, as was building an appropriate network of collaborators [22, 27, 32, 65, 82]. Strong relationships between stakeholders was identified as one of the factors influencing effectiveness , whilst engaging non-traditional partners can expand reach .
Consistency in language used across organisations: The creation and use of a common language can overcome the fact that most organisations have their own beliefs and structures, for example by using consistent and authorised messages and materials, based on insights gained through prior research in the target community .
Embedding initiatives within a broader policy context: It is important to ensure agendas focus on the principles of what the organisations wish to achieve, and to integrate or align initiatives so they are not seen as additional to mainstream activity [39, 51].
Sufficient financial support and resources: Access to relevant resources, including funding, was identified as important in several process evaluations, and lack of resource was identified as a barrier to successful implementation of WSAs [27, 39, 46, 51, 62, 64, 65, 82, 83].
Review question 4: What is the evidence on cost-effectiveness of WSAs in (a) obesity (b) other areas of public health (c) areas other than public health?
We found very little evidence relating to cost effectiveness of a WSA. Only one study, a cross-sectional survey of moderate to poor quality of Put it Out Rockland , reported an apparent cost-benefit comparison, although the methods used were not clear: with an estimated return of $4 to $5 for every dollar spent on tobacco control, Rockland’s total $6 million investment between 2000 and 2010, added to the state’s investment, translated to a potential $24 million to $30 million savings in tobacco- related costs for Rockland County. However the cross-sectional study design means that conclusions about impact cannot be drawn.
Although 65 studies met the broad inclusion criteria, the heterogeneity of studies in terms of different outcomes, research designs, populations and interventions, prevented the data from being analysed statistically. It is also worth noting that most of the included studies did not set out to implement or evaluate a WSA. Furthermore, reporting of intervention and approaches in published articles was usually brief and lacked detail. This underlines the lack of robust evidence in this area and the need for further research to expand and support the suggested associations, in order to increase our understanding of how WSAs can be implemented. Nevertheless, it does seem reasonable that programmes in a community setting that adopt the principles of the ten features identified by Garside et al.  such as developing relationships and engaging stakeholders, ensuring the approach is robust and sustainable and having supportive leadership, are more likely to be successful than programmes that do not adopt these principles. Similarly, it is also feasible that all ten of the features  are associated with positive health effects, however in relation to current thinking around systems approaches, these ten features do not comprehensively describe a WSA.
The review also found consistent evidence from process evaluations that ownership and commitment, strong relationships between stakeholders, and allowing sufficient time to build relationships, trust and community capacity are all key to building a successful WSA.
There is recognition in the literature that several public health problems, including obesity, are complex issues requiring system-based approaches [84, 85]. However, although the concepts and terminology have existed for some decades the degree to which the field has progressed is debatable, partly due to the multitude of ways in which the language surrounding systems approaches is used.
Systems science “refers to a range of methods, composed largely of mathematical or computational modelling and simulation, that enable the user to explore complex problems by addressing both interactions between components of a system and the behaviour of the system over time” . On the one hand, there have been significant advances in the application of a range of systems science approaches to a variety of obesity-related public health issues using techniques such as micro-simulation, social network analysis, agent-based modelling and system dynamics modelling. On the other hand, Garside et al. (2010) reported that the term “whole system approach” was found to represent approaches informed by theory about complex systems which propose new ways of organising, managing and evaluating activities, and also as terminology within a long list of approaches which referred to cross-disciplinary, multi-agency, multi-level community activities aimed at addressing health concerns affected by complex socio-economic conditions  and which rarely, if ever, encompass the use of the system science methods as described above.
Similarly to Garside et al. , this review found little evidence of systems science or systems thinking in included studies. Few programmes had been explicitly designed and delivered with an a priori recognition of the public health issue as a system and thus rarely approached implementation from a perspective encapsulating a systems approach – the implications of which are significant for the reporting and evaluation of interventions. Furthermore, because interventions to date have not been undertaken with a systems-thinking lens or set out to take a WSA at the outset, there has been little recognition of properties inherent in a complex system (e.g. nonlinear relationships, feedback loops, dynamic interacting elements) and little attention afforded to the reporting of the central underlying operational mechanisms (e.g. improving networks, developing a common agenda, developing relationships), as suggested by Allender et al. . Hawe et al.  noted that although the majority of health promotion programmes claim to take an ecological approach, in reality this is realised as multiple interventions at multiple levels with “little theory put forward about how these levels impact the unfolding of the intervention or how they affect intervention outcomes”. Moreover, several authors have noted that implementation of a suite of activities across multiple-settings or multiple-levels is not necessarily the same as taking a “systems approach” [5, 85, 87]. Systems approaches focus on the context into which the intervention is introduced  and relate to intervening directly on the feedbacks, structures and goals of a system . Considered in this light the evidence highlights the limited progress that has been made in the practical implementation and evaluation of WSAs to public health issues to date. What is needed a framework to incorporate the complexity of systems approaches into public health research, policy and practice .
Garside and colleagues in 2010 also looked for examples of a whole system in action, finding only eight articles on the effectiveness of community wide programmes displaying features of a WSA to prevent obesity, none of which were undertaken in the UK and all of which targeted children below 14 years of age . Most findings favoured the interventions but improvements were found to be small and not always statistically significant. The inconclusive evidence relating to the 10 NICE guidance features in the present review may be because these emerged from a systematic review with the aim of providing a working definition of a WSA to obesity prevention, which did not find any “authentic” WSAs, and the definition was therefore widened to include those programmes that were designed to work at multiple levels among multiple agencies in a locality . So, meeting all ten of these criteria still does not indicate an “authentic” WSA. In addition, although studies may have met many or all of the 10 NICE guidance features in their description of their proposed intervention, in studies which presented effectiveness outcomes there was little evidence of whether these interventions had been implemented with fidelity to the WSA framework.
Our search strategy was designed to look as widely as possible to minimise the risks of missing valuable material. Although 20% of titles and abstracts were double screened, screening of the remaining 80% was limited to a single reviewer, an “acceleration strategy” recommended for rapid reviews . While this was a pragmatic necessity, it does potentially introduce bias and human error, which may have resulted in some relevant studies being missed.
Methodological details of included studies were, on the whole, poorly reported, which limits our confidence that the findings are not at significant risk of bias.
Only 11 of the included studies were UK-based, however their findings might be expected to be generalisable to the UK context and three of these [32, 53, 65] met all ten of the NICE criteria for a WSA.
Few studies targeted population groups known to be at higher risk of obesity and other public health issues, such as black and minority ethnic groups and people with low levels of education or low socioeconomic status. This limits the usefulness of the findings.
Thirteen of the 65 included studies were judged to meet all ten of the criteria for a WSA proposed by Garside et al.  in an earlier review. However, the heterogeneity of studies in terms of interventions, outcomes, research designs, and populations prevented the data from being analysed statistically.
Using a broad lens, this systematic review aimed to obtain a greater insight on the effectiveness of WSAs and how they can be implemented in practice. Evidence exists to demonstrate promise with interventions working towards systems approaches. This was most clearly demonstrated through a suite of WHO Healthy Cities process evaluations and evidence from whole of community approaches. A range of positive health outcomes were reported, but there was little evidence of an association between specific WSA features and health impacts. Evidence of systems science and systems thinking was less clear, even in the most “joined up” approaches, similar to the findings of the series of reviews carried out for NICE in 2010.
It is important to note that most of the included studies did not report that they set out to implement or evaluate a WSA, and reporting of interventions and approaches in published articles was usually brief and lacked detail. This underlines the lack of evidence in this area and the need for further research. Whilst several learnings on multi-level, community wide interventions have been obtained which are likely to be relevant to the implementation of a true WSA (e.g. evidence about barriers and facilitators to implementing such approaches), it is also evident that evidence of how to operationalise a whole systems approach to address public health problems is still in its infancy. We recommend that future researchers and policy makers develop consistency in language and an agreed definition of what a WSA should be in relation to obesity. Future research studies into the effectiveness of WSAs should look across sectors and should include detailed descriptions of interventions including approaches, and embedded process and economic evaluations, as recommended by existing guidance on developing and evaluating complex interventions [90, 91].
Association for the Study of Obesity
Be Active Eat Well
Body Mass Index
Coordinated Approach To Child Health
Central California Regional Obesity Prevention Program
Cumulative Index to Nursing and Allied Health Literature
Communities Mobilising for Change on Alcohol
California Tobacco Control Program
Database of Abstracts of Reviews of Effects
Database of Promoting Health Effectiveness Reviews
Ensemble Prévenons l’Obésité Des Enfants’ (Together Let’s Prevent Childhood Obesity)
Health Technology Assessment
International Network of Agencies for Health Technology Assessment
Local Government Association
Minnesota Heart Health Programme
National Health Service Economic Evaluation Database
National Institute of Health & Care Excellence
Public Health England
Put it Out Rockland
Randomised controlled trial
Racial and Ethnic Approaches to Community Health
Trials Register of Promoting Health Interventions
World Health Organisation
Whole systems approach
Butland B, Jebb S, Kopelman P, McPherson K, Thomas S, Mardell J, Parry V. Foresight: tackling obesities: future choices - project report. London: Department of Innovation, Universities and Skills; 2007.
Mabry P, Bures R. Systems science for obesity-related research questions: an introduction to the theme issue. Am J Public Health. 2014;104(7):1157–9.
Rutter H. Where next for obesity? Lancet. 2011;378(9793):746–7.
Kleinert S, Horton R. Rethinking and reframing obesity. Lancet. 2015;385(9985):2326–8.
Garside R, Pearson M, Hunt H, Moxham T, Anderson R. Identifying the key elements and interactions of a whole system approach to obesity prevention. Exeter: Peninsula Technology Assessment Group (PenTAG); 2010.
Hunt H, Anderson R, Coelho H, Garside R, Bayliss S, Fry-Smith A. The effectiveness of Whole System Approaches to prevent obesity. Exeter: Peninsula Technology Assessment Group (PenTAG); 2011.
Pearson M, Garside R, Fry-Smith A, Bayliss S. Preventing obesity using a “whole system” approach at local and community level. Barriers and facilitators to effective whole system approaches. Exeter: Peninsula Technology Assessment Group (PenTAG); 2011.
National Institute of Health and Care Excellence. Identifying the key elements and interactions of a whole system approach to obesity prevention. Edited by National Institute for Health and Care Excellence. London: Peninsula Technology Assessment Group (PenTAG); 2010.
Luke D, Stamatakis K. Systems science methods in public health: dynamics, networks, and agents. Annu Rev Public Health. 2012;33:357–76.
Centre for Reviews and Dissemination. Systematic Reviews: CRD’s guidance for undertaking reviews in health care. York: University of York; 2009.
Higgins J, Green S. Cochrane handbook for systematic review of interventions version 5.0.1. In: The Cochrane Collaboration; 2008.
Thomas J, Brunton J, Graziosi S. EPPI-Reviewer 4.0: software for research synthesis. In: EPPI-Centre Software. London: Social Science Research Unit, Institute of Education, University of London; 2010.
Dahlgren G, Whitehead M. Policies and strategies to promote social equity in health. Stockholm: Institute for Futures Studies; 1991.
Kavanagh J, Oliver S, Lorenc T. Reflections on developing and using PROGRESS-plus. Equity Update. 2008;10:1–3.
Snape D, Meads C, Bagnall A, Tregaskis O, Mansfield L. What Works Centre for Wellbeing: a guide to our evidence review methods. London: What Works Centre for Wellbeing; 2017.
Critical Appraisal Skills Programme. CASP qualitative Checklist. 2018. [online] Available at: https://casp-uk.net/wp-content/uploads/2018/03/CASP-Qualitative-Checklist-2018_fillable_form.pdf. Accessed 6 Dec 2018.
National Institute for Health and Care Excellence (NICE). Methods for the development of NICE public health guidance. 3rd ed. London: NICE; 2012.
Thomas J, Harden A, Newman M. Synthesis: combining results systematically and appropriately. In: Gough D, Oliver S, Thomas J, editors. An introduction to systematic rveiews. London: Sage; 2012. p. 179–226.
Active Living by Design. Growing a movement: healthy kids, healthy communities. Final report. Chapel Hill: Active Living by Design; 2014.
Andersson CM, Bjärås G, Tillgren P, Ostenson CG. A longitudinal assessment of inter-sectoral participation in a community-based diabetes prevention programme. Soc Sci Med. 2005;61:2407–22.
Boonekamp GMM, Colomer C, Tomas A, Nunez A. Healthy cities evaluation: the co-ordinators perspective. Health Promot Int. 1999;14:103–10.
Boonekamp GMM, GutierrezSigler MD, Colomer C, Vaandrager HW. Opportunities for health promotion: the knowledge and information system of the Valencian food sector, Spain. Health Promot Int. 1996;11:309–19.
Chomitz VR, McGowan RJ, Wendel JM, Williams SA, Cabral HJ, King SE, Olcott DB, Cappello M, Breen S, Hacker KA. Healthy living Cambridge kids: a community-based participatory effort to promote healthy weight and fitness. Obesity. 2010;18(suppl 1):s45–53.
Cook G, Dawson P, Elliot D. Case study 1: explicating the role of partnerships in Northumberland FISHNETS. In: Holland K, Warne AR, Howath ML, editors. Explicating the role of partnerships in changing the health and well-being of local communities in urban regeneration areas: an evaluation of the Warnwarth Conceptual framework: a case study approach, vol. 3; 2009. p. 14–34.
Copeland R, Moullin M, Reece L, Gibson D, Barrett D. Sheffield’s Let's Change4Life: a whole systems approach to tackling overweight and obesity in children, young people and families. A local evaluation report. Sheffield: Sheffield Hallam University; 2011.
Cousins JM, Langer SM, Rhew LK, Thomas C. The role of state health departments in supporting community-based obesity prevention. Prev Chronic Dis. 2011;8(10):A87.
de Groot FP, Robertson NM, Swinburn BA, de Silva-Sanigorski AM. Increasing community capacity to prevent childhood obesity: challenges, lessons learned and results from the Romp & Chomp intervention. BMC Public Health. 2010;10:8.
de Leeuw E, Kickbusch I, Palmer N, Spanswick L. European healthy cities come to terms with health network governance. Health Promot Int. 2015;30:i32–44.
de Leeuw E, Tsouros AD, Dyakova M, Green G, editors. Healthy cities: promoting health and equity: evidence for local policy and practice. Copenhagen: WHO Regional Office for Europe; 2014.
de Silva-Sanigorski A, Elea D, Bell C, Kremer P, Carpenter L, Nichols M, Smith M, Sharp S, Boak R, Swinburn B. Obesity prevention in the family day care setting: impact of the Romp & Chomp intervention on opportunities for children's physical activity and healthy eating. Child Care Health Dev. 2011;37:385–93.
de Silva-Sanigorski AM, Bell AC, Kremer P, Nichols M, Crellin M, Smith M, Sharp S, de Groot F, Carpenter L, Boak R, et al. Reducing obesity in early childhood: results from Romp & Chomp, an Australian community-wide intervention program. Am J Clin Nutr. 2010;91:831–40.
Department Of Health: Change4life: one year on; 2010.
Donchin M, Shemesh AA, Horowitz P, Daoud N. Implementation of the Healthy Cities’ principles and strategies: an evaluation of the Israel Healthy Cities Network. Health Promot Int. 2006;21:266–73.
Eat Smart Move More North Carolina Leadership Team. Eat smart, move more: North Carolina’s plan to prevent overweight, obesity and related chronic diseases, 2007–2012: final report. Raleigh: Eat Smart Move More; 2013.
Economos CD, Hyatt RR, Goldberg JP, Must A, Naumova EN, Collins JJ, Nelson ME. A community intervention reduces BMI z-score in children: shape up Somerville first year results. Obesity. 2007;15(5):1325–36.
Farrington JL, Faskunger J, Mackiewicz K. Evaluation of risk factor reduction in a European City network. Health Promot Int. 2015;30:i86–98.
Gantner LA, Olson CM. Evaluation of public health professionals’ capacity to implement environmental changes supportive of healthy weight. Eval Program Plann. 2012;35:407–16.
Goodwin DM, Cummins S, Sautkina E, Ogilvie D, Petticrew M, Jones A, Wheeler K, White M. The role and status of evidence and innovation in the healthy towns programme in England: a qualitative stakeholder interview study. J Epidemiol Community Health. 2013;67:106–12.
Goumans M, Springett J. From projects to policy: ‘Healthy Cities’ as a mechanism for policy change for health? Health Promot Int. 1997;12:311–22.
Green G, Jackisch J, Zamaro G. Healthy cities as catalysts for caring and supportive environments. Health Promot Int. 2015;30:i99–i107.
Green G, Price C, Lipp A, Priestley R. Partnership structures in the WHO European Healthy Cities project. Health Promot Int. 2009;24:37–44.
Hoelscher DM, Kelder SH, Pérez A, Day RS, Benoit JS, Frankowski RF, Walker JL, Lee ES. Changes in the regional prevalence of child obesity in 4th, 8th, and 11th grade students in Texas from 2000–2002 to 2004–2005. Obesity. 2010;18(7):1360–8.
Jeffery RW, Gray CW, French SA, Hellerstedt WL, Murray D, Luepker RV, Blackburn H. Evaluation of weight reduction in a community intervention for cardiovascular-disease risk - changes in body-mass-index in the Minnesota heart health program. Int J Obes. 1995;19:30–9.
Johnson BA, Kremer PJ, Swinburn BA, de Silva-Sanigorski AM. Multilevel analysis of the be active eat well intervention: environmental and behavioural influences on reductions in child obesity risk. Int J Obes. 2012;36:901–7.
Kegler MC, Honeycutt S, Davis M, Dauria E, Berg C, Dove C, Gamble A, Hawkins J. Policy, systems, and environmental change in the Mississippi Delta: considerations for evaluation design. Health Educ Behav. 2015;42:57S–66S.
Kegler MC, Norton BL, Aronson R. Achieving organizational change: findings from case studies of 20 California healthy cities and communities coalitions. Health Promot Int. 2008;23:109–18.
Kegler MC, Painter JE, Twiss JM, Aronson R, Norton BL. Evaluation findings on community participation in the California healthy cities and communities program. Health Promot Int. 2009;24:300–10.
Komro KA, Perry CL, Veblen-Mortenson S, Farbakhsh K, Toomey TL, Stigler MH, Jones-Webb R, Kugler KC, Pasch KE, Williams CL. Outcomes from a randomized controlled trial of a multi-component alcohol use preventive intervention for urban youth: Project Northland Chicago. Addiction. 2008;103:606–18.
Larson CO, Schlundt DG, Patel K, Wang H, Beard K, Hargreaves MK. Trends in smoking among African-Americans: a description of Nashville's REACH 2010 initiative. J Community Health. 2009;34:311–20.
Liao YL, Tsoh JY, Chen R, Foo MA, Garvin CC, Grigg-Saito D, Liang S, McPhee S, Nguyen TT, Tran JH, et al. Decreases in smoking prevalence in Asian communities served by the racial and ethnic approaches to community health (REACH) project. Am J Public Health. 2010;100:853–60.
Lieberman L, Diffley U, King S, Chanler S, Ferrara M, Alleyne O, Facelle J. Local tobacco control: application of the essential public health services model in a County Health Department's efforts to Put It Out Rockland. Am J Public Health. 2013;103:1942–8.
Lipp A, Winters T, Leeuw E. Evaluation of partnership working in cities in phase IV of the WHO Healthy Cities Network. J Urban Health. 2013;90:S37–51.
London Borough of Hackney: Health heroes. A whole school approach to healthy weight. 2014.
Lynn WR, Freedman LS, Green SB, Corle DK, Gail M, Glasgow RE, Hartwell TD, Cummings KM, Ockene JK, Giffen CA. Community intervention trial for smoking cessation (COMMIT) .1. Cohort results from a 4-year community intervention. Am J Public Health. 1995;85:183–92.
Maguire M, Nettleton H, Rix A, Raybould S. Reducing alcohol-related violence and disorder: an evaluation of the ‘TASC’ project (Home Office research study 265). London: Home Office; 2003.
Martínez-Donate AP, Hovell MF, Hofstetter CR, Gonzélez-Pérez GJ, Kotay A, Adams MA. Crossing Borders: the impact of the California tobacco control program on both sides of the US--Mexico border. Am J Public Health. 2008;98:258–67.
Mead EL, Gittelsohn J, Roache C, Corriveau A, Sharma S. A community-based, environmental chronic disease prevention intervention to improve healthy eating psychosocial factors and behaviors in indigenous populations in the Canadian Arctic. Health Educ Behav. 2013;40:592–602.
Middleton G, Henderson H, Evans D. Implementing a community-based obesity prevention programme: experiences of stakeholders in the North East of England. Health Promot Int. 2014;29:201–11.
Mohammadifard N, Kelishadi R, Safavi M, Sarrafzadegan N, Sajadi F, Sadri GH, Maghroon M, Alikhasi H, Heydari S, Sarmadi F. Effect of a community-based intervention on nutritional behaviour in a developing country setting: the Isfahan Healthy Heart Programme. Public Health Nutr. 2009;12:1422–30.
Paschall MJ, Flewellng RL, Grube JW. Using statewide youth surveys to evaluate local drug use policies and interventions. Contemp Drug Probl. 2009;36:427–45.
Peters J, Ellis E, Goyder G, Blank L. Healthy eating initiatives: case studies (New Deal for Communities National Evaluation Research Report 56). Sheffield: Sheffield Hallam University; 2005.
Pettigrew S, Borys J, Plessis H, Walter L, Huang T, Levi J, Vinck J. Process evaluation outcomes from a global child obesity prevention intervention. BMC Public Health. 2014;14:10.
Pierce JP, Gilpin EA, Emery SL, White MM, Rosbrook B, Berry CC. Has the California tobacco control program reduced smoking? JAMA. 1998;280:893–9.
Plumer KD, Kennedy L, Trojan A. Evaluating the implementation of the WHO Healthy Cities Programme across Germany (1999-2002). Health Promot Int. 2010;25:342–54.
Public Health England. Paths to public health and wellbeing: examples of local authority action in the South-West. London: Public Health England; 2014.
Raine KD, Plotnikoff R, Schopflocher D, Lytvyak E, Nykiforuk CIJ, Storey K, Ohinmaa A, Purdy L, Veugelers P, Wild TC. Healthy Alberta communities: impact of a three-year community-based obesity and chronic disease prevention intervention. Prev Med. 2013;57:955–62.
Ritsatakis A, Ostergren PO, Webster P. Tackling the social determinants of inequalities in health during phase V of the Healthy Cities project in Europe. Health Promot Int. 2015;30:i45–53.
Samuels SE, Craypo L, Boyle M, Crawford PB, Yancey A, Flores G. The California Endowment’s healthy eating, active communities program: a midpoint review. Am J Public Health. 2010;100:2114–23.
Sanigorski AM, Bell AC, Kremer PJ, Cuttler R, Swinburn BA. Reducing unhealthy weight gain in children through community capacity-building: results of a quasi-experimental intervention program, Be Active Eat Well. Int J Obes. 2008;32:1060–7.
Sarrafzadegan N, Kelishadi R, Esmaillzadeh A, Mohammadifard N, Rabiei K, Roohafza H, Azadbakht L, Bahonar A, Sadri G, Amani A, et al. Do lifestyle interventions work in developing countries? Findings from the Isfahan healthy heart program in the Islamic Republic of Iran. Bull World Health Organ. 2009;87:39–50.
Sautkina E, Goodwin D, Jones A, Ogilvie D, Petticrew M, White M, Cummins S. Lost in translation? Theory, policy and practice in systems-based environmental approaches to obesity prevention in the Healthy Towns programme in England. Health Place. 2014;29:60–6.
Schoen MW, Moreland-Russell S, Prewitt K, Carothers BJ. Social network analysis of public health programs to measure partnership. Soc Sci Med. 2014;123:90–5.
Schuit AJ, Wendel-Vos GC, Verschuren WM, Ronckers ET, Ament A, Van Assema P, Van Ree J, Ruland EC. Effect of 5-year community intervention Hartslag Limburg on cardiovascular risk factors. Am J Prev Med. 2006;30:237–42.
Schulz AJ, Zenk S, Odoms-Young A, Hollis-Neely T, Nwankwo R, Lockett M, Ridella W, Kannan S. Healthy eating and exercising to reduce diabetes: exploring the potential of social determinants of health frameworks within the context of community-based participatory diabetes prevention. Am J Public Health. 2005;95:645–51.
Schwarte L, Samuels SE, Capitman J, Ruwe M, Boyle M, Flores G. The Central California regional obesity prevention program: changing nutrition and physical activity environments in California's heartland. Am J Public Health. 2010;100:2124–8.
Serpas S, Brandstein K, McKennett M, Hillidge S, Zive M, Nader PR. San Diego healthy weight collaborative: a systems approach to address childhood obesity. J Health Care Poor Underserved. 2013;24:80–96.
Simos J, Spanswick L, Palmer N, Christie D. The role of health impact assessment in phase V of the healthy cities European network. Health Promot Int. 2015;30:i71–85.
Stafstrom M, Larsson S. The Trelleborg project: a process evaluation of a multi-sector community intervention to reduce alcohol consumption and related harm. Subst Use Misuse. 2007;42:2041–51.
Stead M, Mackintosh AM, Eadie D, Hastings G. Preventing adolescent drug use: the development, design and implementation of the first year of ‘NE Choices’. Drugs Educ Prev Policy. 2001;8:151–75.
Wagenaar AC, Gehan JP, Jones-Webb R, Toomey TL, Forster JL, Wolfson M, Murray DM. Communities Mobilizing for Change on Alcohol: lessons and results from a 15-community randomized trial. J Community Psychol. 1999;27:315–26.
Werna E, Harpham T. The implementation of the Healthy Cities project in developing countries: lessons from Chittagong. Habitat Int. 1996;20:221–8.
Amed S, Shea S, Pinkney S, Wharf Higgins J, Naylor P-J. Wayfinding the Live 5-2-1-0 initiative-at the intersection between systems thinking and community-based childhood obesity prevention. Int J Environ Res Public Health. 2016;13(6). https://doi.org/10.3390/ijerph13060614.
Mikkelsen BE, Novotny R, Gittelsohn J. Multi-level, multi-component approaches to community based interventions for healthy living-a three case comparison. Int J Environ Res Public Health. 2016;13(10):1023–40.
Carey G, Malbon E, Carey N, Joyce A, Crammond B, Carey A. Systems science and systems thinking for public health: a systematic review of the field. BMJ Open. 2015;5:e009002.
Hawe P, Shiell A, Riley T. Theorising interventions as events in systems. Am J Community Psychol. 2009;43:267–76.
Allender S, Owen B, Kuhlberg J, Lowe J, Nagorcka-Smith P, Whelan J, et al. A community based systems diagram of obesity causes. PLoS One. 2015;10(7):e0129683.
Huang T, Ferris E. Connecting the dots: translating systems thinking into innovative solutions for childhood obesity. In: Goran MI, editor. Childhood obesity causes, consequences, and intervention approaches. Boca Raton: CRC Press Taylor & Francis Group; 2016. p. 465–77.
Rutter H, Savona N, Glonti K, Bibby J, Cummins S, Finegood D, Greaves F, Harper L, Hawe P, Moore L, et al. The need for a complex systems model of evidence for public health. Lancet. 2017;390(10112):2602–4.
Thomas J, Newman M, Oliver S. Rapid evidence assessments of research to inform social policy: taking stock and moving forward. Evid Policy. 2013;9(1):5–27.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: new guidance. London: Medical Research Council; 2006.
Coly A, Parry G. Evaluating complex health interventions: a guide to rigorous research designs. In: AcademyHealth; 2017.
This report was commissioned from Leeds Beckett University by Public Health England as part of a larger project looking at Whole System Approaches to Obesity. We would like to thank Ben Mitchell for designing the search strategy and carrying out the electronic database searches, and Leonie O’Dwyer and Robin Kaye for their help with data extraction and validity assessment of included studies. We would also like to thank the Interlibrary loans team (Susan Ellis and Karl Derbyshire) in the Sheila Silver Library at Leeds Beckett University, for their excellent help in locating articles. We would also like to acknowledge the support given by the PHE Whole Systems Advisory Group, chaired by Jim McManus, and thank the following individuals for their helpful input: Adrienne Cullum, Diet, Obesity and Physical Activity Health Improvement Directorate PHE; Jim McManus, Director of Public Health, Hertfordshire County Council and Chair, PHE Whole Systems Advisory Group; Verity Hawkes, Higher Nutrition Scientific Officer, Diet & Obesity, Public Health England.
The review was funded, as part of a larger project, by Public Health England. The funding body was not involved in the design of the study or in collection or analysis of the data. Some members of the funding body (listed as authors) were involved in discussions around interpretation of some of the data and in writing the manuscript. Some of James Nobles' time was supported by the National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care West (CLAHRC West) at University Hospitals Bristol NHS Foundation Trust.
Availability of data and materials
The data extracted and used during this study are included in this published article and its supplementary information files. A full report is available from the authors on request.
Ethics approval and consent to participate
Consent for publication
MVD, JB and SM are part of the Public Health England team responsible for the Whole Systems Obesity programme.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.