Skip to main content

Study protocol: evaluation of a community health promotion program in a socioeconomically deprived city district in the Netherlands using mixed methods and guided by action research



Voorstad on the Move (VoM) is a community health promotion program implemented in a socioeconomically deprived city district in the Netherlands. Based on exploration of the health situation, concurrent views on health promotion, and insights from literature, VoM is grounded in a social-ecological perspective and puts three action principles center core: citizens’ participation, intersectoral collaboration, and a health supportive environment. VoM aims to improve the health of inhabitants, mostly low socioeconomic status (SES) families, and to realize changes in the social and physical environment. This current research, as part of the wider VoM project, aims to study the impacts and action principles of VoM. The main research questions concern the inhabitants’ perceptions on health and health supportive environments, the perceived benefits of citizen participation in terms of health literacy and empowerment, and the factors and mechanisms that contribute to citizen participation and intersectoral collaboration.


The study has a mixed methods design, including process evaluation and monitoring, and combines qualitative and quantitative data. Research activities include literature study, in-depth interviews, focus group discussions, concept and capacity mapping, document analysis, and health survey data. A prominent strategy is action research, which aims to involve all stakeholders, capturing the different perspectives of citizens and professionals, and engaging low SES groups. The principle of triangulation is continuously applied to optimize the reliability of this study, using multiple methods and multiple sources. Internal validity is enhanced by triangulation of methods and resources. Other verification techniques will also be used, such as expert consultation.


The design of the study, with a strong focus on action research, facilitates the involvement of all stakeholders and contributes to the development of capacities, learning, and empowerment, and thus contributes to health. The VoM program is innovative because it adopts an open approach in which activities evolve from citizens’ needs, with a focus on action elements. This study will unravel the mechanisms of the action elements at community level, thereby helping to find ways to reduce health inequities. The findings will further elucidate what works and why it works for low SES groups.

Peer Review reports


In the Netherlands, less educated inhabitants live – on average – six years less than most educated people, and the difference in healthy life expectancy between these groups is almost 19 years [1]. Although the healthy life expectancy of less educated people has increased considerably in the last decade, the difference in life expectancy between the two groups has remained the same [1].

Health inequities are a complex problem caused by the interplay between individuals, groups, communities, and multiple factors in the social, physical, and economic environment [2,3,4,5]. To date, health promotion programs have not been successful in substantially reducing the health gap between the higher and the lower socioeconomic groups. It is therefore a challenge to develop more effective strategies [6,7,8,9,10]. These strategies should be based on an ecological perspective, addressing factors at multiple levels and looking at the interaction between factors [11,12,13].

Such strategies are being developed in the community health promotion program called Voorstad on the Move (VoM). In line with national and local policy objectives, the aim of the program is to contribute to the improvement of health and to find ways to reduce health inequities [14, 15]. The program is being implemented in four socioeconomically deprived neighborhoods in a city district of 10,750 inhabitants in a city in the east of the Netherlands between July 2016 and January 2020. In Voorstad, both the socioeconomic status (SES) and the health status of inhabitants are relatively low compared with other parts of city [16].

Casus: Community health promotion program ‘Voorstad on the Move’ (VoM)

VoM is grounded in a social-ecological perspective, based on the exploration of the health situation in Voorstad, concurrent with views on health promotion and insights from the literature [17,18,19,20,21]. VoM puts three action principles at its center: citizen participation, intersectoral collaboration, and a health supportive environment, that that were emanated from the results of an preparatory study (Oct–Dec 2015) [22].

The aim of the preparatory study was to get an impression of the health situation in Voorstad in order to decide on the program goals and methods. This preparatory study consisted of seven focus groups with citizens (n = 40) and 30 interviews with professionals from different disciplines about health and health behaviors. Overall, the top three most mentioned aspects of health were: feeling at ease (no stress), being in control, and being together with friends, family, and neighbors (joint activities). There was a clear focus on health as an asset or resource for meaningful living [23, 24]. The inhabitants barely mentioned unhealthy lifestyles, e.g. obesity and smoking, which are the focus of professionals and of the data in monitor and health surveys. These qualitative data were supplemented with quantitative data from health monitors [25] and the local citizens’ survey [26]. The discrepancy in perceptions on health and wellbeing between inhabitants and professionals emphasizes the need to include citizens’ perceptions in health promotion activities [19, 20, 27].

The Voorstad inhabitants’ viewpoints are the starting point for VoM, thereby giving the inhabitants ownership to address health in a positive way, focusing on assets and resources [24]. This means that activities in the program are not chosen or planned beforehand, but rather developed and implemented as a result of questions and needs expressed by Voorstad inhabitants. Citizens’ active involvement and responsibility for activities strengthen their health literacy and empowerment [28,29,30]. Citizen participation, including defining ‘health’, developing, implementing, and evaluating activities with and by the citizens [31, 32], is one of the action principles in VoM.

Another important finding of the preparatory study was the presence of a comprehensive infrastructure of public, welfare, social support, sports and care organizations, community centers, and (informal) networks and alliances in which both professionals and inhabitants collaborate [22]. Intersectoral collaboration [33,34,35,36] between primary care, social services, and environmental, policy, and public health workers is therefore a second action principle of the program. VoM joins and uses the existing social infrastructure to add the broader view on health and bring in knowledge to make health promotion activities possible.

Both inhabitants and professionals mentioned barriers that hinder healthy living and keep them from changing behavior, such as accessibility of sports facilities and prices of healthy foods, as well as social norms, attitudes, and habits. This indicates the third action principle of VoM: creating a supportive social and physical environment for health [37,38,39].These action principles can be defined as actions, processes, or mechanisms that help establish the effect or impacts of a health promotion program [40,41,42]. The premise of principles for action is that they contribute to health through multiple pathways and serve multiple purposes, such as program effectiveness, the creation of supportive environments for health, and empowerment of all stakeholders, both professionals and citizens [32, 43].

In July 2016, two health brokers started to support these action principles by facilitating citizens’ participation in developing and implementing activities that fit citizens’ needs and build healthy alliances. Recent studies show that the broker role is essential in facilitating intersectoral collaboration and exchanging knowledge between stakeholders [44,45,46].

The aim of the VoM program is to improve the perceived health of the Voorstad inhabitants, mostly low SES families, and achieve changes in the social and physical environment that support health and healthy behavior. The overall research aim is to study the impacts and action principles of VoM comprehensively on different levels. This will contribute to finding ways to reduce existing health inequities. Therefore, four interrelated research questions (RQs) have been formulated:

  1. 1.

    How do Voorstad inhabitants perceive health and health supportive environments?

  2. 2.

    What benefits do citizens who participate in the Voorstad on the Move program observe in terms of perceived health, health literacy, and empowerment?

  3. 3.

    What factors and mechanisms contribute to citizen participation and intersectoral collaboration?

  4. 4.

    What is the overall impact of the Voorstad on the Move program in terms of health promotion activities, social and physical environment, and inhabitants’ perceived health?

Theoretical framework

Because the VoM program is based on a social-ecological perspective on health, the theoretical framework consists of different theories and models that recognize the link between practice and context within social situations.

To study and understand impact on health and the environment on the one hand and the working of the action principles on the other hand, a framework to facilitate and evaluate a community health promotion program will be used [32, 47, 48]. This framework [Fig. 1] visualizes the relation between the social environment, health predicting mediators (e.g. lifestyle), and population health status (e.g. perceived health). It provides operationalizable variables that moderate the relation between the social environment and health predicting mediators. The moderating variables are the action principles in the VoM program. Citizen participation, intersectoral collaboration, and a health supportive environment are used as entry points to make the social environment of health researchable and manageable by communities.

Fig. 1
figure 1

Framework to facilitate and evaluate community health promotion [48]

Social practice theory (SPT) [49], the reasonable person model (RPM) [50], and the Healthy Alliances (HALL) framework [33] are used to understand the working of the action principles comprehensively and on different levels.

SPT integrates the individual with his or her social environment and will be used to study the mechanisms of citizen participation and health behaviors. In contemporary theories of social practice, health and wellbeing are considered to be outcomes of participation in a set of social practices, commonly created by the reality of everyday life [49]. Following Shove et al. [51], a practice is defined as being constituted by meanings about how and why to do things (cultural conventions, expectations, and socially shared meanings), materials (objects, tools, and infrastructures), and competences both tacit and explicit (knowledge and embodied skills) [Fig. 2]. In this study, participation and health behaviors will be regarded as social practices rather than only individual behavior, because they fit with the community approach focusing on social change, instead of attempting to change what Shove et al. [51] refer to as individuals’ ABC (attitudes, behaviors, choices).

Fig. 2
figure 2

The elements of a social practice. Adapted based on Shove et al. [51]

The RPM is a conceptual framework that links environmental factors with human behavior [50]. People are more reasonable, cooperative, helpful, and satisfied when the environment supports their basic informational needs. The same environmental supports are important factors in enhancing human health. Reasonableness is used, rather than well-being, because it focuses on bringing out the best in people. Central in the RPM is the management of information, either visual or written, indicating that people are more reasonable when their informational needs are met [52].

The RPM consists of three domains: building mental models, meaningful action, and being effective [Fig. 3]. Mental models influence our perception of what is going on and guide our actions. Meaningful action implies that people feel listened to and respected, even if their wishes are not met. The sense that one is making a difference can go a long way towards bringing out the best in one [53]. Being effective concerns effectiveness and reasonableness, because of mental fatigue. It is about a particular aspect of mental functioning described as directed attention, caused by the many complex and competing demands in one’s environment. The RPM framework will be used to study the way in which the physical environment can be health supportive to the inhabitants. Both SPT and RPM put great importance on the interaction between the environment and the behavior of an individual. They are complementary, as SPT focuses on the social environment and RPM on the natural (physical) environment.

Fig. 3
figure 3

The Reasonable Person Model [52]

Within the extended network that exists in Voorstad, intersectoral collaboration is facilitated by a small steering group of partners from the healthcare and societal sectors, with health brokers as essential participants. This group can be regarded as the healthy alliance. The updated HALL framework, will be used to study intersectoral collaboration within the healthy alliance in VoM [Fig. 4]. This framework recognizes three groups of factors – institutional factors, (inter)personal factors, and the organization of the alliance – that can either facilitate or hamper the collaboration between the partners in the alliance [33]. The updated HALL framework visualizes the importance of context and learning culture in intersectoral collaboration [54].

Fig. 4
figure 4

The updated Healthy Alliance framework [54]. Translated from Tol et al., [54]


Study design

The study will use a mixed-methods design and will combine qualitative and quantitative data. The research activities will include literature study, in-depth interviews, focus group discussions, concept and capacity mapping, document analysis, and analysis of citizens’ survey data [Table 1].

Table 1 Study overview – frameworks, methods, tools, participants, and repeats

The use of multiple strategies and multiple research methods across multiple levels is assumed to be the most effective approach. The combination of information from multiple sources and methods – triangulation –increases data validity [55]. Also, partners and citizens will be involved in the planning of the research as well as in different research activities.

A prominent strategy is action research, which aims to involve all stakeholders, capturing the different perspectives of citizens and professionals and engaging citizens with low SES. The value of action research is that it reflects the values of health promotion, such as participation and empowerment [6, 56,57,58]. It thereby facilitates the development of capacities, learning, and empowerment [4] and thus contributes to health [59]. It also enables those involved to continually optimize their strategies [60,61,62], and it contributes to developing both theories and research methods to understand and explain what works and why it works.

To operationalize, and to provide insights into, factors relevant to addressing the RQs, the logic model, based on the framework for planning, implementation, and evaluation of health promotion programs [63], will be used [Fig. 5]. This logic model will help to make explicit the hypothesized pathways; to define processes, output, and outcome indicators at different levels (individual, professional, and community); and to unravel action elements [32, 64].

Fig. 5
figure 5

Logic model used for evaluation of Voorstad on the Move. Adapted based on Saan & Haes [63]

Figure 5 illustrates the logic model for the impact evaluation of VoM, based on literature on community-based approaches [6, 32, 64] and evaluation studies of complex community health promotion programs [64]. The hypothesis is that a community-based participatory approach to developing and implementing health activities at different levels such as individuals, professionals, and community will result in improved perceived health, a health supportive environment, and sustainable local health policy, leading to a reduction in health inequities in the long term. These long-term expected outcomes will be preceded by measurable short-term outcomes like e.g. health literacy, healthy alliances, and changes in the physical environment, moderated by the action principles. In this model, citizen participation, intersectoral collaboration, and a health supportive environment are defined as program outcomes and, at the same time, are action principles in this principle-based health promotion program [32]. The operationalization of each of the four research questions is now set out.

Research question 1. How do Voorstad inhabitants perceive health and a health supportive environment?

Perceptions on health and health supportive environments will be measured using focus groups and photovoice.

  1. a.

    Collecting and discussing the perceptions and priorities of the inhabitants about health is the starting point for citizen participation in the VoM program. At the start of the program, focus groups will be held with 15 existing groups of inhabitants to explore perceptions and meanings about health [65, 66]. Results of the first focus group session will be fed back to, and discussed, with the same group in a second session. Participants are challenged to think of actions and plans to work on their own health. In total, about 100 inhabitants will participate in this research study.

  2. b.

    Photovoice will be used to reveal inhabitants’ perceptions of their neighborhood as a source of health opportunities or barriers [67,68,69]. In total, 32–40 inhabitants (8–10 from each of the four neighborhoods) will be asked to tell ‘the story of the photo or image’.

Research question 2. What benefits do citizens who participate in the Voorstad on the move program observe in terms of perceived health, health literacy, and empowerment?

Active participation in health promotion activities, varying from consultation and collaboration to partnership or ownership, can either result from the focus groups or otherwise be initiated by the VoM health brokers or collaborating partners. A total of 100 inhabitants who either participate in focus groups (RQ 1) or are involved in community activities will be ‘followed’ during the program. They will be asked about their way and level of participation using Pretty’s participation ladder [34, 70], health literacy using the 9-item Health Literacy Questionnaire (HLQ) [71,72,73], and empowerment using the Netherlands Empowerment Checklist [74, 75]. Perceived health is assessed based on the question on self-perceived health: ‘How is your health in general’, which contains five answering categories; 1) very good, 2) good, 3) fair, 4) bad, and, 5) very bad. This question is part of the citizens’ survey which takes place every two years in Deventer [16] and of the Health Monitor conducted by the Municipal Health Services in the Netherlands [76, 77]. Subsequently, in-depth interviews and focus groups will be held to discuss citizens’ perceptions on the connection between participation, perceived health, and empowerment.

Research question 3. What factors and mechanisms contribute to citizen participation and intersectoral collaboration?

The HALL framework will be used to study the intersectoral collaboration and active involvement of stakeholders and to identify conditions that contribute to the collaboration and make these alliances successful [33, 54] [Fig. 4]. A special focus will be placed on the role of health brokers, as these seem to be crucial for connecting different sectors [78]. The Coordinated Action Checklist [48] will be used to evaluate and facilitate the collaboration of the core stakeholders, members of the Voorstad social team, the neighborhood manager, health brokers, and the program coordinator. The results of the checklist on various dimensions, such as task, relations, growth, and visibility, will be discussed with this core group. These evaluation sessions will be held once a year, in total three times.

A document analysis of all the reports, plans, and notes produced by the project team will be used to describe the collaboration processes that have taken place. Furthermore, a network analysis [35, 60] will be conducted to map the collaborating organizations – community centers, schools, grassroots organizations, and neighborhood sports club – that take part in the program irregularly and on a less structured basis. Five to 10 organizations will be interviewed twice (2018 and 2020) to get insights into the impact of VoM, the collaboration processes [79], and the health broker role.

Research question 4. What is the overall impact of the Voorstad on the move program in terms of health promotion activities, social and physical environment, and inhabitants’ perceived health?

Results and outcomes of the program will be measured on different levels: individual, professional, and community [Fig. 5]. At the individual level, perceived health, lifestyle, and health behaviors have been or will be measured in the local citizens’ survey every two years (2015: T0; 2017: T1; 2019: T2) [16]. Additionally, the health monitors [76] carried out in 2016 and 2020 will provide more detailed information on the health status of the city district, Voorstad. In both surveys, citizens’ health and lifestyle data are monitored at neighborhood level.

The program activities are monitored in a so-called activity database. The number and type of health promotion activities developed with citizens’ involvement and the number of participants per activity will be registered, thereby monitoring the program output. Citizens who participate in the program activities will be asked about their satisfaction. In order to map changes in perceptions of the social and physical environment, the photovoice study (RQ1) will be repeated in 2019.

Qualitative research data from interviews and focus group discussions will be audiotaped, transcribed, and analyzed using Atlas-ti to manage the data and guarantee transparency. A coding scheme based on theory and the framework will be developed to analyze the qualitative data stepwise, data driven, and thematically. Top-down as well as bottom-up coding will be used. The top-down coding will use predefined codes based on factors mentioned in the theoretical models: the HALL framework, SPT, and RPM. The bottom-up coding (free coding) will trace general themes that emerge in interviews and focus groups. In this way, relevant topics devised in advance of the study design and relevant topics from practice will be fully mapped. These themes will make it possible to interrelate and interpret the gathered data [80].

Quantitative data will be analyzed by descriptive statistics and regression analysis techniques using the SPSS program. In the analysis, quantitative data obtained to measure changes in perceived health (RQ4) will be combined with qualitative data on participation, empowerment, and health literacy (RQ 2), with data at professional level – short-term outcomes realized by the healthy alliances and health brokers (RQ 3), and with data at community level – the social and the physical environment (RQ1).

The impacts on the different levels will be integrated and related to the action principles using realist synthesis [81] in the data analysis, facilitating the identification of the contextual factors and program mechanisms determining the outcomes (or impacts). These context–mechanism–outcome (CMO) configurations [18] will provide insights into the overall impacts in relation to the action principles.

Sample size and power

The perceived health of adult inhabitants in the neighborhood will be used as the primary outcome of the VoM program at the individual level. In line with common practice in presenting perceived health prevalence rates, response options for self-perceived health will be dichotomized, with the response categories ‘very good’ and ‘good’ into one ‘very good or good’ category and the other response options in a ‘less than good’ category [82]. In 2015, the percentage of inhabitants in the city of Deventer scoring (very) good health was on average 79%, whereas this was 75% for the city district Voorstad [16]. Therefore, the estimate of the effect size of perceived health to be obtained by implementing the VoM program was determined by the difference between Voorstad (0.75) and the city of Deventer (0.79): 0.04. The sample size calculation was conducted with G*Power version with alpha set on 0.05, and a power of 0.80. The used test family was exact and based on the difference from a constant (0.75). The required lower critical number of participants is 542, the required sample size is 697. The response rate of Health Monitors in general is 40% [83]. As there are differences in response rate between city districts, we assume a modest response rate of 35%. The required number of participants to obtain reliable estimates of increase in perceived health is therefore 2000. The total adult population in Voorstad is 8412 inhabitants. 2200 Inhabitants will be invited to join the online survey, in order to be sure of sufficient power.



This study will evaluate the impact of a community-based health program in a socioeconomically deprived city district in order to find keys to reducing health inequities. It is a single case study in which low SES inhabitants – in the view of health professionals usually hard to reach and not very interested in health promotion activities – are actively involved. It will provide insights into perceptions, values, and needs regarding the health of low SES groups.

The VoM program is innovative as it is different from usual health promotion programs in which health subjects and activities are set by professionals. Instead, the VoM program shifts from being a pre-devised health promotion program with a set of interventions to being an open approach with a focus on action elements. Unravelling the mechanisms of these action elements – citizen participation, intersectoral collaboration at community level, and a health supportive environment – will help to find ways to reduce health inequities. The findings will contribute to a better understanding, and will expand the knowledge, of what works for low SES groups and why it works. Other local health promotion programs can benefit from the knowledge and experiences gathered in this study.

Strengths and limitations

The study design is optimized for internal and external validity because of the combination of action research, process evaluation, and citizens’ monitoring and survey data. The principle of triangulation is continuously applied to optimize the reliability of this study, using multiple methods and multiple sources. Internal validity is enhanced by triangulation of methods and resources, whereby results will be checked with other stakeholders. In addition, other verification techniques will be used, such as expert consultation.

In this study, the inhabitants’ survey will be used to measure perceived health and health determinants in a pre-test/post-test design. The results obtained from these surveys will be linked with results from the intervention, the environment, and the organizational level in order to be able to explain why changes in perceived health have taken place or not.

The application of SPT, the HALL framework, and RPM provides the researcher with a strong theoretical framework and guarantees validation of the results gathered in this single case study. This study contributes to the knowledge on the benefits of citizen participation, being a necessary aspect of health promotion, and how to realize it. Recent studies [84] recommend evaluation of community participation in creating a ‘health in all policies’ knowledge base. Hence, the participatory action research in itself contributes to health literacy, is empowering for those who participate, and contributes to community building [27].





Healthy Alliance


Health Literacy Questionnaire


Participatory Network Mapping Tool


Reasonable Person Model


Research Question


Socioeconomic Status


Social Practice Theory


Voorstad on the Move


  1. RIVM. Een gezonder Nederland [Towards a healthier Netherlands]. 2014. Accessed 2 June 2017.

    Google Scholar 

  2. Whitehead M, Dahlgren G. What can be done about inequalities in health? Lancet. 1991;338:1059–63.

    Article  CAS  PubMed  Google Scholar 

  3. Marmot MG. Closing the gap in a generation. Bull World Health Organ. 2011;89:702.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Rice M, Franceschini MC. Lessons learned from the application of a participatory evaluation methodology to healthy municipalities, cities and communities initiatives in selected countries of the Americas. Promot Educ. 2007;14:68–73.

    Article  PubMed  Google Scholar 

  5. Golden SD, McLeroy KR, Green LW, Earp JAL, Lieberman LD. Upending the Social Ecological Model to Guide Health Promotion Efforts Toward Policy and Environmental Change. Heal Educ Behav. 2015;42(1_suppl):8S–14S.

    Article  Google Scholar 

  6. Herens M, Wagemakers A, Vaandrager L, van Ophem J, Koelen MA. Evaluation design for community-based physical activity programs for socially disadvantaged groups: communities on the move. JMIR Res Protoc. 2013;2(1):e20.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Storm I, van Koperen M, van der Lucht F, van Oers H, Schuit J. Monitoren en evalueren van integraal gezondheidsbeleid [monitoring and evaluation of integral health policy]. Beleidsonderzoek Online. 2014.

  8. Stronks K, Arah OA, Plochg T. Learning from policy failure and failing to learn from policy. Eur J Pub Health. 2006;16:343–4.

    Article  Google Scholar 

  9. Mackenbach JP. Has the English strategy to reduce health inequalities failed? Soc Sci Med. 2010;71:1249–53.

    Article  PubMed  Google Scholar 

  10. Borrell C, Artazcoz L, Pasarín MI, Díez E, Claes C, van Loon J, et al. Social inequalities in health and closing the gap in a generation. Eval Program Plann. 2009;30:189–94.

    Google Scholar 

  11. Bronfenbrenner U. Ecological models of human development. In: The international encyclopedia of education, vol. 3. 2nd ed. Oxford: Elsevier; 1994. p. 1643–7.

    Google Scholar 

  12. Sallis JF, Owen N, Fotheringham MJ. Behavioral epidemiology: a systematic framework to classify phases of research on health promotion and disease prevention. Ann Behav Med. 2000;22:294–8.

    Article  CAS  PubMed  Google Scholar 

  13. Stokols D. Translating social ecological theory into guidelines for community health promotion. Am J Health Promot. 1996;10:282–98.

    Article  CAS  PubMed  Google Scholar 

  14. de Jong MAJG. Projectplan Voorstad beweegt [Project plan Voorstad on the Move] 2016. Assessed 2 Nov 2018.

    Google Scholar 

  15. Ministery of Health Welfare and Sports. Landelijke nota gezondheidsbeleid 2016-2019 [National Health Policy document 2016–2019]. Den Haag: Ministery of Health Welfare and Sports; 2015.

    Google Scholar 

  16. Gemeente Deventer. Wijkenmonitor [Neighbourhood monitor]. 2016. Accessed 2 Nov 2018.

    Google Scholar 

  17. Sallis J, Cervero R, Ascher W, Henderson K, Kraft MK, Kerr J. An ecological approach to creating active living communities. Annu Rev Public Health. 2006;27:297–322.

    Article  PubMed  Google Scholar 

  18. Herens M, Wagemakers A, Vaandrager L, van Ophem J, Koelen MA. Contexts, mechanisms, and outcomes that matter in Dutch Community-based physical activity programs targeting socially vulnerable groups. Eval Health Prof. 2017;40:294–331.

    Article  PubMed  Google Scholar 

  19. Naaldenberg J, Vaandrager L, Koelen MA, Leeuwis C. Aging populations’ everyday life perspectives on healthy aging. J Appl Gerontol. 2012;31:711–33.

    Article  Google Scholar 

  20. Bukman AJ, Teuscher D, Feskens EJM, van Baak MA, Meershoek A, Renes RJ. Perceptions on healthy eating, physical activity and lifestyle advice: opportunities for adapting lifestyle interventions to individuals with low socioeconomic status. BMC Public Health. 2014;14:1036.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Vaandrager L, Wagemakers A, Saan H. Evidence in gezondheidsbevordering [Evidence in health promotion]. Tijdschr voor gezondheidswetenschappen. 2010;88:271–7.

    Article  Google Scholar 

  22. de Jong MAJG, Roos G. Startfoto Gezond in Voorstad [starting picture health in Voorstad]. 2016.

    Google Scholar 

  23. Antonovsky A. The salutogenic model as a theory to guide health promotion. Health Promot Int. 1996;11:11–8.

    Article  Google Scholar 

  24. Morgan A, Ziglio E. Revitalising the evidence base for public health: an assets model. Promot Educ. 2007;14(2_suppl):17–22.

    Article  Google Scholar 

  25. GGD IJsselland. Tabellenboek Volwassenenmonitor 2012 [Book of tables of the health survey, adult population]. Accessed 12 Jun 2017.

  26. Gemeente Deventer. Kerncijfers Voorstad [Key figures Voorstad]. 2015 Accessed 2 Jun 2017.

    Google Scholar 

  27. den Broeder L, Chung KY, Geelen L, Scholtes M, Schuit AJ, Wagemakers A. We are all experts! Does stakeholder engagement in health impact scoping lead to consensus? A Dutch case study. Impact Assess Proj Apprais. 2016;34:294–305.

    Article  Google Scholar 

  28. Laverack G. Using a “domains” approach to build community empowerment. Community Dev J. 2006;41:4–12.

    Article  Google Scholar 

  29. Nutbeam D. The evolving concept of health literacy. Soc Sci Med. 2008;67:2072–8.

    Article  PubMed  Google Scholar 

  30. Peerson A, Saunders M. Health literacy revisited: what do we mean and why does it matter? Health Promot Int. 2009;24:285–96.

    Article  PubMed  Google Scholar 

  31. Koelen MA, van den Ban AW. Health education and health Promotion. Wageningen: Wageningen Academic Publishers; 2004.

    Book  Google Scholar 

  32. Wagemakers A, Vaandrager L, Koelen MA, Saan H, Leeuwis C. Community health promotion: a framework to facilitate and evaluate supportive social environments for health. Eval Program Plann. 2010;33:428–35.

    Article  PubMed  Google Scholar 

  33. Koelen MA, Vaandrager L, Wagemakers A. The healthy alliances (HALL) framework: prerequisites for success. Fam Pract. 2012;29(SUPPL. 1):132–8.

    Article  Google Scholar 

  34. Wagemakers A, Corstjens R, Koelen MA, Vaandrager L, Van ‘t Riet H, Dijkshoorn H. Participatory approaches to promote healthy lifestyles among Turkish and Moroccan women in Amsterdam. Promot Educ. 2008;15:17–23.

    Article  PubMed  Google Scholar 

  35. Storm I, den Hertog F, van Oers H, Schuit AJ. How to improve collaboration between the public health sector and other policy sectors to reduce health inequalities? – a study in sixteen municipalities in the Netherlands. Int J Equity Health. 2016;15:97.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Leenaars KEF, Smit E, Wagemakers A, Molleman GRM, Koelen MA. Facilitators and barriers in the collaboration between the primary care and the sport sector in order to promote physical activity: a systematic literature review. Prev Med. 2015;81:460–78.

    Article  CAS  PubMed  Google Scholar 

  37. Schulz A, Northridge ME. Social determinants of health: implications for environmental health promotion. Health Educ Behav. 2004;31:455–71.

    Article  PubMed  Google Scholar 

  38. Foster C, Hillsdon M. Changing the environment to promote health-enhancing physical activity. J Sports Sci. 2004;22:755–69.

    Article  PubMed  Google Scholar 

  39. Golden SD, Earp JAL. Social ecological approaches to individuals and their contexts. Heal Educ Behav. 2012;39:364–72.

    Article  Google Scholar 

  40. Herens M, Wagemakers A, Vaandrager L, Koelen MA. Exploring participant appreciation of group-based principles for action in community-based physical activity programs for socially vulnerable groups in the Netherlands. BMC Public Health. 2015;15:1173.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Gregg J, O’Hara L. Values and principles evident in current health promotion practice. Heal Promot J Aust. 2007;18:7–11.

    Article  Google Scholar 

  42. Wartna J, Vaandrager L, Wagemakers A, Koelen MA. “Er is geen enkel werkzaam Principe dat altijd werkt” Een eerste verkenning van het begrip werkzame principes [there is not a single effective principle that always works. An initial exploration of the term effective principles]. Wageningen: Health & Society, Wageningen University & Research; 2012.

    Google Scholar 

  43. Koelen MA, Vaandrager L, Wagemakers A. What is needed for coordinated action for health? Fam Pract. 2008;25(Suppl 1):i25–31.

    Article  PubMed  Google Scholar 

  44. Harting J, Kunst AE, Kwan A, Stronks K. A “health broker” role as a catalyst of change to promote health: an experiment in deprived Dutch neighbourhoods. Health Promot Int. 2011;26:65–81.

    Article  PubMed  Google Scholar 

  45. Leenaars KEF, Florisson AME, Smit E, Wagemakers A, Molleman GRM, Koelen MA. The connection between the primary care and the physical activity sector: professionals’ perceptions. BMC Public Health. 2016;16:1001.

    Article  PubMed  PubMed Central  Google Scholar 

  46. van Rinsum CE, Gerards SMPL, Rutten GM, van de Goor IAM, Kremers SPJ. Health brokers: how can they help Deal with the wickedness of public health problems? Biomed Res Int. 2017.

  47. Wagemakers A. Community Health Promotion. Facilitating and evaluating coordinated action to create supportive social environments. Wageningen: Wageningen University; 2010.

    Google Scholar 

  48. Wagemakers A, Koelen MA, Lezwijn J, Vaandrager L. Coordinated action checklist: a tool for partnerships to facilitate and evaluate community health promotion. Glob Health Promot. 2010;17:17–28.

    Article  PubMed  Google Scholar 

  49. Maller CJ. Understanding health through social practices: performance and materiality in everyday life. Sociol Health Illn. 2015;37:52–66.

    Article  PubMed  Google Scholar 

  50. Kaplan S, Kaplan R. Health, supportive environments, and the reasonable person model. Am J Public Health. 2003;93:148–1489.

    Article  Google Scholar 

  51. Shove E, Pantzar M, Watson M. The Dynamics of Social Practice: Everyday Life and How it Changes: SAGE publications; 2012.

  52. Kaplan R, Kaplan S. Well-being, reasonableness, and the natural environment. Appl Psychol Heal Well-Being. 2011;3:304–21.

    Article  Google Scholar 

  53. Basu A, Kaplan R. The reasonable person model (RPM): introducing the framework and the chapters. In: Fostering reasonableness: supportive environments bringing out our best. Ann Arbor: Maize Books; 2015. p. 1–27.

    Google Scholar 

  54. van Tol M, Wagemakers A, Koelen MA. Succesvol samenwerken is leren [Collaborating succesfully is a learning process]. Tijdschr voor gezondheidswetenschappen. 2017;95:24–9.

    Article  Google Scholar 

  55. Koelen MA, Vaandrager L, Colomér C. Health promotion research: dilemmas and challenges. J Epidemiol Community Health. 2001;55:257–62.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  56. Baum F. Participatory action research. J Epidemiol Community Heal. 2006;60:854–7.

    Article  Google Scholar 

  57. Koch T, Kralik D, van Loon A, Mann S. Participatory action research in health care. Malden: Blackwell Publishing; 2009.

    Google Scholar 

  58. Hughes I. Action research in healthcare. In: The SAGE handbook of action research: participatory inquiry and practice. 2nd ed. Thousand Oaks: Sage Publications Ltd; 2008. p. 381–93.

    Chapter  Google Scholar 

  59. Huber M, van Vliet M, Giezenberg M, Winkens B, Heerkens Y, Dagnelie PC, et al. Towards a ‘patient-centred ’ operationalisation of the new dynamic concept of health : a mixed methods study. BMJ Open. 2016;6:1–12.

    Article  Google Scholar 

  60. Wijenberg E, Wagemakers A, Herens M, den Hartog F, Koelen MA. The value of the participatory network mapping tool to facilitate and evaluate coordinated action in health promotion networks: two Dutch case studies. Glob Health Promot. 2017.

  61. Laverack G, Keshavarz MN. What remains for the future: Strengthening community actions to become an integral part of health promotion practice. Health Promot Int. 2011;26(SUPPL. 2):ii258–62.

    PubMed  Google Scholar 

  62. Glanz K, Rimer BK, Viswanath K. Health behaviour and health education: theory, research and practice. San Francisco: Jossey-Bass; 2008. p. 49–54.

    Book  Google Scholar 

  63. Saan H, de Haes W. Gezond effect bevorderen. Het organiseren van effectieve gezondheidsbevordering [to promote healthy effects. Organising effective health promotion]. NIGZ: Woerden; 2005.

    Google Scholar 

  64. van Koperen TM, Jebb SA, Summerbell CD, Visscher TLS, Romon M, Borys JM, et al. Characterizing the EPODE logic model: unravelling the past and informing the future. Obes Rev. 2013;14:162–70.

    Article  PubMed  Google Scholar 

  65. Ruff CC, Alexander IM, McKie C. The use of focus group methodology in health disparities research. Nurs Outlook. 2005;53:134–40.

    Article  PubMed  Google Scholar 

  66. Dahlin Ivanoff S, Hultberg J. Understanding the multiple realities of everyday life: basic assumptions in focus-group methodology. Scand J Occup Ther. 2006;13:125–32.

    Article  Google Scholar 

  67. Wang C. Photovoice as a participatory health promotion strategy. Glob Health Promot. 2007;2:68–73.

    CAS  Google Scholar 

  68. Nykiforuk CIJ, Vallianatos H, Nieuwendyk LM. Photovoice as a method for revealing Community perceptions of the built and social environment. Glob Health Promot. 2007;2:68–73.

    Google Scholar 

  69. Belon AP, Nieuwendyk LM, Valliannatos H, Nykiforuk CIJ. Perceived community environmental influences on eating behaviors: a Photovoice analysis. Glob Health Promot. 2007;2:68–73.

    Google Scholar 

  70. Draper AK, Hewitt G, Rifkin S. Chasing the dragon: developing indicators for the assessment of community participation in health programmes. Soc Sci Med. 2010;71:1102–9.

    Article  PubMed  Google Scholar 

  71. Sørensen K, van den Broucke S, Pelikan JM, Fullam J, Doyle G, Slonska Z, et al. Measuring health literacy in populations: illuminating the design and development process of the European health literacy survey questionnaire (HLS-EU-Q). BMC Public Health. 2013;13:948.

    Article  PubMed  PubMed Central  Google Scholar 

  72. Maindal HT, Kayser L, Norgaard O, Bo A, Elsworth GR, Osborne RH. Cultural adaptation and validation of the health literacy questionnaire (HLQ): robust nine-dimension Danish language confirmatory factor model. Springerplus. 2016;5:1232.

    Article  PubMed  PubMed Central  Google Scholar 

  73. Fransen MP, van Schaik TM, Twickler TB, Essink-Bot ML. Applicability of internationally available health literacy measures in the Netherlands. J Health Commun. 2011;16(SUPPL. 3):134–49.

    Article  PubMed  Google Scholar 

  74. Laverack G. Improving health outcomes through Community empowerment: a review of the literature. J Health Popul Nutr. 2006;24:113–20.

    PubMed  Google Scholar 

  75. van Hooijdonk C, van Lenthe F, Rentema M. Empowerment door van klacht naar kracht [Empowerment ‘from complaint to strength’]. Rotterdam: Afdeling Maatschappelijke Gezondheidszorg, Erasmus MC; 2010.

    Google Scholar 

  76. GGD IJsselland. Gezondheidsmonitor Volwassenen en ouderen [Health survey adult and elderly population]. Accessed 12 Jun 2017.

  77. RIVM. Ervaren Gezondheid meten [Measuring perceived health]. Accessed 2 Nov 2018.

  78. Leenaars KEF, Smit E, Wagemakers A, Molleman GRM, Koelen MA. Exploring the impact of the care sport connector in the Netherlands. BMC Public Health. 2017;17:813.

    Article  PubMed  PubMed Central  Google Scholar 

  79. van Tol M, Wagemakers A, Heinrich J, Koelen MA. Evaluatieonderzoek naar duurzame samenwerking binnen het project Gezond Ouder Worden [evaluation of sustainable collaboration within the healthy aging project]. GGD Noord- en Oost Gelderland: Apeldoorn; 2015.

    Google Scholar 

  80. Creswell J, Clark V. Designing and conducting mixed-methods research. 2nd ed. Thousand Oaks: Sage; 2011.

    Google Scholar 

  81. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist synthesis - an introduction. ESRC Res Methods Program. 2004:1–46.

  82. Croezen S, Burdorf A, Van Lenthe FJ. Self-perceived health in older Europeans: does the choice of survey matter? Eur J Pub Health. 2016;26:686–92.

    Article  Google Scholar 

  83. CBS. Gezondheidsmonitor 2016 [Health Monitor 2016]. Accessed 2 Nov 2018.

  84. den Broeder L, Devilee J, van Oers H, Schuit JA, Wagemakers A. Citizen science for public health. Health Promot Int. 2016:1–10.

  85. Council for International Organizations of Medical Sciences (CIOMS). International Ethical Guidelines for Health-Related Research Involving Humans. Geneva: Council for International Organizations of Medical Sciences; 2016.

    Google Scholar 

Download references


We are grateful to the project team and citizens in Voorstad who support this project.


The VoM program and evaluation study is funded by FNO (Fund NutsOhra) as part of the program ‘Healthy Future Nearby’. FNO a Dutch non-governmental organization (NGO). Project no. 101550. The study protocol to evaluate the VoM program was submitted, reviewed and approved by the Wageningen School of Social Sciences (WASS), the Netherlands.

Availability of data and materials

Not applicable.

Author information

Authors and Affiliations



MdJ, AW, and MK contributed to designing the study protocol. All authors are contributing to implementing the study. MdJ, and AW mainly wrote the article. All authors commented on draft versions of the manuscript and approved the final manuscript.

Corresponding author

Correspondence to Annemarie Wagemakers.

Ethics declarations

Ethics approval and consent to participate

The study will be conducted in accordance with the general ethical guidelines published by the Council for International Organizations of Medical Sciences [85] (, which include guidelines for vulnerable groups. This study consists of different sub-studies focusing on different groups within the community. Recruitment of participants will take place in collaboration with the members of the VoM project team, all being professionals working in this area and familiar with the citizens. The researchers will inform citizens and other stakeholders verbally and written about the purpose and contents of the study and research activities. Prior to each research activity, a guarantee of confidentiality and anonymity will be given by the researchers. Participant will be given the chance to ask questions. All participants will be asked to provide written informed consent. The data will be presented on an aggregated level, without any possibility of identifying individuals. The term ‘low SES’ will not be used in the study or in any of the other research activities with citizens.

The study protocol has been reviewed by the Social Sciences Ethics Committee of Wageningen University. The Committee does not have any objections to the overall research idea and approves the outline of the study. In line with the recommendation of the Committee the researchers have submitted applications for ethical approval for two sub-studies, which have been approved by the Committee.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

de Jong, M.A.J.G., Wagemakers, A. & Koelen, M.A. Study protocol: evaluation of a community health promotion program in a socioeconomically deprived city district in the Netherlands using mixed methods and guided by action research. BMC Public Health 19, 72 (2019).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: