- Study protocol
- Open Access
Study protocol: evaluation of a community health promotion program in a socioeconomically deprived city district in the Netherlands using mixed methods and guided by action research
BMC Public Health volume 19, Article number: 72 (2019)
Voorstad on the Move (VoM) is a community health promotion program implemented in a socioeconomically deprived city district in the Netherlands. Based on exploration of the health situation, concurrent views on health promotion, and insights from literature, VoM is grounded in a social-ecological perspective and puts three action principles center core: citizens’ participation, intersectoral collaboration, and a health supportive environment. VoM aims to improve the health of inhabitants, mostly low socioeconomic status (SES) families, and to realize changes in the social and physical environment. This current research, as part of the wider VoM project, aims to study the impacts and action principles of VoM. The main research questions concern the inhabitants’ perceptions on health and health supportive environments, the perceived benefits of citizen participation in terms of health literacy and empowerment, and the factors and mechanisms that contribute to citizen participation and intersectoral collaboration.
The study has a mixed methods design, including process evaluation and monitoring, and combines qualitative and quantitative data. Research activities include literature study, in-depth interviews, focus group discussions, concept and capacity mapping, document analysis, and health survey data. A prominent strategy is action research, which aims to involve all stakeholders, capturing the different perspectives of citizens and professionals, and engaging low SES groups. The principle of triangulation is continuously applied to optimize the reliability of this study, using multiple methods and multiple sources. Internal validity is enhanced by triangulation of methods and resources. Other verification techniques will also be used, such as expert consultation.
The design of the study, with a strong focus on action research, facilitates the involvement of all stakeholders and contributes to the development of capacities, learning, and empowerment, and thus contributes to health. The VoM program is innovative because it adopts an open approach in which activities evolve from citizens’ needs, with a focus on action elements. This study will unravel the mechanisms of the action elements at community level, thereby helping to find ways to reduce health inequities. The findings will further elucidate what works and why it works for low SES groups.
In the Netherlands, less educated inhabitants live – on average – six years less than most educated people, and the difference in healthy life expectancy between these groups is almost 19 years . Although the healthy life expectancy of less educated people has increased considerably in the last decade, the difference in life expectancy between the two groups has remained the same .
Health inequities are a complex problem caused by the interplay between individuals, groups, communities, and multiple factors in the social, physical, and economic environment [2,3,4,5]. To date, health promotion programs have not been successful in substantially reducing the health gap between the higher and the lower socioeconomic groups. It is therefore a challenge to develop more effective strategies [6,7,8,9,10]. These strategies should be based on an ecological perspective, addressing factors at multiple levels and looking at the interaction between factors [11,12,13].
Such strategies are being developed in the community health promotion program called Voorstad on the Move (VoM). In line with national and local policy objectives, the aim of the program is to contribute to the improvement of health and to find ways to reduce health inequities [14, 15]. The program is being implemented in four socioeconomically deprived neighborhoods in a city district of 10,750 inhabitants in a city in the east of the Netherlands between July 2016 and January 2020. In Voorstad, both the socioeconomic status (SES) and the health status of inhabitants are relatively low compared with other parts of city .
Casus: Community health promotion program ‘Voorstad on the Move’ (VoM)
VoM is grounded in a social-ecological perspective, based on the exploration of the health situation in Voorstad, concurrent with views on health promotion and insights from the literature [17,18,19,20,21]. VoM puts three action principles at its center: citizen participation, intersectoral collaboration, and a health supportive environment, that that were emanated from the results of an preparatory study (Oct–Dec 2015) .
The aim of the preparatory study was to get an impression of the health situation in Voorstad in order to decide on the program goals and methods. This preparatory study consisted of seven focus groups with citizens (n = 40) and 30 interviews with professionals from different disciplines about health and health behaviors. Overall, the top three most mentioned aspects of health were: feeling at ease (no stress), being in control, and being together with friends, family, and neighbors (joint activities). There was a clear focus on health as an asset or resource for meaningful living [23, 24]. The inhabitants barely mentioned unhealthy lifestyles, e.g. obesity and smoking, which are the focus of professionals and of the data in monitor and health surveys. These qualitative data were supplemented with quantitative data from health monitors  and the local citizens’ survey . The discrepancy in perceptions on health and wellbeing between inhabitants and professionals emphasizes the need to include citizens’ perceptions in health promotion activities [19, 20, 27].
The Voorstad inhabitants’ viewpoints are the starting point for VoM, thereby giving the inhabitants ownership to address health in a positive way, focusing on assets and resources . This means that activities in the program are not chosen or planned beforehand, but rather developed and implemented as a result of questions and needs expressed by Voorstad inhabitants. Citizens’ active involvement and responsibility for activities strengthen their health literacy and empowerment [28,29,30]. Citizen participation, including defining ‘health’, developing, implementing, and evaluating activities with and by the citizens [31, 32], is one of the action principles in VoM.
Another important finding of the preparatory study was the presence of a comprehensive infrastructure of public, welfare, social support, sports and care organizations, community centers, and (informal) networks and alliances in which both professionals and inhabitants collaborate . Intersectoral collaboration [33,34,35,36] between primary care, social services, and environmental, policy, and public health workers is therefore a second action principle of the program. VoM joins and uses the existing social infrastructure to add the broader view on health and bring in knowledge to make health promotion activities possible.
Both inhabitants and professionals mentioned barriers that hinder healthy living and keep them from changing behavior, such as accessibility of sports facilities and prices of healthy foods, as well as social norms, attitudes, and habits. This indicates the third action principle of VoM: creating a supportive social and physical environment for health [37,38,39].These action principles can be defined as actions, processes, or mechanisms that help establish the effect or impacts of a health promotion program [40,41,42]. The premise of principles for action is that they contribute to health through multiple pathways and serve multiple purposes, such as program effectiveness, the creation of supportive environments for health, and empowerment of all stakeholders, both professionals and citizens [32, 43].
In July 2016, two health brokers started to support these action principles by facilitating citizens’ participation in developing and implementing activities that fit citizens’ needs and build healthy alliances. Recent studies show that the broker role is essential in facilitating intersectoral collaboration and exchanging knowledge between stakeholders [44,45,46].
The aim of the VoM program is to improve the perceived health of the Voorstad inhabitants, mostly low SES families, and achieve changes in the social and physical environment that support health and healthy behavior. The overall research aim is to study the impacts and action principles of VoM comprehensively on different levels. This will contribute to finding ways to reduce existing health inequities. Therefore, four interrelated research questions (RQs) have been formulated:
How do Voorstad inhabitants perceive health and health supportive environments?
What benefits do citizens who participate in the Voorstad on the Move program observe in terms of perceived health, health literacy, and empowerment?
What factors and mechanisms contribute to citizen participation and intersectoral collaboration?
What is the overall impact of the Voorstad on the Move program in terms of health promotion activities, social and physical environment, and inhabitants’ perceived health?
Because the VoM program is based on a social-ecological perspective on health, the theoretical framework consists of different theories and models that recognize the link between practice and context within social situations.
To study and understand impact on health and the environment on the one hand and the working of the action principles on the other hand, a framework to facilitate and evaluate a community health promotion program will be used [32, 47, 48]. This framework [Fig. 1] visualizes the relation between the social environment, health predicting mediators (e.g. lifestyle), and population health status (e.g. perceived health). It provides operationalizable variables that moderate the relation between the social environment and health predicting mediators. The moderating variables are the action principles in the VoM program. Citizen participation, intersectoral collaboration, and a health supportive environment are used as entry points to make the social environment of health researchable and manageable by communities.
Social practice theory (SPT) , the reasonable person model (RPM) , and the Healthy Alliances (HALL) framework  are used to understand the working of the action principles comprehensively and on different levels.
SPT integrates the individual with his or her social environment and will be used to study the mechanisms of citizen participation and health behaviors. In contemporary theories of social practice, health and wellbeing are considered to be outcomes of participation in a set of social practices, commonly created by the reality of everyday life . Following Shove et al. , a practice is defined as being constituted by meanings about how and why to do things (cultural conventions, expectations, and socially shared meanings), materials (objects, tools, and infrastructures), and competences both tacit and explicit (knowledge and embodied skills) [Fig. 2]. In this study, participation and health behaviors will be regarded as social practices rather than only individual behavior, because they fit with the community approach focusing on social change, instead of attempting to change what Shove et al.  refer to as individuals’ ABC (attitudes, behaviors, choices).
The RPM is a conceptual framework that links environmental factors with human behavior . People are more reasonable, cooperative, helpful, and satisfied when the environment supports their basic informational needs. The same environmental supports are important factors in enhancing human health. Reasonableness is used, rather than well-being, because it focuses on bringing out the best in people. Central in the RPM is the management of information, either visual or written, indicating that people are more reasonable when their informational needs are met .
The RPM consists of three domains: building mental models, meaningful action, and being effective [Fig. 3]. Mental models influence our perception of what is going on and guide our actions. Meaningful action implies that people feel listened to and respected, even if their wishes are not met. The sense that one is making a difference can go a long way towards bringing out the best in one . Being effective concerns effectiveness and reasonableness, because of mental fatigue. It is about a particular aspect of mental functioning described as directed attention, caused by the many complex and competing demands in one’s environment. The RPM framework will be used to study the way in which the physical environment can be health supportive to the inhabitants. Both SPT and RPM put great importance on the interaction between the environment and the behavior of an individual. They are complementary, as SPT focuses on the social environment and RPM on the natural (physical) environment.
Within the extended network that exists in Voorstad, intersectoral collaboration is facilitated by a small steering group of partners from the healthcare and societal sectors, with health brokers as essential participants. This group can be regarded as the healthy alliance. The updated HALL framework, will be used to study intersectoral collaboration within the healthy alliance in VoM [Fig. 4]. This framework recognizes three groups of factors – institutional factors, (inter)personal factors, and the organization of the alliance – that can either facilitate or hamper the collaboration between the partners in the alliance . The updated HALL framework visualizes the importance of context and learning culture in intersectoral collaboration .
The study will use a mixed-methods design and will combine qualitative and quantitative data. The research activities will include literature study, in-depth interviews, focus group discussions, concept and capacity mapping, document analysis, and analysis of citizens’ survey data [Table 1].
The use of multiple strategies and multiple research methods across multiple levels is assumed to be the most effective approach. The combination of information from multiple sources and methods – triangulation –increases data validity . Also, partners and citizens will be involved in the planning of the research as well as in different research activities.
A prominent strategy is action research, which aims to involve all stakeholders, capturing the different perspectives of citizens and professionals and engaging citizens with low SES. The value of action research is that it reflects the values of health promotion, such as participation and empowerment [6, 56,57,58]. It thereby facilitates the development of capacities, learning, and empowerment  and thus contributes to health . It also enables those involved to continually optimize their strategies [60,61,62], and it contributes to developing both theories and research methods to understand and explain what works and why it works.
To operationalize, and to provide insights into, factors relevant to addressing the RQs, the logic model, based on the framework for planning, implementation, and evaluation of health promotion programs , will be used [Fig. 5]. This logic model will help to make explicit the hypothesized pathways; to define processes, output, and outcome indicators at different levels (individual, professional, and community); and to unravel action elements [32, 64].
Figure 5 illustrates the logic model for the impact evaluation of VoM, based on literature on community-based approaches [6, 32, 64] and evaluation studies of complex community health promotion programs . The hypothesis is that a community-based participatory approach to developing and implementing health activities at different levels such as individuals, professionals, and community will result in improved perceived health, a health supportive environment, and sustainable local health policy, leading to a reduction in health inequities in the long term. These long-term expected outcomes will be preceded by measurable short-term outcomes like e.g. health literacy, healthy alliances, and changes in the physical environment, moderated by the action principles. In this model, citizen participation, intersectoral collaboration, and a health supportive environment are defined as program outcomes and, at the same time, are action principles in this principle-based health promotion program . The operationalization of each of the four research questions is now set out.
Research question 1. How do Voorstad inhabitants perceive health and a health supportive environment?
Perceptions on health and health supportive environments will be measured using focus groups and photovoice.
Collecting and discussing the perceptions and priorities of the inhabitants about health is the starting point for citizen participation in the VoM program. At the start of the program, focus groups will be held with 15 existing groups of inhabitants to explore perceptions and meanings about health [65, 66]. Results of the first focus group session will be fed back to, and discussed, with the same group in a second session. Participants are challenged to think of actions and plans to work on their own health. In total, about 100 inhabitants will participate in this research study.
Photovoice will be used to reveal inhabitants’ perceptions of their neighborhood as a source of health opportunities or barriers [67,68,69]. In total, 32–40 inhabitants (8–10 from each of the four neighborhoods) will be asked to tell ‘the story of the photo or image’.
Research question 2. What benefits do citizens who participate in the Voorstad on the move program observe in terms of perceived health, health literacy, and empowerment?
Active participation in health promotion activities, varying from consultation and collaboration to partnership or ownership, can either result from the focus groups or otherwise be initiated by the VoM health brokers or collaborating partners. A total of 100 inhabitants who either participate in focus groups (RQ 1) or are involved in community activities will be ‘followed’ during the program. They will be asked about their way and level of participation using Pretty’s participation ladder [34, 70], health literacy using the 9-item Health Literacy Questionnaire (HLQ) [71,72,73], and empowerment using the Netherlands Empowerment Checklist [74, 75]. Perceived health is assessed based on the question on self-perceived health: ‘How is your health in general’, which contains five answering categories; 1) very good, 2) good, 3) fair, 4) bad, and, 5) very bad. This question is part of the citizens’ survey which takes place every two years in Deventer  and of the Health Monitor conducted by the Municipal Health Services in the Netherlands [76, 77]. Subsequently, in-depth interviews and focus groups will be held to discuss citizens’ perceptions on the connection between participation, perceived health, and empowerment.
Research question 3. What factors and mechanisms contribute to citizen participation and intersectoral collaboration?
The HALL framework will be used to study the intersectoral collaboration and active involvement of stakeholders and to identify conditions that contribute to the collaboration and make these alliances successful [33, 54] [Fig. 4]. A special focus will be placed on the role of health brokers, as these seem to be crucial for connecting different sectors . The Coordinated Action Checklist  will be used to evaluate and facilitate the collaboration of the core stakeholders, members of the Voorstad social team, the neighborhood manager, health brokers, and the program coordinator. The results of the checklist on various dimensions, such as task, relations, growth, and visibility, will be discussed with this core group. These evaluation sessions will be held once a year, in total three times.
A document analysis of all the reports, plans, and notes produced by the project team will be used to describe the collaboration processes that have taken place. Furthermore, a network analysis [35, 60] will be conducted to map the collaborating organizations – community centers, schools, grassroots organizations, and neighborhood sports club – that take part in the program irregularly and on a less structured basis. Five to 10 organizations will be interviewed twice (2018 and 2020) to get insights into the impact of VoM, the collaboration processes , and the health broker role.
Research question 4. What is the overall impact of the Voorstad on the move program in terms of health promotion activities, social and physical environment, and inhabitants’ perceived health?
Results and outcomes of the program will be measured on different levels: individual, professional, and community [Fig. 5]. At the individual level, perceived health, lifestyle, and health behaviors have been or will be measured in the local citizens’ survey every two years (2015: T0; 2017: T1; 2019: T2) . Additionally, the health monitors  carried out in 2016 and 2020 will provide more detailed information on the health status of the city district, Voorstad. In both surveys, citizens’ health and lifestyle data are monitored at neighborhood level.
The program activities are monitored in a so-called activity database. The number and type of health promotion activities developed with citizens’ involvement and the number of participants per activity will be registered, thereby monitoring the program output. Citizens who participate in the program activities will be asked about their satisfaction. In order to map changes in perceptions of the social and physical environment, the photovoice study (RQ1) will be repeated in 2019.
Qualitative research data from interviews and focus group discussions will be audiotaped, transcribed, and analyzed using Atlas-ti to manage the data and guarantee transparency. A coding scheme based on theory and the framework will be developed to analyze the qualitative data stepwise, data driven, and thematically. Top-down as well as bottom-up coding will be used. The top-down coding will use predefined codes based on factors mentioned in the theoretical models: the HALL framework, SPT, and RPM. The bottom-up coding (free coding) will trace general themes that emerge in interviews and focus groups. In this way, relevant topics devised in advance of the study design and relevant topics from practice will be fully mapped. These themes will make it possible to interrelate and interpret the gathered data .
Quantitative data will be analyzed by descriptive statistics and regression analysis techniques using the SPSS program. In the analysis, quantitative data obtained to measure changes in perceived health (RQ4) will be combined with qualitative data on participation, empowerment, and health literacy (RQ 2), with data at professional level – short-term outcomes realized by the healthy alliances and health brokers (RQ 3), and with data at community level – the social and the physical environment (RQ1).
The impacts on the different levels will be integrated and related to the action principles using realist synthesis  in the data analysis, facilitating the identification of the contextual factors and program mechanisms determining the outcomes (or impacts). These context–mechanism–outcome (CMO) configurations  will provide insights into the overall impacts in relation to the action principles.
Sample size and power
The perceived health of adult inhabitants in the neighborhood will be used as the primary outcome of the VoM program at the individual level. In line with common practice in presenting perceived health prevalence rates, response options for self-perceived health will be dichotomized, with the response categories ‘very good’ and ‘good’ into one ‘very good or good’ category and the other response options in a ‘less than good’ category . In 2015, the percentage of inhabitants in the city of Deventer scoring (very) good health was on average 79%, whereas this was 75% for the city district Voorstad . Therefore, the estimate of the effect size of perceived health to be obtained by implementing the VoM program was determined by the difference between Voorstad (0.75) and the city of Deventer (0.79): 0.04. The sample size calculation was conducted with G*Power version 126.96.36.199. with alpha set on 0.05, and a power of 0.80. The used test family was exact and based on the difference from a constant (0.75). The required lower critical number of participants is 542, the required sample size is 697. The response rate of Health Monitors in general is 40% . As there are differences in response rate between city districts, we assume a modest response rate of 35%. The required number of participants to obtain reliable estimates of increase in perceived health is therefore 2000. The total adult population in Voorstad is 8412 inhabitants. 2200 Inhabitants will be invited to join the online survey, in order to be sure of sufficient power.
This study will evaluate the impact of a community-based health program in a socioeconomically deprived city district in order to find keys to reducing health inequities. It is a single case study in which low SES inhabitants – in the view of health professionals usually hard to reach and not very interested in health promotion activities – are actively involved. It will provide insights into perceptions, values, and needs regarding the health of low SES groups.
The VoM program is innovative as it is different from usual health promotion programs in which health subjects and activities are set by professionals. Instead, the VoM program shifts from being a pre-devised health promotion program with a set of interventions to being an open approach with a focus on action elements. Unravelling the mechanisms of these action elements – citizen participation, intersectoral collaboration at community level, and a health supportive environment – will help to find ways to reduce health inequities. The findings will contribute to a better understanding, and will expand the knowledge, of what works for low SES groups and why it works. Other local health promotion programs can benefit from the knowledge and experiences gathered in this study.
Strengths and limitations
The study design is optimized for internal and external validity because of the combination of action research, process evaluation, and citizens’ monitoring and survey data. The principle of triangulation is continuously applied to optimize the reliability of this study, using multiple methods and multiple sources. Internal validity is enhanced by triangulation of methods and resources, whereby results will be checked with other stakeholders. In addition, other verification techniques will be used, such as expert consultation.
In this study, the inhabitants’ survey will be used to measure perceived health and health determinants in a pre-test/post-test design. The results obtained from these surveys will be linked with results from the intervention, the environment, and the organizational level in order to be able to explain why changes in perceived health have taken place or not.
The application of SPT, the HALL framework, and RPM provides the researcher with a strong theoretical framework and guarantees validation of the results gathered in this single case study. This study contributes to the knowledge on the benefits of citizen participation, being a necessary aspect of health promotion, and how to realize it. Recent studies  recommend evaluation of community participation in creating a ‘health in all policies’ knowledge base. Hence, the participatory action research in itself contributes to health literacy, is empowering for those who participate, and contributes to community building .
Health Literacy Questionnaire
Participatory Network Mapping Tool
Reasonable Person Model
Social Practice Theory
Voorstad on the Move
RIVM. Een gezonder Nederland [Towards a healthier Netherlands]. 2014. http://www.eengezondernederland.nl/Heden_en_verleden. Accessed 2 June 2017.
Whitehead M, Dahlgren G. What can be done about inequalities in health? Lancet. 1991;338:1059–63.
Marmot MG. Closing the gap in a generation. Bull World Health Organ. 2011;89:702.
Rice M, Franceschini MC. Lessons learned from the application of a participatory evaluation methodology to healthy municipalities, cities and communities initiatives in selected countries of the Americas. Promot Educ. 2007;14:68–73.
Golden SD, McLeroy KR, Green LW, Earp JAL, Lieberman LD. Upending the Social Ecological Model to Guide Health Promotion Efforts Toward Policy and Environmental Change. Heal Educ Behav. 2015;42(1_suppl):8S–14S.
Herens M, Wagemakers A, Vaandrager L, van Ophem J, Koelen MA. Evaluation design for community-based physical activity programs for socially disadvantaged groups: communities on the move. JMIR Res Protoc. 2013;2(1):e20. https://doi.org/10.2196/resprot.2327.
Storm I, van Koperen M, van der Lucht F, van Oers H, Schuit J. Monitoren en evalueren van integraal gezondheidsbeleid [monitoring and evaluation of integral health policy]. Beleidsonderzoek Online. 2014. https://doi.org/10.5553/Beleidsonderzoek.000043.
Stronks K, Arah OA, Plochg T. Learning from policy failure and failing to learn from policy. Eur J Pub Health. 2006;16:343–4.
Mackenbach JP. Has the English strategy to reduce health inequalities failed? Soc Sci Med. 2010;71:1249–53.
Borrell C, Artazcoz L, Pasarín MI, Díez E, Claes C, van Loon J, et al. Social inequalities in health and closing the gap in a generation. Eval Program Plann. 2009;30:189–94.
Bronfenbrenner U. Ecological models of human development. In: The international encyclopedia of education, vol. 3. 2nd ed. Oxford: Elsevier; 1994. p. 1643–7.
Sallis JF, Owen N, Fotheringham MJ. Behavioral epidemiology: a systematic framework to classify phases of research on health promotion and disease prevention. Ann Behav Med. 2000;22:294–8.
Stokols D. Translating social ecological theory into guidelines for community health promotion. Am J Health Promot. 1996;10:282–98.
de Jong MAJG. Projectplan Voorstad beweegt [Project plan Voorstad on the Move] 2016. https://www.fnozorgvoorkansen.nl/project/gezond-in-voorstad/. Assessed 2 Nov 2018.
Ministery of Health Welfare and Sports. Landelijke nota gezondheidsbeleid 2016-2019 [National Health Policy document 2016–2019]. Den Haag: Ministery of Health Welfare and Sports; 2015.
Gemeente Deventer. Wijkenmonitor [Neighbourhood monitor]. 2016. http://www.staatvandeventer.nl/svd/wijkenmonitor-in/4/3. Accessed 2 Nov 2018.
Sallis J, Cervero R, Ascher W, Henderson K, Kraft MK, Kerr J. An ecological approach to creating active living communities. Annu Rev Public Health. 2006;27:297–322.
Herens M, Wagemakers A, Vaandrager L, van Ophem J, Koelen MA. Contexts, mechanisms, and outcomes that matter in Dutch Community-based physical activity programs targeting socially vulnerable groups. Eval Health Prof. 2017;40:294–331.
Naaldenberg J, Vaandrager L, Koelen MA, Leeuwis C. Aging populations’ everyday life perspectives on healthy aging. J Appl Gerontol. 2012;31:711–33.
Bukman AJ, Teuscher D, Feskens EJM, van Baak MA, Meershoek A, Renes RJ. Perceptions on healthy eating, physical activity and lifestyle advice: opportunities for adapting lifestyle interventions to individuals with low socioeconomic status. BMC Public Health. 2014;14:1036. https://doi.org/10.1186/1471-2458-14-1036.
Vaandrager L, Wagemakers A, Saan H. Evidence in gezondheidsbevordering [Evidence in health promotion]. Tijdschr voor gezondheidswetenschappen. 2010;88:271–7.
de Jong MAJG, Roos G. Startfoto Gezond in Voorstad [starting picture health in Voorstad]. 2016. http://www.samengezondindeventer.nl/projecten/voorstad-beweegt/.
Antonovsky A. The salutogenic model as a theory to guide health promotion. Health Promot Int. 1996;11:11–8.
Morgan A, Ziglio E. Revitalising the evidence base for public health: an assets model. Promot Educ. 2007;14(2_suppl):17–22.
GGD IJsselland. Tabellenboek Volwassenenmonitor 2012 [Book of tables of the health survey, adult population]. https://ggdijsselland.buurtmonitor.nl//Jive/Jive?cat_open_code=c1 Accessed 12 Jun 2017.
Gemeente Deventer. Kerncijfers Voorstad [Key figures Voorstad]. 2015 www.staatvandeventer.nl. Accessed 2 Jun 2017.
den Broeder L, Chung KY, Geelen L, Scholtes M, Schuit AJ, Wagemakers A. We are all experts! Does stakeholder engagement in health impact scoping lead to consensus? A Dutch case study. Impact Assess Proj Apprais. 2016;34:294–305.
Laverack G. Using a “domains” approach to build community empowerment. Community Dev J. 2006;41:4–12.
Nutbeam D. The evolving concept of health literacy. Soc Sci Med. 2008;67:2072–8.
Peerson A, Saunders M. Health literacy revisited: what do we mean and why does it matter? Health Promot Int. 2009;24:285–96.
Koelen MA, van den Ban AW. Health education and health Promotion. Wageningen: Wageningen Academic Publishers; 2004.
Wagemakers A, Vaandrager L, Koelen MA, Saan H, Leeuwis C. Community health promotion: a framework to facilitate and evaluate supportive social environments for health. Eval Program Plann. 2010;33:428–35.
Koelen MA, Vaandrager L, Wagemakers A. The healthy alliances (HALL) framework: prerequisites for success. Fam Pract. 2012;29(SUPPL. 1):132–8.
Wagemakers A, Corstjens R, Koelen MA, Vaandrager L, Van ‘t Riet H, Dijkshoorn H. Participatory approaches to promote healthy lifestyles among Turkish and Moroccan women in Amsterdam. Promot Educ. 2008;15:17–23.
Storm I, den Hertog F, van Oers H, Schuit AJ. How to improve collaboration between the public health sector and other policy sectors to reduce health inequalities? – a study in sixteen municipalities in the Netherlands. Int J Equity Health. 2016;15:97.
Leenaars KEF, Smit E, Wagemakers A, Molleman GRM, Koelen MA. Facilitators and barriers in the collaboration between the primary care and the sport sector in order to promote physical activity: a systematic literature review. Prev Med. 2015;81:460–78.
Schulz A, Northridge ME. Social determinants of health: implications for environmental health promotion. Health Educ Behav. 2004;31:455–71.
Foster C, Hillsdon M. Changing the environment to promote health-enhancing physical activity. J Sports Sci. 2004;22:755–69.
Golden SD, Earp JAL. Social ecological approaches to individuals and their contexts. Heal Educ Behav. 2012;39:364–72.
Herens M, Wagemakers A, Vaandrager L, Koelen MA. Exploring participant appreciation of group-based principles for action in community-based physical activity programs for socially vulnerable groups in the Netherlands. BMC Public Health. 2015;15:1173. https://doi.org/10.1186/s12889-015-2515-6.
Gregg J, O’Hara L. Values and principles evident in current health promotion practice. Heal Promot J Aust. 2007;18:7–11.
Wartna J, Vaandrager L, Wagemakers A, Koelen MA. “Er is geen enkel werkzaam Principe dat altijd werkt” Een eerste verkenning van het begrip werkzame principes [there is not a single effective principle that always works. An initial exploration of the term effective principles]. Wageningen: Health & Society, Wageningen University & Research; 2012.
Koelen MA, Vaandrager L, Wagemakers A. What is needed for coordinated action for health? Fam Pract. 2008;25(Suppl 1):i25–31.
Harting J, Kunst AE, Kwan A, Stronks K. A “health broker” role as a catalyst of change to promote health: an experiment in deprived Dutch neighbourhoods. Health Promot Int. 2011;26:65–81.
Leenaars KEF, Florisson AME, Smit E, Wagemakers A, Molleman GRM, Koelen MA. The connection between the primary care and the physical activity sector: professionals’ perceptions. BMC Public Health. 2016;16:1001. https://doi.org/10.1186/s12889-016-3665-x.
van Rinsum CE, Gerards SMPL, Rutten GM, van de Goor IAM, Kremers SPJ. Health brokers: how can they help Deal with the wickedness of public health problems? Biomed Res Int. 2017. https://doi.org/10.1155/2017/1979153.
Wagemakers A. Community Health Promotion. Facilitating and evaluating coordinated action to create supportive social environments. Wageningen: Wageningen University; 2010.
Wagemakers A, Koelen MA, Lezwijn J, Vaandrager L. Coordinated action checklist: a tool for partnerships to facilitate and evaluate community health promotion. Glob Health Promot. 2010;17:17–28. https://doi.org/10.1177/1757975910375166.
Maller CJ. Understanding health through social practices: performance and materiality in everyday life. Sociol Health Illn. 2015;37:52–66.
Kaplan S, Kaplan R. Health, supportive environments, and the reasonable person model. Am J Public Health. 2003;93:148–1489.
Shove E, Pantzar M, Watson M. The Dynamics of Social Practice: Everyday Life and How it Changes: SAGE publications; 2012. https://doi.org/10.4135/9781446250655.
Kaplan R, Kaplan S. Well-being, reasonableness, and the natural environment. Appl Psychol Heal Well-Being. 2011;3:304–21.
Basu A, Kaplan R. The reasonable person model (RPM): introducing the framework and the chapters. In: Fostering reasonableness: supportive environments bringing out our best. Ann Arbor: Maize Books; 2015. p. 1–27.
van Tol M, Wagemakers A, Koelen MA. Succesvol samenwerken is leren [Collaborating succesfully is a learning process]. Tijdschr voor gezondheidswetenschappen. 2017;95:24–9. https://doi.org/10.1007/s12508-017-0003-3.
Koelen MA, Vaandrager L, Colomér C. Health promotion research: dilemmas and challenges. J Epidemiol Community Health. 2001;55:257–62.
Baum F. Participatory action research. J Epidemiol Community Heal. 2006;60:854–7.
Koch T, Kralik D, van Loon A, Mann S. Participatory action research in health care. Malden: Blackwell Publishing; 2009.
Hughes I. Action research in healthcare. In: The SAGE handbook of action research: participatory inquiry and practice. 2nd ed. Thousand Oaks: Sage Publications Ltd; 2008. p. 381–93.
Huber M, van Vliet M, Giezenberg M, Winkens B, Heerkens Y, Dagnelie PC, et al. Towards a ‘patient-centred ’ operationalisation of the new dynamic concept of health : a mixed methods study. BMJ Open. 2016;6:1–12. https://doi.org/10.1136/bmjopen-2015-010091.
Wijenberg E, Wagemakers A, Herens M, den Hartog F, Koelen MA. The value of the participatory network mapping tool to facilitate and evaluate coordinated action in health promotion networks: two Dutch case studies. Glob Health Promot. 2017. https://doi.org/10.1177/1757975917716923.
Laverack G, Keshavarz MN. What remains for the future: Strengthening community actions to become an integral part of health promotion practice. Health Promot Int. 2011;26(SUPPL. 2):ii258–62.
Glanz K, Rimer BK, Viswanath K. Health behaviour and health education: theory, research and practice. San Francisco: Jossey-Bass; 2008. p. 49–54. https://doi.org/10.1016/S0033-3506(49)81524-1.
Saan H, de Haes W. Gezond effect bevorderen. Het organiseren van effectieve gezondheidsbevordering [to promote healthy effects. Organising effective health promotion]. NIGZ: Woerden; 2005.
van Koperen TM, Jebb SA, Summerbell CD, Visscher TLS, Romon M, Borys JM, et al. Characterizing the EPODE logic model: unravelling the past and informing the future. Obes Rev. 2013;14:162–70.
Ruff CC, Alexander IM, McKie C. The use of focus group methodology in health disparities research. Nurs Outlook. 2005;53:134–40.
Dahlin Ivanoff S, Hultberg J. Understanding the multiple realities of everyday life: basic assumptions in focus-group methodology. Scand J Occup Ther. 2006;13:125–32.
Wang C. Photovoice as a participatory health promotion strategy. Glob Health Promot. 2007;2:68–73.
Nykiforuk CIJ, Vallianatos H, Nieuwendyk LM. Photovoice as a method for revealing Community perceptions of the built and social environment. Glob Health Promot. 2007;2:68–73.
Belon AP, Nieuwendyk LM, Valliannatos H, Nykiforuk CIJ. Perceived community environmental influences on eating behaviors: a Photovoice analysis. Glob Health Promot. 2007;2:68–73.
Draper AK, Hewitt G, Rifkin S. Chasing the dragon: developing indicators for the assessment of community participation in health programmes. Soc Sci Med. 2010;71:1102–9.
Sørensen K, van den Broucke S, Pelikan JM, Fullam J, Doyle G, Slonska Z, et al. Measuring health literacy in populations: illuminating the design and development process of the European health literacy survey questionnaire (HLS-EU-Q). BMC Public Health. 2013;13:948. https://doi.org/10.1186/1471-2458-13-948.
Maindal HT, Kayser L, Norgaard O, Bo A, Elsworth GR, Osborne RH. Cultural adaptation and validation of the health literacy questionnaire (HLQ): robust nine-dimension Danish language confirmatory factor model. Springerplus. 2016;5:1232. https://doi.org/10.1186/s40064-016-2887-9.
Fransen MP, van Schaik TM, Twickler TB, Essink-Bot ML. Applicability of internationally available health literacy measures in the Netherlands. J Health Commun. 2011;16(SUPPL. 3):134–49.
Laverack G. Improving health outcomes through Community empowerment: a review of the literature. J Health Popul Nutr. 2006;24:113–20.
van Hooijdonk C, van Lenthe F, Rentema M. Empowerment door van klacht naar kracht [Empowerment ‘from complaint to strength’]. Rotterdam: Afdeling Maatschappelijke Gezondheidszorg, Erasmus MC; 2010.
GGD IJsselland. Gezondheidsmonitor Volwassenen en ouderen [Health survey adult and elderly population]. https://ggdijsselland.buurtmonitor.nl//jive/report?openinputs=true&id=tabdevvolwoud2016 Accessed 12 Jun 2017.
RIVM. Ervaren Gezondheid meten [Measuring perceived health]. https://www.volksgezondheidenzorg.info/onderwerp/ervaren-gezondheid. Accessed 2 Nov 2018.
Leenaars KEF, Smit E, Wagemakers A, Molleman GRM, Koelen MA. Exploring the impact of the care sport connector in the Netherlands. BMC Public Health. 2017;17:813. https://doi.org/10.1186/s12889-017-4830-6.
van Tol M, Wagemakers A, Heinrich J, Koelen MA. Evaluatieonderzoek naar duurzame samenwerking binnen het project Gezond Ouder Worden [evaluation of sustainable collaboration within the healthy aging project]. GGD Noord- en Oost Gelderland: Apeldoorn; 2015.
Creswell J, Clark V. Designing and conducting mixed-methods research. 2nd ed. Thousand Oaks: Sage; 2011.
Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist synthesis - an introduction. ESRC Res Methods Program. 2004:1–46. https://doi.org/10.1186/1748-5908-7-33.
Croezen S, Burdorf A, Van Lenthe FJ. Self-perceived health in older Europeans: does the choice of survey matter? Eur J Pub Health. 2016;26:686–92. https://doi.org/10.1093/eurpub/ckw017.
CBS. Gezondheidsmonitor 2016 [Health Monitor 2016]. https://www.cbs.nl/nl-nl/onze-diensten/methoden/onderzoeksomschrijvingen/korte-onderzoeksbeschrijvingen/gezondheidsmonitor-2016 Accessed 2 Nov 2018.
den Broeder L, Devilee J, van Oers H, Schuit JA, Wagemakers A. Citizen science for public health. Health Promot Int. 2016:1–10. https://doi.org/10.1093/heapro/daw086.
Council for International Organizations of Medical Sciences (CIOMS). International Ethical Guidelines for Health-Related Research Involving Humans. Geneva: Council for International Organizations of Medical Sciences; 2016.
We are grateful to the project team and citizens in Voorstad who support this project.
The VoM program and evaluation study is funded by FNO (Fund NutsOhra) as part of the program ‘Healthy Future Nearby’. FNO a Dutch non-governmental organization (NGO). Project no. 101550. The study protocol to evaluate the VoM program was submitted, reviewed and approved by the Wageningen School of Social Sciences (WASS), the Netherlands.
Availability of data and materials
Ethics approval and consent to participate
The study will be conducted in accordance with the general ethical guidelines published by the Council for International Organizations of Medical Sciences  (www.cioms.ch), which include guidelines for vulnerable groups. This study consists of different sub-studies focusing on different groups within the community. Recruitment of participants will take place in collaboration with the members of the VoM project team, all being professionals working in this area and familiar with the citizens. The researchers will inform citizens and other stakeholders verbally and written about the purpose and contents of the study and research activities. Prior to each research activity, a guarantee of confidentiality and anonymity will be given by the researchers. Participant will be given the chance to ask questions. All participants will be asked to provide written informed consent. The data will be presented on an aggregated level, without any possibility of identifying individuals. The term ‘low SES’ will not be used in the study or in any of the other research activities with citizens.
The study protocol has been reviewed by the Social Sciences Ethics Committee of Wageningen University. The Committee does not have any objections to the overall research idea and approves the outline of the study. In line with the recommendation of the Committee the researchers have submitted applications for ethical approval for two sub-studies, which have been approved by the Committee.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
de Jong, M.A.J.G., Wagemakers, A. & Koelen, M.A. Study protocol: evaluation of a community health promotion program in a socioeconomically deprived city district in the Netherlands using mixed methods and guided by action research. BMC Public Health 19, 72 (2019). https://doi.org/10.1186/s12889-019-6389-x
- Community health promotion
- Citizen participation
- Intersectoral collaboration
- Health supportive environments
- Action research