Skip to main content

Improving the health of workers with a low socioeconomic position: Intervention Mapping as a useful method for adaptation of the Participatory Approach

Abstract

Background

Workers with a low socioeconomic position (SEP) have a higher risk for health problems and premature dropout from the workforce. Unfavorable working conditions and unhealthy behaviors are more prevalent among this group of workers. The Participatory Approach (PA), is an evidence-based method to identify and solve problems at the workplace related to health issues of the worker. Health problems among workers with a low SEP are usually caused by an interplay of problems in and outside the workplace. To solve health problems on multiple life domains for workers with a low SEP we aim to adapt this approach to a broader perspective.

Methods

An Intervention Mapping (IM) protocol was used to adapt the PA. First, a needs assessment was conducted combining literature with data from interviews and focus groups with workers with a low SEP, employers and occupational health professionals (OHPs). Based on the needs assessment a program goal and performance and change objectives were defined, which resulted in methods and practical strategies to solve problems on multiple life domains. Based on the results of these steps, the PA was adapted and an implementation and evaluation plan were developed.

Results

The needs assessment confirmed that an interplay of problems on multiple life domains affect work functioning and health of workers with a low SEP. Moreover, they perceived difficulties with solving problems or used passive or avoidant coping styles towards these problems. The program goal is to identify and solve problems on multiple life domains that affect healthy functioning at work. To achieve this workers need support from OHPs to solve problems. The PA protocol and materials were adapted using theoretical concepts of the Self-Determination Theory (SDT), which resulted in the Grip on Health intervention. For OHPs a training was developed on how to implement this intervention in practice. The intervention will be evaluated in a pilot implementation study among workers with a low SEP and other relevant stakeholders.

Conclusions

IM was a valuable tool for the adaptation of the PA to better support workers with a low SEP to improve their work functioning and health from a broader perspective.

Peer Review reports

Background

Socioeconomic health inequalities are a major societal problem. Workers with a low socioeconomic position (SEP) have a higher risk for health deterioration and premature mortality [1,2,3]. Therefore, morbidity and mortality rates are generally higher than among workers with a high SEP [4, 5]. Workers with a low SEP may also be more prone to health problems, because unfavorable physical and psychosocial working conditions and unhealthy behaviors are more prevalent among this group of workers [6, 7]. Unfavorable working conditions and unhealthy behaviors are linked to poor health outcomes, which increases the risk for a disability and premature dropout from the labor market [8,9,10]. Hence, workers with a low SEP are more likely to be unemployed or stop working due to a disability, as compared to workers with a high SEP. Furthermore, dropout from work is likely to lead to further deterioration of health [11]. To prevent work disability among workers with a low SEP it is important to improve work functioning and health of workers with a low SEP which can be achieved by a workplace intervention.

In the past decades there has been a growing awareness for interventions at the workplace that aim to solve health risks at the workplace through involvement of relevant stakeholders. One of these interventions is the Participatory Approach (PA). The effectiveness of the PA has been extensively investigated and these studies have shown that the PA had a positive impact on physical and mental health outcomes and return to work (RTW) [12, 13]. The PA consists of a stepwise process to identify and solve problems at the workplace in a participatory way [14]. This process is guided by an independent occupational health professional (OHP), wherein equivalent and active input of the worker, supervisor and other relevant stakeholders at the workplace is required and together they reach consensus on the most important problems and solutions [15]. Stakeholder involvement may lead to a higher acceptance and implementation of solutions [16, 17]. Moreover, participation of stakeholders may also lead to a better adherence to solutions, which increases the chance that solutions are sustained over time [13]. Gradually the PA has been increasingly implemented in occupational health practice. Herein, the PA originally had an organizational preventive approach and was later on adapted to an individual (RTW) approach [15, 18].

Although the PA is a promising method to reduce health risks at the workplace, this approach solely focuses on problems at the workplace and does not take into account that problems outside the workplace may also interfere with work functioning and health. Workers with a low SEP often face problems on multiple life domains [19], e.g. next to musculoskeletal problems experienced at the workplace, they could also have psychosocial problems or poor housing conditions. According to the new concept of health ‘The Positive Health approach’ the lack of ability to adapt and self-manage physical, emotional and social challenges of life could all be considered as health problems [20]. In this approach health is more than the absence of disease, as one’s health status can be determined by multiple life domains. So, to improve work functioning and health of workers with a low SEP more effectively, the PA might extend its focus to identify and solve problems both in and outside the workplace. Therefore, the aim of this study is to adapt the PA to improve work functioning and health of workers with a low SEP from a broader perspective.

Methods

This paper describes the process of adaptation of the PA (Fig. 1), guided by the six steps of an Intervention Mapping (IM) protocol for development, implementation and evaluation of theory and evidence-based health promotion interventions [21]. IM is not rigid, it is an iterative process which makes it possible to move back and forth between steps, and each step is based on previous steps. Moreover, IM stimulates involvement of stakeholders during the entire process to tailor interventions to the needs and wishes of these stakeholders. The Medical Ethics Review Committee of the VU University Medical Center approved the study protocol and confirmed that the Medical Research Involving Human Subjects Act does not apply to this study. All participants signed informed consent before participation.

Fig. 1
figure 1

The six steps of Intervention Mapping adapted from Eldredge et al. 2016 [21]

Step 1: logic model of the problem

In the first step, a planning group was established for the whole IM process. Next, a needs assessment was conducted which combined evidence from literature with data from six semi-structured interviews with workers with a low SEP working in a steel factory and from two focus groups with OHPs (i.e. 2 occupational health experts, 1 occupational physician, 1 employability coach and 1 occupational social worker) and employers (i.e. 1 health and safety manager and 6 human resource managers). Themes that were discussed in the interviews and focus groups were: 1) the need for discussing problems on multiple life domains, 2) the content of the different steps of the PA, 3) the involvement of relevant stakeholders in and outside the workplace, 4) what type of solutions and in what way solutions can be implemented, 5) the need for a preventive intervention, 6) in what way workers with a low SEP can be reached, and 7) important preconditions for the implementation of the intervention in occupational health practice. In additional file 1, interview guides can be found for the interviews and focus groups. Interviews and focus groups were audio-recorded and transcribed verbatim. Thereafter, the transcripts were summarized and combined with evidence from literature. The needs assessment provided insight into work functioning and health problems of workers with a low SEP and behaviors and underlying determinants that may cause these problems. Furthermore, the needs assessment provided insight into environmental factors and the underlying determinants for these factors that may also cause work functioning and health problems among workers with a low SEP. This resulted in a logic model of the problem. Based on this model a program goal was formulated to improve work functioning and health of workers with a low SEP from a broader perspective.

Step 2: program outcomes and objectives – logic model of change

In the second step, behavioral and environmental outcomes were developed to achieve the program goal. Behavioral and environmental outcomes were derived from the behaviors and environmental factors that were described in the logic model of the problem. For each of these outcomes, performance objectives were specified, which describe in detail what needs to be done to accomplish the behavioral or environmental outcomes. This resulted in a logic model of change. Thereafter, theoretical concepts were selected to change the performance objectives. Theoretical concepts were based on the behavioral and environmental determinants. Next, matrices of change objectives were constructed; for each behavioral and environmental performance objective strategies linked to theoretical concepts were formulated, to describe what needs to be done to accomplish the performance objectives.

Step 3 & 4: program design and program production

In the third step, the design of the PA with a broader perspective on health was developed consisting of theory and evidence-based change methods to influence the change objectives for the behavioral and environmental outcomes in step 2. Next, practical strategies were identified to deliver the change methods. In the fourth step, the program structure and organization of the PA with a broader perspective were described in an intervention program, training and materials. All gathered information from the previous steps was synthesized and translated to adapt the PA.

Step 5 & 6: program implementation and evaluation plan

In the fifth step, a plan for the implementation of the adapted PA was developed. In the implementation plan potential users of the PA were specified. Next, program outcomes, performance objectives and practical strategies were developed for the users to enable optimal delivery. In the sixth and final step of the IM process, an evaluation design was chosen and a plan for the evaluation of the PA was developed to investigate the implementation of the adapted PA in practice.

Results

Step 1: logic model of the problem

Planning group

The planning group consisted of 3 health scientists (RS, AB, CB), 2 occupational health physicians (FS, JA) and 1 ergonomist (MH). This multidisciplinary planning group was established to adapt the PA for workers with a low SEP. Furthermore, throughout the IM process relevant stakeholders at the workplace were consulted, namely workers with a low SEP, OHPs and employers.

Needs assessment

Health problems among workers with a low SEP

Literature on the perception of health among workers with a low SEP showed that health has been described as a multidimensional concept [22, 23]. This is in line with the ‘Positive Health approach’, which defines health as the ability to adapt and self-manage, in the light of physical, emotional and social challenges of life [20]. In this approach health is a dynamic phenomenon that should be seen as an integral part of life, rather than something that is only considered when illness occurs. Research shows that this concept is highly appreciated, as it addresses people as more than just their illness, and people themselves can decide what is important to them [24]. According to this concept, health consists of multiple domains (e.g. bodily and mental functions, social and societal participation) and these domains were also recognized by workers with a low SEP [23].

Workers with a low SEP often face problems on multiple life domains [19], which could interfere with work functioning and health. In the interviews, workers with a low SEP recognized that not only health complaints are related to problems at work, but that problems in other life domains also interfere. Workers with a low SEP also mentioned that problems at work are often caused by underlying problems in other life domains that are not always identified by OHPs. OHPs and employers acknowledged in the focus groups that problems outside the workplace are relevant to discuss in occupational health practice and are often not identified. The time and energy that workers need for problems outside the workplace could negatively affect their work functioning [19]. Moreover, short term social or economic problems may hinder workers with a low SEP to improve their health on the longer term [19, 25]. For example, adherence to lifestyle interventions is often only feasible when short term problems in daily life are resolved [26, 27].

Main determinants for health problems among workers with a low SEP

Workers with a low SEP have a larger risk for health problems for three different reasons. First, unfavorable work-related determinants, including both physical and psychosocial factors. Physical factors prevalent among workers with a low SEP are biomechanical, chemical and biological exposures which increases the risk for physical health problems [6, 28, 29]. Workers with a low SEP also often have jobs that include repetitive work, heavy lifting and with poorer working arrangements, such as shift work [6, 30]. Psychosocial factors prevalent among workers with a low SEP are low job control, high job insecurity and low levels of social support [6, 28, 29, 31], which may result in a lower psychological wellbeing and an increased risk for mental health problems [32].

Second, unfavorable non-work-related determinants are more prevalent among workers with a low SEP. Workers with a low SEP more often have unhealthy lifestyle behaviors, such as smoking, physical inactivity, heavy drinking and unhealthy dietary patterns [19, 28, 33]. In addition, workers with a low SEP generally have limited financial resources, and these limited resources could hinder them to live healthy [25, 33]. Healthy behaviors are often more costly than unhealthy behaviors. For example, healthy food is often more expensive than unhealthy food [34]. Moreover, workers with a low SEP have more limited social networks than people with a higher SEP [23]. Social networks can provide resources, such as support or knowledge in enabling healthy behaviors [33]. Access to resources through social networks refers to the concept of ‘Social Capital’ [35]. Moreover, social capital may also be a work-related determinant, consisting of support from for example, the supervisor. People with a low SEP generally have lower levels of social capital which limits their access to obtain and use diverse resources [36]. This may lead to poorer health outcomes among people with a low SEP, as compared to people with a high SEP [35,36,37]. Hence, increasing social capital could be more important among workers with a low SEP than among workers with a high SEP, and the workplace could provide an opportunity to increase this.

Work and non-work-related determinants may also result in work-family conflicts, wherein family demands (i.e. non-work-related determinants) interfere with work life, and vice versa. Unfavorable work-related determinants such as shift work or less flexible work could negatively affect the family life [38]. Inversely, unfavorable non-work-related determinants, such as an unhealthy lifestyle could negatively affect the working life [39]. Work-family conflicts are associated with a higher sickness absence [40, 41] and poorer health outcomes [41, 42]. Especially among workers with a low SEP, work-family conflicts seem to have a more negative effect on health, compared to workers with a high SEP [43]. Hence, workers with a low SEP are simultaneously exposed to a variety of unfavorable determinants [6, 44]. Interventions that focus only on work-related determinants ignore the interconnections between these determinants and are less likely to be effective [44].

Third, poor health literacy to adapt these work and non-work-related determinants. Workers with a low SEP tend to have poor health literacy, which means that they have less cognitive and social skills which determine the motivation and ability of individuals to gain access to, understand and use information in ways that promote and maintain good health [33, 45]. As a result, workers with a low SEP may find it difficult to self-manage and adapt unfavorable circumstances in or outside the workplace, which could be caused by a lack of motivation or self-efficacy for their ability to adapt unfavorable circumstances [46]. Moreover, poor health literacy could also result from a lack of awareness and a lower risk perception of health problems. Workers with a low SEP hardly think about their own sustainable employability [19], which was also recognized in the interviews. Workers with a low SEP mentioned that it was difficult to be aware of a problem and to act on it. Especially when they were able to work they may not recognize the value or importance of changing unfavorable determinants for work functioning and health. Poor health literacy may lead to passive or avoidant coping styles towards health problems. Research shows that people with a higher SEP show a more active attitude towards their health status, whereas people with a low SEP focus more on acceptance instead of facing the challenges [22]. This could also be enhanced by the more difficult circumstances workers with a low SEP may face due to problems on multiple life domains. It may be harder for workers with a low SEP to act on these circumstances, making it easier to accept them. As a result, workers with a low SEP may be too late in addressing health problems, which could increase the risk for premature dropout from the labor market [47].

Only improving the ability of workers with a low SEP to self-manage and adapt health problems is not enough, this group of workers also need a supportive environment on how to perform the desired behavior. For example, a study among truck drivers showed that those who were motivated to change their lifestyle did not succeed, as they didn’t know how to overcome the obstacles in their work and private life [48]. For that reason, workers with a low SEP need support in tackling these problems, such as making an action plan, that includes information on how and when the behavior can be performed and thinking about strategies on how to overcome potential obstacles [49]. Moreover, workers with a low SEP also need a supportive environment as they have a lower control (i.e. autonomy) over decisions in and outside the workplace. Workers with a low SEP have, compared to workers with a high SEP, a lower decision latitude which is a predictor for health problems at the workplace [6]. Outside the workplace workers with a low SEP experience a lower control over decisions in their day-to-day lives, due to a lack of resources needed for health and wellbeing [25, 50]. Finally, supportive environments are associated with a decrease in work-family conflicts and an increase in social capital [35, 51, 52]. This could be relevant for workers with a low SEP, as they experience more negative health effects of work-family conflicts and have lower levels of social capital [36, 43]. So, to effectively self-manage and adapt problems on multiple life domains, relevant stakeholders (e.g. supervisor or partner) need to be involved in the decision-making process of solving problems. OHPs could play an important role in this process by bringing together the worker and relevant stakeholders.

A supportive environment can consist of an OHP who supports the worker in solving problems on multiple life domains. However, occupational health practice is mainly focused on healthy functioning at the workplace [53]. As a result, OHPs may insufficiently consider problems on other life domains than work or may lack competencies on how to support workers with a low SEP in solving problems on other life domains than work. Therefore, occupational health care should provide more attention to the interplay of problems in and outside the workplace and how this could affect work functioning and health of workers with a low SEP. Furthermore, preventive interventions wherein OHPs provide early support to workers with a low SEP could be difficult. OHPs are not always easily reached in organizations; they could be seen as someone who works for the employer (i.e. lack of trust) and workers could be unfamiliar with the preventive role of OHPs [54]. Finally, as was mentioned above, workers with a low SEP have a lower awareness and risk perception of health problems. As a result, workers with a low SEP do not easily ask for help from an OHP. For that reason, OHPs need to create a safe environment for workers with a low SEP and improve their familiarity among workers at the workplace.

Logic model of the problem

To improve the health of workers with a low SEP from a broader perspective the PA should focus on identifying both work and non-work-related health problems, and also consider the interplay between these problems. Therefore, the program goal of the PA is to solve problems on multiple life domains that affect work functioning. This could result in healthy functioning at the workplace, sustainable employability and the prevention of work disability among workers with a low SEP. To achieve this, the logic model of the problem (Fig. 2) describes behavioral and environmental determinants that need to be considered in the PA. Behavioral determinants for workers with a low SEP are motivation, self-efficacy, awareness, risk perception and control for solving health problems on multiple life domains. Environmental determinants are competencies (knowledge and skills) for OHPs to support workers with a low SEP in solving health problems with relevant stakeholders, trust and familiarity of OHPs among workers with a low SEP and more attention for healthy functioning outside the workplace in occupational health care.

Fig. 2
figure 2

Logic model of the problem

Step 2: logic model of change

Performance objectives

The behavioral outcome related to goal of the PA is that workers with a low SEP are able to actively solve problems on multiple life domains that affect healthy functioning at work. The performance objectives associated with the behavioral outcome of workers with a low SEP are listed in Table 1. OHPs are the environmental agents at the workplace who can support workers with a low SEP. The environmental outcome related to the goal of the PA is that OHPs support workers with a low SEP in actively solving problems on multiple life domains that affect healthy functioning at work. The performance objectives associated with the environmental outcome are listed in Table 2. In additional file 2, the logic model of change can be found, which summarizes the behavioral and environmental determinants, performance objectives and outcomes.

Table 1 Performance objectives for the behavioral outcome
Table 2 Performance objectives for the environmental outcome

Selection of theoretical concepts and change objectives

To enable workers with a low SEP to actively identify, prioritize and solve problems in and/or outside the workplace the theoretical concepts of the Self-Determination Theory (SDT) were selected; autonomy, competence and relatedness. This theory argues that by increasing autonomy, competence and relatedness health related behaviors are more likely to be initiated and maintained (i.e. motivation) [55], and thereby may also positively influence the attitude of workers with a low SEP towards solving health problems (i.e. awareness and risk perception) [56]. The behavioral determinants control and self-efficacy described in the logic model of the problem match well with the determinants autonomy and competence. Furthermore, the key elements of the PA; involvement of relevant stakeholders and a consensus-based process match well with the determinants autonomy and relatedness. In additional file 3, matrices of change objectives can be found for the behavioral outcome to identify what workers with a low SEP may need to learn or change to achieve the performance objectives. For the environmental agents the theoretical concepts competence and attitude were selected. For OHPs to support workers with a low SEP, it is important that they feel competent, create a safe environment and have a positive attitude towards solving problems both in and outside the workplace. In additional file 4, matrices of change objectives can be found for the environmental outcome to identify what OHPs need to learn or change to achieve the performance objectives.

Step 3: program design

Theory and evidence-based change methods and practical strategies were formulated in Tables 3 and 4 for the selected determinants of the behavioral and environmental outcome. The already existing protocol of the PA was used as a starting point for the delivery of practical strategies. This PA protocol exists of different steps that are considered logical and provide a structured way of understanding what problems and solutions are considered most relevant [58]. In applying the PA, a process leader is essential. OHPs are suitable for this role as they have communication skills, are independent, confidential and are used to guide workers with work-related problems. Furthermore, in the already existing protocol of the PA, the supervisor is often a relevant stakeholder for problems that are identified at the workplace [14]. The worker and supervisor can together decide on the most important problems and solutions, which will give a higher chance of solutions being implemented at the workplace. If problems are identified outside the workplace relevant stakeholders can vary, for example spouse, family members, friends or (health) professionals (e.g. general practitioner or job coach from the municipality). They can provide another perspective on the most important problems and solutions or can provide support in the implementation of solutions outside the workplace. The PA protocol, training and material need to be adapted to fit the goal of discussing and solving health problems both in and outside the workplace that may affect work functioning, and are presented in step 4: program production.

Table 3 Theoretical methods and practical strategies for selected determinants of the behavioral outcome
Table 4 Theoretical methods and practical strategies for selected determinants of the environmental outcome

Step 4: program production

The existing protocol and material of the PA were adapted to match the broadened perspective of the PA (see Table 5). This resulted in an intervention that was named “Grip on Health”. The original PA materials were considered too complex (i.e. focus is put on the cognitive skills) for workers with a low SEP and too time consuming, also for the OHP [59]. As a result, there was a need to develop materials with more visual aspects that were less time consuming. In collaboration with a designer new material was developed that was tailored to the needs and wishes of workers with a low SEP and OHPs. The new material was pretested through interviews and focus groups among workers with a low SEP, OHPs and employers. Workers with a low SEP, as well as OHPs and employers, were positive towards the new material, considered the material useful to discuss problems in and outside the workplace and found that the material provided a structured way to identify problems and solutions. Pretesting the material also provided input for improvements in the material and practical requirements for working with the material in occupational health practice.

Table 5 The protocol of the Grip on Health intervention

The training for OHPs was also adapted into a training for the Grip on Health intervention. The training will provide OHPs with information on 1) the variety of health problems among workers with a low SEP, 2) the Positive Health approach, 3) the PA and its key elements, 3) how to apply the Grip on Health intervention in practice, 4) how to act as a process leader and 5) how and when to involve relevant stakeholders in and outside the workplace. Information on the Grip on Health intervention will be alternated with role plays, giving OHPs the opportunity to practice certain steps of the intervention with the material and their role as process leader. The training will be given by two members of the planning group. At the end of the training, participating OHPs will receive a practical manual on how to apply the Grip on Health intervention, a presentation of the training and the materials of the intervention. Moreover, OHPs get a practical assignment, wherein they are asked to apply the intervention in occupational health practice among 3–5 workers with a low SEP. OHPs are advised to complete the steps of the intervention within 3 to 4 four different conversations within a time frame of 3 months. A couple of months after the training a follow up meeting will be planned in which OHPs will share their experiences with the practical assignment, reflect on the different steps of the intervention and on their role as process leader.

Step 5: implementation plan

The experiences with the Grip on Health intervention in occupational health practice will be assessed in a pilot implementation study. We will invite approximately 20 OHPs for the Grip on Health training, and we will ask them to apply the intervention in their occupational health practice. Two important requirements were identified in the interviews and focus groups for optimal delivery of the intervention by the OHP. First, a confidential and safe environment are important preconditions for discussing problems at the workplace. OHPs that will be invited for the training need to have full confidentiality as problems from other life domains may also be discussed. In the Dutch context, OHPs need to be either physicians or nurses, or professionals who work under legal supervision of an occupational health physician. Furthermore, the OHP must also create a safe environment, as workers with a low SEP mentioned in the interviews that certain problems are difficult to discuss (e.g. problems outside the workplace) when they are not feeling safe. Second, the intervention cannot be applied in all situations or to all kinds of health problems. In the protocol of the PA it is stated that the PA is not suitable for a worker with a juridical conflict at work with for example the supervisor or for workers with serious medical conditions – e.g. severe mental disorders [14]. Moreover, OHPs and employers mentioned in the focus groups that not every non-work-related problem can be solved in the PA (e.g. financial problems) and that it may sometimes be better to refer a worker to a (health) professional from outside the workplace.

The trained OHPs will apply the intervention in an organization among workers with a low SEP. Therefore, the employers of the organization in which OHPs will apply the intervention are a relevant stakeholder for optimal delivery of the intervention. The employers need to allow and support the implementation of the Grip on Health intervention in their organization. As the needs assessment showed that workers with a low SEP do not easily ask for help from an OHP, employers and supervisors also need to make their workers with a low SEP aware of this intervention by referring a worker to an OHP when they notice health problems or problems that affect work functioning. Performance objectives for these environmental agents to enable implementation are listed in Table 6. To achieve these performance objectives, the OHP needs to provide employers with information and make them aware of the added value of the Grip on Health intervention. Employers will receive information from the planning group about the intervention and the OHP is asked to discuss with the employer how and when the intervention can be implemented.

Table 6 Performance objectives for employers

Step 6: evaluation plan

To evaluate the pilot implementation of the Grip on Health intervention in occupational health practice we will use the Medical Research Council process evaluation framework [60]. In this framework the key components of a process evaluation are: measuring implementation (i.e. what is implemented and how?), mechanism of impact (how does the delivered intervention produce change?) and context (i.e. how does context affect implementation and outcomes). Implementation of interventions at the workplace may be difficult as it is dependent on how occupational health care is organized in an organization and on a variety of stakeholders, such as employers and supervisors. This in turn, emphasizes the need for conducting a more comprehensive process evaluation of the Grip on Health intervention with different methods (i.e. both qualitative and quantitative) and from different levels (i.e. workers with a low SEP, OHPs and other relevant stakeholders). The process of the implementation will be assessed by measuring the following aspects: 1) reach, 2) recruitment, 3) fidelity, 4) dose delivered, 5) dose received and 6) quality of delivery. The mechanisms of impact will be assessed by measuring 1) participant responsiveness (i.e. perceived satisfaction, effectiveness and relevance), and 2) perceived differentiation (i.e. essential components of the intervention). The context will be assessed by measuring the facilitators and barriers related to the implementation of the intervention in occupational health practice. First, a process evaluation will be conducted, because this information is essential to determine how, for whom and under what conditions the intervention will be feasible and applicable. Thereafter, we will use this information to decide whether and how we should conduct an effect-evaluation in occupational health practice. A randomized controlled trial is an appropriate method for an effect-evaluation [61], if this is considered feasible within occupational health practice [62].

Discussion

This study describes how the PA was adapted to improve work functioning and health of workers with a low SEP from a broader perspective. Adaptation of the PA was guided by the IM protocol, which resulted in the Grip on Health intervention. In this intervention OHPs support workers with a low SEP in actively solving problems on multiple life domains that affect work functioning and thereby health. The intervention consists of a stepwise protocol to identify, prioritize and solve problems in and/or outside the workplace with the involvement of at least one relevant stakeholder. The OHP is considered the optimal professional to execute this intervention in daily practice as he or she already has an independent and confidential role in occupational health care.

Previous studies that used the IM protocol for the development of a PA intervention at the workplace focused on RTW [63, 64]. These studies based their intervention on the  Attitude Social influence Self-efficacy (ASE) model, as workers’ attitude, social influence and self-efficacy were identified as determinants for RTW. In this study the SDT was used as the needs assessment showed that workers with a low SEP may lack motivation to actively solve health problems, and according to this theory workers’ autonomy, competence and relatedness may increase their motivation for health-related behaviors [55]. This is important as workers with a low SEP use avoidant and/or passive coping styles towards health problems, which could increase the risk of further health deterioration and eventually the chance for premature dropout from the labor market. The concepts of the SDT, which are autonomy, competence and relatedness, are an essential part of the Grip on Health intervention and match well with the behavioral determinants self-efficacy and control that were described in the logic model of the problem. Moreover, participation of workers in the intervention could also increase the behavioral determinants awareness and risk perception towards health problems, which in turn may also improve the motivation of workers with a low SEP to solve these problems [65].

Implementation of the PA with a broadened perspective is beneficial for occupational health practice, as there is still too little awareness that aspects in multiple life domains may influence work functioning and it is therefore essential to take these into account to prevent work disability. This broadened perspective is also more in line with the Positive Health approach. In this approach, first a person evaluates each health domain for him or her selves, wherein the health status on each of these domains becomes visible. Then, a health professional asks the person what he or she wants to change to provide guidance in solving those problems that are really important to the person [24]. In that way, the Positive Health approach focuses on a person’s own responsibility, participation and self-management, which is also apparent in their definition of health: “Health as the ability to adapt and self-manage, in the light of physical, emotional and social challenges of life” [20]. However, one of the main points of criticism of the Positive Health approach is that not all people are equipped to manage problems themselves, especially people with a low SEP. For individuals with problems on multiple life domains an intervention wherein (health) professionals, social networks and organizations are involved is necessary to improve their health status [25]. The Grip on Health intervention tackles this point of criticism, as in the PA the OHP not only asks the worker what problems he or she wants to change but also involves relevant stakeholders and supports the worker in solving these problems.

Methodological considerations

IM was a valuable tool to adapt the PA to the needs of the target group, workers with a low SEP. However, this is not a guarantee that the intervention will be successful. There are still some methodological considerations of the intervention itself. First, workers with a low SEP may be hard to reach for OHPs. The needs assessment showed that OHPs have a lack of trust and familiarity among workers with a low SEP. Therefore, OHPs are not easily approached or accessible as an health professional who can support them in solving health problems both in and outside the workplace. Furthermore, workers visit primarily a general practitioner when they are experiencing health problems outside the workplace. Integrating occupational and general health care might be a strategy to reach more workers in occupational health care [66]. For example, general practitioners could take into account work-related problems, be more aware of the importance of work as a contributory factor of health and if needed refer a worker to an OHP.

Second, it may also be challenging to involve relevant stakeholders from outside the workplace in an intervention that is facilitated and financed by the workplace. Stakeholders from outside the workplace could be the partner or family member of the worker, but also another health professional. However, including other health professionals for a face to face discussion with the worker and the OHP may too difficult to organize in practice, but will depend per situation. For example, in the Netherlands occupational health care is strictly separated from regular health care, which could make it harder to include health professionals from outside the workplace. In this study only stakeholders from the workplace were invited to participate in the focus groups, as their needs on how to adapt the PA were considered most relevant to consider for an intervention that will be implemented at the workplace. Nevertheless, adding views of professionals from outside the workplace on how to involve them in the intervention, could further improve the implementation of the intervention. Whether it is actually feasible in practice to involve stakeholders from outside the workplace needs to be further investigated.

Third, OHPs may also experience time as a barrier to implement the intervention in occupational health practice. Following the steps of the PA is a very time-consuming process [58, 67]. Nevertheless, the elaborated process of the PA gives OHPs the opportunity to get a complete overview of the worker and gain the workers’ trust in their guidance [58]. Gain the workers trust was mentioned as an important factor in this study for discussing health problems, especially for problems from outside the workplace. In this study different OHPs, which may vary in their possibilities to implement the Grip on Health intervention, will be trained to implement the intervention. Thereby, the pilot implementation study can provide more information on which type of OHPs would be most suitable for the implementation of this intervention, how much time is needed for the implementation of the intervention and whether implementation of this intervention is feasible.

Conclusion

IM was a valuable tool for adaption of the PA to workers with a low SEP to improve their work functioning and health from a broader perspective. The IM provided information on which adaptations were needed to solve problems on multiple life domains that affect healthy functioning at work. This resulted in the Grip on Health intervention that is specifically tailored to workers with a low SEP and considers the interconnection between work and non-work-related determinants for work functioning and health. This intervention will be evaluated in a pilot implementation study to further explore whether and how this intervention fits in occupational health practice.

Availability of data and materials

The data generated and analyzed during the current study are not publicly available. The data consist of transcripts of interviews and focus groups which contain identifying information, and are therefore sensitive to privacy issues. The data are available from the corresponding author on reasonable request.

Abbreviations

ASE:

Attitude Social influence Self-efficacy

IM:

Intervention Mapping

OHP:

Occupational health professional

PA:

Participatory Approach

RTW:

Return to work

SDT:

Self-Determination Theory

SEP:

Socioeconomic Position

References

  1. Mackenbach JP, Stirbu I, Roskam A-JR, Schaap MM, Menvielle G, Leinsalu M, et al. Socioeconomic inequalities in health in 22 European countries. N Engl J Med. 2008;358(23):2468–81.

    CAS  Google Scholar 

  2. Stringhini S, Carmeli C, Jokela M, Avendaño M, Muennig P, Guida F, et al. Socioeconomic status and the 25 × 25 risk factors as determinants of premature mortality: a multicohort study and meta-analysis of 1· 7 million men and women. Lancet. 2017;389(10075):1229–37.

    PubMed  PubMed Central  Google Scholar 

  3. Hu Y, van Lenthe FJ, Borsboom GJ, Looman CW, Bopp M, Burström B, et al. Trends in socioeconomic inequalities in self-assessed health in 17 European countries between 1990 and 2010. J Epidemiol Community Health. 2016;70(7):644–52.

    PubMed  Google Scholar 

  4. Kunst AE, Leon DA, Groenhof F, Mackenbach JP. Occupational class and cause specific mortality in middle aged men in 11 European countries: comparison of population based studiesCommentary: unequal inequalities across Europe. BMJ. 1998;316(7145):1636–42.

    CAS  PubMed  PubMed Central  Google Scholar 

  5. Mackenbach JP, Kunst A, Cavelaars A, Groenhof F, Geurts J. EU working group on socio-economic inequalities in health socio-economic inequalities in morbidity and mortality in western Europe. Lancet. 1997;349(7):1655–9.

    CAS  PubMed  Google Scholar 

  6. Niedhammer I, Chastang J-F, David S, Kelleher C. The contribution of occupational factors to social inequalities in health: findings from the national French SUMER survey. Soc Sci Med. 2008;67(11):1870–81.

    PubMed  Google Scholar 

  7. Laaksonen M, Roos E, Rahkonen O, Martikainen P, Lahelma E. Influence of material and behavioural factors on occupational class differences in health. J Epidemiol Community Health. 2005;59(2):163–9.

    PubMed  PubMed Central  Google Scholar 

  8. Polvinen A, Gould R, Lahelma E, Martikainen P. Socioeconomic differences in disability retirement in Finland: the contribution of ill-health, health behaviours and working conditions. Scand J Public Health. 2013;41(5):470–8.

    PubMed  Google Scholar 

  9. Robroek SJ, Rongen A, Arts CH, Otten FW, Burdorf A, Schuring M. Educational inequalities in exit from paid employment among Dutch workers: the influence of health, lifestyle and work. PLoS One. 2015;10(8):e0134867.

    PubMed  PubMed Central  Google Scholar 

  10. Schuring M, Robroek SJ, Otten FW, Arts CH, Burdorf A. The effect of ill health and socioeconomic status on labor force exit and re-employment: a prospective study with ten years follow-up in the Netherlands. Scand J Work Environ Health. 2013;39(2):134–43.

    PubMed  Google Scholar 

  11. Dooley D, Fielding J, Levi L. Health and unemployment. Annu Rev Public Health. 1996;17(1):449–65.

    CAS  PubMed  Google Scholar 

  12. Rivilis I, Van Eerd D, Cullen K, Cole DC, Irvin E, Tyson J, et al. Effectiveness of participatory ergonomic interventions on health outcomes: a systematic review. Appl Ergon. 2008;39(3):342–58.

    PubMed  Google Scholar 

  13. Tsutsumi A, Nagami M, Yoshikawa T, Kogi K, Kawakami N. Participatory intervention for workplace improvements on mental health and job performance among blue-collar workers: a cluster randomized controlled trial. J Occup Environ Med. 2009;51(5):554–63.

    PubMed  Google Scholar 

  14. Huysmans M, Schaafsma F, Viester L, Anema J. Multidisciplinaire Leidraad Participatieve Aanpak op de Werkplek–Hoofddocument en achtergronddocument. VU Medisch Centrum Amsterdam EMOG Instituut voor onderzoek naar Gezondheid en Zorg; 2016.

    Google Scholar 

  15. Loisel P, Anema JR. Handbook of work disability. New York: Springer-Verlag; 2013.

  16. Driessen MT, Groenewoud K, Proper KI, Anema JR, Bongers PM, van der Beek AJ. What are possible barriers and facilitators to implementation of a participatory ergonomics programme? Implement Sci. 2010;5(1):64.

    PubMed  PubMed Central  Google Scholar 

  17. Wilson JR. Solution ownership in participative work redesign: the case of a crane control room. Int J Ind Ergon. 1995;15(5):329–44.

    Google Scholar 

  18. Anema J, Steenstra I, Urlings I, Bongers P, De Vroome E, Van Mechelen W. Participatory ergonomics as a return-to-work intervention: a future challenge? Am J Ind Med. 2003;44(3):273–81.

    CAS  PubMed  Google Scholar 

  19. Burdorf A, Robroek S, Schurig M. Kennissynthese Werk (en) is Gezond. The Hague: ZonMw; 2016.

    Google Scholar 

  20. Huber M, Knottnerus JA, Green L, van der Horst H, Jadad AR, Kromhout D, et al. How should we define health? BMJ. 2011;343:d4163.

    PubMed  Google Scholar 

  21. Eldredge L, Markham C, Ruiter R, Fernández M, Kok G, Parcel G. Planning health promotion programs: an intervention mapping approach. San Fransisco: Jossey-Bass Inc; 2016.

  22. Stronks K, Hoeymans N, Haverkamp B, den Hertog FR, van Bon-Martens MJ, Galenkamp H, et al. Do conceptualisations of health differ across social strata? A concept mapping study among lay people. BMJ Open. 2018;8(4):e020210.

    PubMed  PubMed Central  Google Scholar 

  23. Flinterman F, Bisscheroux P, Dijkema P, den Hertog F, de Jong M, Vermeer A, et al. Positieve Gezondheid en gezondheidspercepties van mensen met een lage SES. Tijdschrift voor gezondheidswetenschappen. 2019;97(3–4):96–105.

    Google Scholar 

  24. Huber M, van Vliet M, Giezenberg M, Winkens B, Heerkens Y, Dagnelie P, et al. Towards a ‘patient-centred’operationalisation of the new dynamic concept of health: a mixed methods study. BMJ Open. 2016;6(1):e010091.

    CAS  PubMed  PubMed Central  Google Scholar 

  25. Berg J, Harting J, Stronks K. Individualisation in public health: reflections from life narratives in a disadvantaged neighbourhood. Crit Public Health. 2019;29:1–12.

  26. Dumas A, Robitaille J, Jette SL. Lifestyle as a choice of necessity: young women, health and obesity. Soc Theory Health. 2014;12(2):138–58.

    Google Scholar 

  27. Coupe N, Cotterill S, Peters S. Tailoring lifestyle interventions to low socio-economic populations: a qualitative study. BMC Public Health. 2018;18(1):967.

    PubMed  PubMed Central  Google Scholar 

  28. Borg V, Kristensen TS. Social class and self-rated health: can the gradient be explained by differences in life style or work environment? Soc Sci Med. 2000;51(7):1019–30.

    CAS  PubMed  Google Scholar 

  29. Kaikkonen R, Rahkonen O, Lallukka T, Lahelma E. Physical and psychosocial working conditions as explanations for occupational class inequalities in self-rated health. Eur J Public Health. 2009;19(5):458–63.

    PubMed  Google Scholar 

  30. Åkerstedt T. Shift work and disturbed sleep/wakefulness. Occup Med. 2003;53(2):89–94.

    Google Scholar 

  31. Rahkonen O, Laaksonen M, Martikainen P, Roos E, Lahelma E. Job control, job demands, or social class? The impact of working conditions on the relation between social class and health. J Epidemiol Community Health. 2006;60(1):50–4.

    PubMed  PubMed Central  Google Scholar 

  32. Stansfeld SA, Head J, Marmot M. Explaining social class differences in depression and well-being. Soc Psychiatry Psychiatr Epidemiol. 1997;33(1):1–9.

    Google Scholar 

  33. André S, Kraaykamp G, Meuleman R. Een (on) gezonde leefstijl: opleiding als scheidslijn: Den Haag: Sociaal en Cultureel Planbureau (SCP); 2018.

    Google Scholar 

  34. Waterlander WE, de Haas WE, van Amstel I, Schuit AJ, Twisk JW, Visser M, et al. Energy density, energy costs and income–how are they related? Public Health Nutr. 2010;13(10):1599–608.

    PubMed  Google Scholar 

  35. Moore S, Kawachi I. Twenty years of social capital and health research: a glossary. J Epidemiol Community Health. 2017;71(5):513–7.

    CAS  PubMed  Google Scholar 

  36. Uphoff EP, Pickett KE, Cabieses B, Small N, Wright J. A systematic review of the relationships between social capital and socioeconomic inequalities in health: a contribution to understanding the psychosocial pathway of health inequalities. Int J Equity Health. 2013;12(1):54.

    PubMed  PubMed Central  Google Scholar 

  37. Oksanen T, Kouvonen A, Kivimäki M, Pentti J, Virtanen M, Linna A, et al. Social capital at work as a predictor of employee health: multilevel evidence from work units in Finland. Soc Sci Med. 2008;66(3):637–49.

    PubMed  Google Scholar 

  38. Jacobsen DI, Fjeldbraaten EM. Shift work and sickness absence—the mediating roles of work–home conflict and perceived health. Hum Resour Manag. 2018;57(5):1145–57.

    Google Scholar 

  39. Oellingrath IM, De Bortoli MM, Svendsen MV, Fell AKM. Lifestyle and work ability in a general working population in Norway: a cross-sectional study. BMJ Open. 2019;9(4):e026215.

    PubMed  PubMed Central  Google Scholar 

  40. Nilsen W, Skipstein A, Ostby KA, Mykletun A. Examination of the double burden hypothesis-a systematic review of work-family conflict and sickness absence. Eur J Pub Health. 2017;27(3):465–71.

    Google Scholar 

  41. Hämmig O, Bauer GF. Work, work–life conflict and health in an industrial work environment. Occup Med. 2014;64(1):34–8.

    Google Scholar 

  42. Neto M, Chambel MJ, Carvalho VS. Work-family life conflict and mental well-being. Occup Medicine. 2018;68(6):364–9.

    CAS  Google Scholar 

  43. Hämmig O. Prevalence and health correlates of work-life conflict among blue-and white-collar workers from different economic sectors. Front Public Health. 2014;2:221.

    PubMed  PubMed Central  Google Scholar 

  44. Carmichael F, Fenton S, Pinilla Roncancio M, Sing M, Sadhra S. Workplace wellbeing programmes and their impact on employees and their employing organisations: a scoping review of the evidence base: a collarboration between Health Exchange & University of Birmingham. Work: Wealth and Wellbeing Research Group and Network, The University of Birmingham; 2014.

    Google Scholar 

  45. World Health Organization. Health promotion glossary. Geneva: World Health Organization; 1998. Retrieved from: https://www.who.int/healthpromotion/about/HPR%20Glossary%201998.pdf?ua=1.

  46. Ryan RM, Patrick H, Deci EL, Williams GC. Facilitating health behaviour change and its maintenance: interventions based on self-determination theory. Eur Health Psychol. 2008;10(1):2–5.

    Google Scholar 

  47. de Wit M, Wind H, Hulshof CT, Frings-Dresen MH. Person-related factors associated with work participation in employees with health problems: a systematic review. Int Arch Occup Environ Health. 2018;91(5):497–512.

    PubMed  PubMed Central  Google Scholar 

  48. Boeijinga A, Hoeken H, Sanders J. An analysis of health promotion materials for Dutch truck drivers: off target and too complex? Work. 2017;56(4):539–49.

    PubMed  Google Scholar 

  49. Schwarzer R. Modeling health behavior change: how to predict and modify the adoption and maintenance of health behaviors. Appl Psychol. 2008;57(1):1–29.

    Google Scholar 

  50. Whitehead M, Pennington A, Orton L, Nayak S, Petticrew M, Sowden A, et al. How could differences in ‘control over destiny’lead to socio-economic inequalities in health? A synthesis of theories and pathways in the living environment. Health Place. 2016;39:51–61.

    PubMed  Google Scholar 

  51. Griggs TL, Casper WJ, Eby LT. Work, family and community support as predictors of work–family conflict: a study of low-income workers. J Vocat Behav. 2013;82(1):59–68.

    Google Scholar 

  52. Muse LA, Pichler S. A comparison of types of support for lower-skill workers: evidence for the importance of family supportive supervisors. J Vocat Behav. 2011;79(3):653–66.

    Google Scholar 

  53. Van Amelsvoort LG, De Brouwer CP, Heerkens YF, Widdershoven GA, Kant I. Fostering functioning of workers: a new challenge for prevention in occupational health. Work. 2017;57(2):153–6.

    PubMed  Google Scholar 

  54. De Brouwer CP, Verdonk P, Van Amelsvoort LG, Jansen NW, Kant I, Widdershoven GA. Experiences of occupational physicians with the implementation of indicated prevention for long term sickness absence. Work. 2017;57(2):157–72.

    PubMed  Google Scholar 

  55. Deci EL, Ryan RM. Self-determination theory: sage publications ltd; 2012.

    Google Scholar 

  56. Hagger MS, Chatzisarantis N. Integrating the theory of planned behaviour and self-determination theory in health behaviour: a meta-analysis. Br J Health Psychol. 2009;14(2):275–302.

    PubMed  Google Scholar 

  57. Bandura A. Self-efficacy: the exercise of control. New York: Worth Publishers; 1997.

  58. Lammerts L, Schaafsma FG, Van Mechelen W, Anema JR. Execution of a participatory supportive return to work program within the Dutch social security sector: a qualitative evaluation of stakeholders’ perceptions. BMC Public Health. 2016;16(1):323.

    PubMed  PubMed Central  Google Scholar 

  59. van Beurden KM, Vermeulen SJ, Anema JR, van der Beek AJ. A participatory return-to-work program for temporary agency workers and unemployed workers sick-listed due to musculoskeletal disorders: a process evaluation alongside a randomized controlled trial. J Occup Rehabil. 2012;22(1):127–40.

    PubMed  Google Scholar 

  60. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.

    PubMed  PubMed Central  Google Scholar 

  61. Rosen L, Manor O, Engelhard D, Zucker D. In defense of the randomized controlled trial for health promotion research. Am J Public Health. 2006;96(7):1181–6.

    PubMed  PubMed Central  Google Scholar 

  62. Schelvis RM, Hengel KMO, Burdorf A, Blatter BM, Strijk JE, van der Beek AJ. Evaluation of occupational health interventions using a randomized controlled trial: challenges and alternative research designs. Scand J Work Environ Health. 2015;41(5):491–503.

    PubMed  Google Scholar 

  63. van Oostrom SH, Anema JR, Terluin B, Venema A, de Vet HC, van Mechelen W. Development of a workplace intervention for sick-listed employees with stress-related mental disorders: intervention mapping as a useful tool. BMC Health Serv Res. 2007;7(1):127.

    PubMed  PubMed Central  Google Scholar 

  64. Vermeulen SJ, Anema JR, Schellart AJ, van Mechelen W, van der Beek AJ. Intervention mapping for development of a participatory return-to-work intervention for temporary agency workers and unemployed workers sick-listed due to musculoskeletal disorders. BMC Public Health. 2009;9(1):216.

    PubMed  PubMed Central  Google Scholar 

  65. Pehkonen I, Takala E-P, Ketola R, Viikari-Juntura E, Leino-Arjas P, Hopsu L, et al. Evaluation of a participatory ergonomic intervention process in kitchen work. Appl Ergon. 2009;40(1):115–23.

    PubMed  Google Scholar 

  66. Buijs P, Gunnyeon B, van Weel C. Primary health care: what role for occupational health? Br J Gen Pract. 2012;62(605):623–4.

    PubMed  PubMed Central  Google Scholar 

  67. van Oostrom SH, van Mechelen W, Terluin B, de Vet HC, Anema JR. A participatory workplace intervention for employees with distress and lost time: a feasibility evaluation within a randomized controlled trial. J Occup Rehabil. 2009;19(2):212–22.

    PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This study was funded by The Netherlands Organization for Health Research and Development (ZonMW). The funder had no role in the design of the study, collection, analysis and interpretation of data and in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

RS performed the study by using the IM protocol and wrote the article. All authors (RS, FS, AB, MH, CB, JA) contributed to the development of the Grip on Health intervention, provided feedback on the drafts of the article and read and approved the final manuscript.

Corresponding author

Correspondence to R. Schaap.

Ethics declarations

Ethics approval and consent to participate

The Medical Ethics Review Committee of the VU University Medical Center approved the study protocol and confirmed that the Medical Research Involving Human Subjects Act does not apply to this study. Written informed consent was obtained from all participants before participation.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Interview guides for the interviews and focus groups with workers with a low SEP, OHPs and employers.

Additional file 2.

Logic model of chance. A summary of the behavioral and environmental determinants, performance objectives and outcomes.

Additional file 3.

Matrices of change for the behavioral outcome. Change objectives for the behavioral outcome to identify what workers with a low SEP may need to learn or change to achieve the performance objectives.

Additional file 4.

Matrices of change for the environmental outcome. Change objectives for the environmental outcome to identify what OHPs need to learn or change to achieve the performance objectives.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schaap, R., Schaafsma, F.G., Bosma, A.R. et al. Improving the health of workers with a low socioeconomic position: Intervention Mapping as a useful method for adaptation of the Participatory Approach. BMC Public Health 20, 961 (2020). https://doi.org/10.1186/s12889-020-09028-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-020-09028-2

Keywords