- Study protocol
- Open Access
Safety and Health through Integrated, Facilitated Teams (SHIFT): stepped-wedge protocol for prospective, mixed-methods evaluation of the Healthy Workplace Participatory Program
BMC Public Health volume 20, Article number: 1463 (2020)
Healthcare facilities are notorious for occupational health and safety problems. Multi-level interventions are needed to address interacting exposures and their overlapping origins in work organization features. Worker participation in problem identification and resolution is essential. This study evaluates the CPH-NEW Healthy Workplace Participatory Program (HWPP), a Total Worker Health® protocol to develop effective employee teams for worker safety, health, and wellbeing.
Six public sector, unionized healthcare facilities are enrolled, in three pairs, matched by agency. The unit of intervention is a workplace health and safety committee, adapted here to a joint labor-management “Design Team” (DT). The DT conducts root cause analyses, prioritizes problems, identifies feasible interventions in light of the constraints and needs of the specific setting, makes business-case presentations to facility leadership, and assists in evaluation.
Following a stepped-wedge (cross-over) design, one site in each pair is randomly assigned to “immediate intervention” status, receiving the full coached intervention at baseline; in the “lagged intervention” site, coaching begins about half-way through the study. Program effectiveness and cost-effectiveness outcomes are assessed at both organizational (e.g., workers’ compensation claim and absenteeism rates, perceived management support of safety) and individual levels (e.g., self-rated health, sleep quality, leisure-time exercise). Targeted pre-post analyses will also examine specific outcomes appropriate to the topics selected for intervention. Process evaluation outcomes include fidelity of the HWPP intervention, extent of individual DT member activity, expansion of committee scope to include employee well-being, program obstacles and opportunities in each setting, and sustainability (within the available time frame).
This study aims for a quantitative evaluation of the HWPP over a time period long enough to accomplish multiple intervention cycles in each facility. The design seeks to achieve comparable study engagement and data quality between groups. We will also assess whether the HWPP might be further improved to meet the needs of U.S. public sector healthcare institutions. Potential challenges include difficulty in pooling data across study sites if Design Teams select different intervention topics, and follow-up periods too short for change to be observed.
ClinicalTrials.gov NCT04251429 (retrospectively registered January 29, 2020), protocol version 1.
Background and rationale
Occupational health and safety in the healthcare sector
Healthcare is one of the largest sectors in the U.S. economy, with over 16 million employees, representing 11% of the U.S. labor force . Eighteen of the 30 fastest-growing professions in the U.S. are in healthcare and associated sectors; they are expected to create more than 3.4 million additional jobs by the year 2028 . The largest projected increases are for home health professionals and personal care assistants [2, 3]. Other professions such as nurse practitioners, physician technicians, and medical assistants also represent steady demand as the healthcare sector shifts towards team-based services .
Numerous exposures in the healthcare work environment include excessive physical workload (e.g., patient handling), biological agents, cleaning and disinfection chemicals, shiftwork with extended hours, electronic data entry, assaults, and psychosocial stressors. Not all of the resulting health effects are recognized or reported as work-related. Nationally, the reported incidence rate of recordable non-fatal occupational injuries and illnesses for healthcare and social assistance jobs was 4.1 per 100 full-time workers in 2017 and 3.9 in 2018 .
The type and severity of injuries vary by job title. Compared to all occupations (private sector), psychiatric aides have among the highest incidence rates for non-fatal workplace injuries requiring days away from work (647.7 per 10,000 full time workers) . Among other healthcare professions, orderlies and nursing assistants’ rates were 283.3 and 255.7, respectively . Rates for registered nurses (RNs) were 88.4, licensed practical and vocational nurses (LPNs) 85.6, healthcare social workers 25.4, and mental health and substance abuse social workers 14.7 .
In 2018, incidence rates for nonfatal occupational injuries and illnesses resulting in days away from work among public sector (state government) healthcare occupations were considerably higher than those of their private sector counterparts . Public sector psychiatric aides’ incidence rates were 1475.7 per 10,000 full time workers, nursing assistants 445.9, RNs 194.5, and LPNs 427.7 per 10,000 .
The most common events recorded for injuries with days away from work for psychiatric aides were related to violence . In the U.S., violence from patients, visitors, and coworkers is often tolerated as inevitable in the healthcare workplace . The U.S. Occupational Safety and Health Administration (OSHA) has issued prevention guidelines that include engineering controls for primary prevention . However, the typical and often sole strategy offered for preventing health care worker injuries from assault is training in management of patient/client behavior; OSHA’s guidelines are often not implemented and occupational safety personnel are typically not engaged in problem analysis and solutions [10, 11].
Musculoskeletal disorders (MSDs) such as sprains, strains and tears are a common nature of injury among all healthcare workers . For nursing assistants and RNs, overexertion and bodily reaction were the most common types of reported incidents . In 2016, over 19,790 registered nurses in private industry sustained musculoskeletal injuries that resulted in lost work days . In 2015, registered nurses and nursing assistants were two of the top six occupations for lost-workday MSD rates . Nearly 20,000 nursing assistants and over 11,000 registered nurses sustained musculoskeletal injuries that resulted in missed days from work . Other healthcare job groups with notable MSD risk include physical and occupational therapists , laboratory technicians , housekeeping , maintenance workers, laundry, and food service workers .
Patient handling is recognized as a major cause of MSDs for clinical staff . For direct care personnel, patient/resident lifting devices can reduce biomechanical load and injury risk [20,21,22,23,24]. However, many facilities do not have sufficient equipment; patient needs and limited co-worker availability for assistance can challenge a structured lifting program. Biomechanical considerations may be complicated by other job features, such as time pressure, staff-supervisor interaction, combative patients , and attention to infectious disease risk . Potential effect modification of lifting demands by personal factors such as obesity, cigarette smoking, or depression is still understudied . Further, patient handling is not the only ergonomic demand in caregiving jobs, which also involve lifting of material loads, bending and twisting, and standing for long periods of time.
Job stress and burnout are high among healthcare workers and associated with both psychological and somatic distress [27,28,29]. Psychosocial stressors, night work, and workplace assault are associated with chronic disease risk factors such as smoking, physical inactivity, obesity, sleep, and mental wellbeing [30,31,32], health concerns that are not typically attributed to work. Psychosocial stressors have also been linked to high staff turnover intention in nursing homes . Healthcare institutions face substantial challenges in retaining direct care personnel due to workplace health and safety issues. Annual turnover rates for registered nurses are estimated to range from 18 to 26% , with cost estimates for each turnover ranging from $62,100–$67,000 . High personnel turnover impacts organizational conditions that increase workplace hazards, creating a vicious cycle and posing challenges for patient safety and quality of care.
This multiplicity of hazards and outcomes poses practical challenges for employee health champions. It can be difficult to prioritize efforts, especially when there is insufficient understanding about how exposures interact with each other, how to interrupt the positive feedback loops, and whether there are common barriers to improving working conditions in these various domains. There is an emerging agreement that workplace health interventions should operate at multiple levels of influence , and that health and safety interventions should address work organization and empowering employees in problem identification and resolution [36, 37]. However, there is limited experience with a systematic approach to identify and address the interplay among this myriad of causal factors in order to improve healthcare worker mental and physical health effectively [29, 38, 39].
Total Worker Health®
The U.S. National Institute for Occupational Safety and Health supports a Total Worker Health® (TWH) research program to examine the combined effects of workplace and non-workplace factors on worker safety, health and well-being [40, 41] and to evaluate trials of integrated workplace efforts. Evaluation literature is sparse to date and TWH approaches and goals vary among investigators [42,43,44].
One strategy to elucidate the relevant occupational and non-occupational risk factors, and how they interact, is participatory action research . In a participatory approach, employees are actively engaged in problem identification and prioritization, decision-making, implementation, and evaluation of the program. This supports effective program implementation and uptake because employees are well qualified to identify opportunities and obstacles present in their work environment [44, 46]. Key features include collaboration, mutual education, and acting on results developed from research questions that are relevant to the community [47, 48]. Previous studies have demonstrated the importance of direct involvement of employees and their levels of influences in the process of program implementation [49, 50]. Decision latitude is itself a key psychosocial determinant of worker health. Thus, providing opportunities for workers to identify problems, set priorities, and design and assess health and safety programs should contribute to improving worker health both directly and indirectly .
The Healthy Workplace Participatory Program (HWPP) (http://www.uml.edu/Research/Centers/CPH-NEW/Healthy-Work-Participatory-Program/) is an innovative, evidence-based protocol to facilitate worker participation in priority-setting, root cause analysis, and development, implementation, and evaluation of integrated solutions to workforce health problems. It promotes employee empowerment and engagement to address a wide range of work environment, work organization, and safety and health issues through organization-level change. New understandings emerge as participants reflect on interventions in light of their first-hand knowledge. Preliminary evaluations have shown high user acceptance and positive process outcomes [44, 52, 53].
This study, Safety and Health through Integrated, Facilitated Teams (SHIFT), undertakes a prospective evaluation of the HWPP in the healthcare sector. The overall goal is to increase effectiveness of health and safety committees to undertake root cause analysis, problem-solving, and development of solutions. The study will generate quantitative and qualitative evidence regarding its feasibility and effectiveness as a process for obtaining integrated solutions to challenges for worker health. The primary short-term hypothesis is that the health and safety committees will become more active and engaged. Longer-term goals are that the committees become more effective in implementing measures to improve workforce health and safety. Because all study sites come from the same economic sector, generalizable knowledge may be derived regarding the needs and challenges of public sector healthcare facilities. The findings may also identify needs for any further revisions to the HWPP toolkit.
Setting and population
The study is carried out in six public sector healthcare facilities, one pair from each of three agencies. Four of these are run by the state of Massachusetts Executive Office of Health and Human Services: two Department of Mental Health hospitals and two residential facilities for veterans. The other two are inpatient/outpatient facilities of the U.S. Veterans’ Administration.
These agencies all have pre-existing workforce safety and health infrastructure. The Veterans’ Administration has multiple initiatives addressing employee health and safety on a national scope and has been particularly recognized for the excellence of its safe patient handling program [54, 55]. Various committees address Environment of Care, accident review, safe patient handling, violence prevention, and in some facilities health promotion.
In Massachusetts, every executive-level branch of state government is required to have a Safety and Health Coordinator and joint labor-management health and safety committees . State law also mandates that all state agencies provide employees with safety and health protections at least as protective as federal OSHA requirements. Health and Human Services has been one of the most pro-active state agencies, creating an occupational health and safety infrastructure with committees in every agency and assigning a secretariat-level coordinator. Regional workers’ compensation managers review claims data with the coordinator on a regular basis.
Individual study sites were recruited according to the following criteria:
Active, high-level interest in a participatory, integrated occupational health program.
An existing occupational health and safety committee with front-line staff members that meets regularly, has a designated facilitator or chair, and is willing to consider expansion of scope to include worker well-being.
Openness to high degree of worker participation in development and implementation of solutions.
Leadership recognition and acceptance of the necessary in-kind personnel time commitment (manage survey logistics, coordinate transmission of administrative data files); openness to broadening the scope of issues over time; and willingness to be oriented to the designed management role.
The study has a stepped-wedge design , meaning a prospective study with concurrent controls that later cross over to intervention (Fig. 1). Study sites are enrolled in matched pairs. Within each pair, one facility is randomly assigned to “immediate intervention” status and receives the intervention as early as possible during the project period, following baseline data collection. The research team provides coaching to co-facilitators and champions throughout the implementation process, in order to enhance fidelity, engagement, and effectiveness. The other facility, designated as the “lagged intervention” site, has status-quo control group status for the first half of the project, continuing with the safety process already in place at that facility until mid-way through the timeline. At that point, the three immediate intervention sites will continue with the HWPP process independently, and the HWPP coaching will be transferred to the lagged intervention sites.
The lag period seeks to obtain adequate observation time with concurrent controls for the intervention sites, as well as follow-up time to examine the interventions that the control sites undertake before the end of the study. During the lag period, all sites have access to health and safety information upon request from the researchers, on topics prioritized by committee members (e.g., ergonomics/safe patient handling; assault prevention; shift work and sleep quality; job stress prevention).
At the time of randomization, findings are presented to the facility Steering Committee (SC) and the Design Team (DT) co-facilitators from the baseline formative assessments (below) of key challenges to employee health, safety, and wellbeing, as well as opportunities and barriers for the participatory process. Similarly, throughout the project the researchers will report key descriptive findings from administrative data and employee surveys (see below) to the DT’s and SC’s for their use in priority-setting.
The HWPP intervention is delivered at the institutional level. A coach from the research team assists each facility to implement the CPH-NEW Intervention Design and Analysis Scorecard (IDEAS) process . The steps in the HWPP program are described and illustrated with training videos and example worksheets on the CPH-NEW website (www.uml.edu/cphnewtoolkit/IDEAS).
The key working group is the Design Team. Because each participating healthcare facility had at least one existing joint management-labor health and safety team, most typically an Environment of Care committee, the HWPP has been adapted to this membership structure. During the recruitment and start-up period, specific instructions are provided regarding equal numbers of DT members from the rank-and-file workforce and management, and avoidance of direct supervisory relationships between any pair of DT members. The researchers expended substantial time in pre-study communication with facility leadership as well as the multiple bargaining units at each site to ensure clear understanding of these ground rules and selection of representatives enthusiastic to participate. Two employees per site were trained as co-facilitators, one from labor and one from management. Besides seeking balance in perspectives, having co-facilitators seeks to ensure continuity in case of employee turnover and to set the stage for longer-term sustainability.
Within each facility, the existing management decision-making group is designated the HWPP Steering Committee and a senior manager plays the role of program “champion.” The champion attends the initial trainings, participates in quarterly study oversight meetings, and agrees to maintain regular communication with the DT co-facilitators. A structured process defines the sequence of activities and key communications between the DT and SC, which provides the DT with constructive feedback about the proposals, selects interventions to be implemented, and provides any needed resources for refining, implementing, and evaluating interventions.
The researchers orient all DT members and the champion to the study design, the HWPP, and the study roles. Additional training is provided as the DT moves through the stages of the HWPP: meeting management skills (agendas, minutes, tracking action items); use of fishbone diagrams to identify root causes of selected safety/health concerns; development of solutions through systems analysis; strategies for presenting these to the facility leadership team; and techniques to evaluate DT activities and use these results to guide refinements and related solutions. Finally, the teams will present these ideas to leadership, creating effective and meaningful dialogue.
Because interventions are designed through a participatory process, the DT and SC members at each site – not the researchers – select the intervention goals and activities to be carried out. Based on prior experience in the healthcare sector, review of earlier workers’ compensation claims from these three agencies, and conversations during the recruitment process, key issues likely to be selected at the participating facilities include psychosocial job stress and burnout; verbal and physical assault; physical ergonomics (including but not limited to patient handling); overtime, shiftwork, and sleep quality; and traditional safety issues (e.g., slips, trips and falls). In accordance with the Total Worker Health mission, the DT’s are specifically invited to consider interactions between the work environment and personal well-being/health behaviors (exercise, nutrition, sleep, etc.), and whether these might have shared or overlapping solutions.
The researchers anticipate at least one issue to be selected and intervened on per year at each site, once active coaching begins. By the mid-point of the study, each immediate intervention DT should have completed at least two complete IDEAS cycles and be prepared to continue the process more independently. The coach will reduce active assistance while maintaining contact through regular telephone or e-mail check-ins with DT members and co-facilitators to assess progress, learn about problems or concerns, and offer advice if requested. Research staff will continue to be available as a technical resource when DTs take up new topics.
The program implementation process and effectiveness will be evaluated, using qualitative and quantitative methods, at the levels of the institution, program team members, and individuals affected by interventions generated by the teams (Table 1). A program logic model of the HWPP outputs and outcomes guides the selection, development and use of the evaluation elements (Fig. 2), informed by that of Strickland et al. . This section describes process evaluation measures to evaluate HWPP outputs, and formative and effectiveness evaluation measures to describe HWPP outcomes.
The HWPP relies on continuous participatory engagement of program participants and the workforce so that the workers’ own knowledge can inform customization of the program to local conditions, in keeping with the principles of participatory action research. Thus, a substantial amount of planned evaluation addresses the implementation process and corresponds to the Logic Model elements of “Activities and Outputs.”
Process evaluation addresses potential generalizability of the results by documenting specific conditions that necessitate customization as well as quantifying personnel and other resources needed for implementation. The choice of process measures is informed by implementation science research frameworks [59,60,61] with adaptations for the occupational safety and health setting . For example, the level of participants’ engagement, enthusiasm and confidence in their roles is expected to predict the success of the program. Quality and usability of the program materials are also likely predictors. Characteristics of the implementation process include the participants’ efforts in planning, engaging, executing, reflecting, and evaluating the program steps. External forces and organizational characteristics of the study sites may either facilitate or impede program implementation.
Process measures registered as primary outcomes for this clinical trial are team attendance, team engagement, level of committee activity, and scope of health, safety, and well-being issues addressed. Process measures registered as secondary outcomes include proportion of the HWPP protocol and content followed (fidelity), and development of shared labor-management awareness of job-related health issues.
Pre-program data on workforce health, safety, and well-being provide baseline assessments of potential problems to be addressed. Workers’ compensation (WC) and administrative data are collected retrospectively at baseline to provide context and understanding of major health and safety needs. Each site will provide de-identified electronic administrative data files annually covering workforce size and demographics; employee retention by job group; workers’ health-related absenteeism, and WC claims and costs. These data will also be collected prospectively over the course of the study.
The baseline All-Employee Survey (AES) assesses the starting conditions for individual-level employee health status, burnout, and work ability; frequency of threats, assault, and harassment of employees; staff-reported quality of care of patients/residents; and perceived organizational support for workforce health, safety, and wellbeing.
Baseline interviews with upper and mid-level managers, as well as union leaders, assess perceptions of priority employee safety and health concerns, alignment of the HWPP with organizational goals, as well as expectancies for program outcomes and sustainability. (The interview guide was developed for this study (see Supplementary File). Organizational readiness surveys of the same organizational leaders assess perception in organizational resources and readiness for safety and health programs, teamwork and communication, and organizational-level readiness for worker participation in program design. These domains are associated with successful implementation of participatory ergonomics programs and safety-related organization change efforts . Baseline data from organizational leaders will identify training needs and other possible resource gaps to address for successful implementation of the HWPP. Follow-up data will be gathered through regular interviews and surveys of the same managers, program champions, and union leaders, as well as DT members.
Effectiveness outcome measures include changes in the formative measures over time, designated in the Logic Model as “Short Term,” “Intermediate,” and “Long Term” outcomes (Fig. 2). Short-term outcomes include changes in knowledge and skills of Design Team members (e.g. greater awareness of perspectives of other employees in different work units and at different levels of the organizational hierarchy, increased quality of communication and level of engagement, and focus on safety, health, and well-being concerns of employees), as well as management commitment of resources for implementing safety/well-being interventions.
At the facility level, the goal is that locally-designed interventions on DT-selected topics will be implemented through the authority of the Steering Committee. Their eventual effectiveness on relevant metrics of organizational performance will be assessed at multiple levels. We expect the training provided to teams to result in the production of intervention ideas that reflect both work and non-work contributors. Therefore, the team-generated interventions will be assessed for TWH characteristics.
Organizational performance will be assessed through interim interviews of champions, co-facilitators, and organizational leaders to assess expectancies related to implementation and impact of interventions selected by the Design Team. A survey will be administered to DT members semi-annually to collect similar measures, plus measures of personal involvement, program value, and management support.
Longer-term effectiveness analyses will utilize data from the AES, administered at least twice during the study. Outcomes of interest include changes in workers’ exposures, stressors, work climate, and perceived organizational support, as well as individual-level health, safety, and wellbeing (Table 1). Organizational readiness surveys will be re-administered with organizational leaders to assess changes in resources and readiness for participation, change initiatives, safety and health teamwork and communication.
While valuable for tracking large trends in a workforce, the AES may not be sensitive to specific interventions, especially if these target certain units or workforce sub-groups. The IDEAS toolkit calls for the DT to identify measurable key performance indicators for each intervention. The DT will use these to generate topic-specific measures such as pre/post “mini-surveys” to assess impact in the appropriate segment(s) of the workforce. The HWPP intervention includes investigator coaching on how to design and conduct targeted pre/post surveys. Thus, carrying out these targeted surveys will itself be recorded as a measure of committee effectiveness. If different DT’s select the same issue during the study, the investigators will suggest use of overlapping measures, to facilitate cross-facility comparison and pooling of data on effectiveness.
Short-term process measures will be summarized for each committee over time and compared between the control and intervention groups. For example, changes in implementation metrics will quantify the extent to which the participatory DTs utilized the HWPP program (uptake) and adhered to it (fidelity, sustainability). The DT surveys and Coach notes will be summarized to document the development of team functionality, independence, ability to plan and implement activities, and ability to evaluate success or setbacks of activities to improve the process in the future. We will also describe obstacles and opportunities in each setting, and the extent to which these are similar among agencies.
We will summarize the accomplishments of the HWPP and the factors observed to affect implementation and outcomes of the program; the challenges and successes of long-term team maintenance; and how these were different from or similar to the challenges and successes of the health and safety committees in the control sites before the lagged interventions. We will discuss the implications of these combined qualitative and quantitative findings for potential long-term sustainability of the participatory programs. These findings may be relevant to post-hoc analyses of any site differences in effectiveness and will also inform future refinements in HWPP content or delivery.
Initial analyses of individual-level AES data will quantify the baseline magnitude of worker health and health-related indicators, such as burnout/depression, musculoskeletal symptoms and function, recent assault, and acute injury. Data will be summarized by study group (immediate/lagged intervention), facility, and job group. Cross-sectional associations with work environment features will focus on dependent variables prioritized by DT and SC members in the initial surveys and interviews. Candidate job characteristics are physical and psychosocial job demands, decision latitude, perceived supervisor and coworker support, and work schedule.
We will also generate descriptive data on institutional characteristics such as average ratings of organizational culture and climate; quality of safe patient/resident handling and other worker health or safety programs; compensation claim rates; employee turnover rates; and clinical staffing ratios. These analyses will be done by site for customized reports, and by agency type and study group to assess potential confounding and effect modification.
The pre/post “mini-surveys” will be analyzed to assess short-term effectiveness of locally-designed interventions within the proportion of the workforce expected to benefit. Employee participation in DT-promoted activities will be compared between study groups and over time (pre- vs post-intervention).
Organizational-level improvements in worker engagement, communication or shared understanding between management and workforce, SC authorization of resources, or uptake and institutionalization of new practices will be interpreted as effectiveness of the participatory intervention process, at the overall study level.
Assuming that both groups intervene on similar topics over time, pooled effectiveness analyses will compare AES data in the immediate intervention and lagged intervention groups. If sufficient numbers of workers complete more than two surveys, we will also use a difference-in-difference approach. Reporting of individual-level outcomes (e.g., changes in occupational exposures, health beliefs and behaviors) will follow the CONSORT guidelines for cluster randomized trials .
Statistical power calculations for intention-to-treat comparisons of several key outcomes (Table 2) were conducted for difference-in-difference analysis, with two-sample differences at the population level. The facilities within each pair are of different workforce sizes, so we assumed conservatively the smaller of the facilities from each pair in both groups. Full-time equivalent denominators were assumed to represent 90% of headcount; a 75% response rate gave samples of about 1650 workers per group. We used a binomial distribution for proportions (e.g., smoking) and Gaussian distribution for means (e.g., body mass index (BMI)). Starting values were taken as those found in our prior healthcare study using a similar instrument [31, 32, 65]. Modest differences should be readily detectable, assuming facility-wide implementation of each HWPP intervention.
In addition, where interventions have addressed health outcomes that are generally attributed to working conditions, workers’ compensation claims will be compared over time. For example, with an occupational safety and health intervention such as installation of safe patient handling equipment, benefits may be measured through change in WC claim rates and costs for back injuries and muscle strains.
We will estimate cost-benefit for each intervention and cost-effectiveness (cost-outcome) for selected outcomes. Cost will be represented by organizational inputs (equipment, personnel effort) and benefits in terms of adverse outcomes avoided (e.g., worker injury prevented, dollars of WC claims avoided, unit of body weight lost, resident fall prevented).
The primary challenges to cost-benefit analyses lie in the measurement of costs of intervention and in assigning a monetary value to the outcomes. Data from the control group will be used to estimate the cost (lost workdays, turnover, training, hiring substitutes) of not intervening. The analyses will calculate “net present value,” or the sum of all costs and benefits associated with the intervention, measured at a specific time point by discounting each cost and benefit by the opportunity cost of capital . This sum is positive when an intervention provides a benefit greater than its costs. Some intervention costs involve large initial outlays and others recur over time, such as the costs of equipment maintenance and employee training. Benefits may or may not be immediately visible or may also increase over time. This method allows adjustment for the difference in timing of each monetary value through the discounting of each amount by the opportunity cost. In other words, the benefits of interventions are incremental, estimated per year. This also implies that, in order to be cost-effective, the benefits of intervention need to be large enough to outweigh the opportunity cost of capital that could have alternative uses.
As noted above, for some interventions, changes in WC costs will be meaningful. Other interventions may affect health outcomes not generally attributed to working conditions, such as obesity or sleep quality and its sequelae. In this case, benefits would likely be severely underestimated by relying only on WC costs, and other metrics are needed. In either case, benefits may also include reduced worker fatigue, higher productivity, fewer employee errors, or improved patient care. To aid in understanding, some AES items address knowledge and use of the internal reporting system and WC; self-assessed work ability and productivity; perceived quality of patient care; and intention to leave the job. However, these benefits are difficult to assign a monetary value. We will work with the partnering facilities to attempt to develop conservative estimation algorithms, using survey measures and administrative data.
An approach that does not require assigning dollar value to health or other non-monetary, measurable benefits (improved worker morale) is cost-effectiveness or cost-outcome analysis, which produces estimates of the cost to achieve a given unit of benefit, e.g., reducing body mass index by one point. The cost is estimated by recording the efforts and resources required to implement the program and applying dollar values to each one, as above. We will then estimate the investment relative to the program benefits achieved.
Protection of human subjects
All subject recruitment is directed by the study personnel. If contact is made through a third party (e.g., employer newsletter), all further communications occur privately. All participants are asked to sign activity-specific informed consent forms explaining the procedure, offering to answer questions, and informing them that they are free to withdraw their consent and discontinue participation in the study at any time without prejudice to their employment situations. Personal identifiers are requested for contact information and to ensure accurate record linkage across stages of data collection. They are not kept with the data files and will be destroyed at the end of the study. Data values for small cells (e.g., fewer than 5 people per facility/job group/gender) will not be reported, to protect anonymity.
Overall, the SHIFT study will extend the knowledge about the effectiveness of a participatory approach to Total Worker Health in the healthcare sector. The HWPP will be implemented with attention to all job groups, for the broad objectives of protecting employee safety and fostering health and well-being. It is hoped that this integrated approach will complement and strengthen existing workplace safety and health initiatives and promote organizational learning, producing synergistic effects . We expect to obtain valuable information on program effectiveness for improving employee safety and health, program impact at the individual and organizational levels, facilitators and barriers to program implementation, and how the HWPP might be further improved, especially for public sector facilities.
Although workplace integration of programs in occupational health and health promotion seems desirable, there are challenges. One is that integrated programs require more time, effort, and commitment from the organization . For example, we expect the management steering committee to provide timely constructive feedback to interventions proposed by the DT, as well as financial and organizational resources for implementing and evaluating them. The biggest barrier to front-line employee participation in a previous healthcare program was lack of release time for employees . Although obtaining such commitment from the organization takes time and effort, we believe it will be worthwhile because organization culture, environment, and leadership support are closely associated with employee safety and health [32, 69].
The standardized All-Employee Survey will be valuable for tracking large trends in the study population, but if the intervention only benefits a sub-group, any effect could be diluted and difficult to observe. Further, individual health outcomes, as well as workplace culture and organizational features, may evolve gradually enough that there is not adequate time to see changes. We have included a number of proximal endpoints to alleviate this potential challenge. For example, perceived management support of safety relates to longer-term outcomes HWPP, through the multi-level communication and organizational learning that results from the IDEAS process.
Because of the high degree of participatory decision-making, specific health targets selected may vary among DTs. The facilities have generally indicated a similar set of concerns, but even if intervention topics overlap across the sites, they will not necessarily be taken up in the same sequence. This requires that we examine both generic injury/illness outcomes, as well as problem-specific outcomes. Depending on the sequence in which the same topics are addressed in each facility, the length of follow-up time for those endpoints may vary and need to be adjusted for accordingly.
The gold standard for an intervention study is the randomized clinical trial (RCT). Ideally this study would use a cluster randomized design, where groups with similar background risk (on average) are randomly assigned to the intervention or to a control group that receives standard or current services. However, the benefits of randomization to prevent confounding are not realized except with a large sample. In this case, the intervention is administered at the level of the entire facility, and resources do not permit enrollment of enough sites. In any case, it would be difficult to find enough workplaces of a similar nature. The alternative is to compare the treatment groups on baseline characteristics that might influence the outcome. Differences can then be adjusted for with stratified analysis multivariable regression. The double-blinding in RCTs also prevents the possibility of information bias. However, double-blinding is infeasible for organization-level interventions, and other study designs, such as the stepped wedge, maybe be of equal value with attention to reducing bias [70,71,72]. Further, RCTs have other disadvantages, such as limited capacity to assess multi-dimensional interventions – such as this one - and incompatibility with community trust, choice, and participation often needed for successful program design and evaluation. The stepped-wedge design was selected to achieve comparable study engagement, survey participation, and data quality in all sites.
Study revisions after the start date
After the study began, one facility withdrew by order of a manager in a central agency office, for administrative reasons. We continue to support the other facility in that pair as an immediate intervention site. Data from the unpaired facility will be utilized in comparisons with the other two immediate intervention sites, to assess generalizability of results and describe program sensitivity to institutional context.
Due to administrative delays and personnel changes, the SHIFT start-up process took about 2 years, whereas the original study design had envisioned less than 1 year needed until the Design Teams began application of the IDEAS Tool. For meaningful evaluation, the coaching in the immediate intervention group should be maintained long enough to complete at least two full intervention cycles. Coaching in the lagged intervention group will then be concurrent with that in the first group. This preserves roughly 1.5 years of the core comparison between concurrent experiences in Groups A and B. In fact, this timeline corresponds closely to the typical stepped-wedge design, where interventions are added progressively to later sites but not necessarily withdrawn from the initial ones.
This study of healthcare workers is innovative in not being limited to clinical personnel. There are numerous health and safety challenges for workers in other healthcare jobs, especially those of lower socioeconomic status, such as laundry, food service, housekeeping and maintenance .
This work will benefit both workers and employers. Rooted in participatory action research with organization support, the HWPP will ideally be sustained after the researchers step back, because employees will benefit from an improved work environment as well as safety and health through interventions proposed and implemented on their willingness. Employer support might be motivated by positive effects such as improved worker morale and engagement and lower rates of compensation claims, missed workdays, and job turnover.
Availability of data and materials
Data collection forms are available from the research team at: email@example.com. Data files are not publicly available due to privacy guarantees to study participants, many of whom could be identified from their roles and demographic characteristics even in de-identified data sets.
Center for the Promotion of Health in the New England Workplace
Healthy Workplace Participatory Program
Intervention Design and Analysis Scorecard
Licensed practical nurse
Occupational Safety and Health Administration
Safety and Health through Integrated, Facilitated Teams
Total Worker Health
Bureau of Labor Statistics. The Employment Situation - December 2018. In: Bureau of Labor Statistics, U.S. Department of Labor; 2019.
Bureau of Labor Statistics. Employment Projections: 2018–2028. In: Bureau of Labor Statistics, U.S. Department of Labor; 2019.
Bureau of Labor Statistics. Employment Projections. Fastest growing occupations. [https://www.bls.gov/emp/tables/fastest-growing-occupations.htm]. Accessed 22 June 2020.
Bureau of Labor Statistics. Employer-Reported Workplace Injuries and Illnesses - 2018. In: Bureau of Labor Statistics, U.S. Department of Labor; 2019.
Bureau of Labor Statistics. Table R100. Incidence rates for nonfatal occupational injuries and illnesses involving days away from work per 10,000 full-time workers by occupation and selected events or exposures leading to injury or illness, private industry, 2018. [https://www.bls.gov/web/osh/cd_r100.htm]. Accessed 22 June 2020.
Bureau of Labor Statistics. 2018 Survey of occupational injuries & illnesses: charts package. [https://www.bls.gov/iif/soii-charts-2018.pdf]. Accessed 22 June 2020.
Bureau of Labor Statistics. Chart 17: Nonfatal occupational injury and illness incidence rates for cases involving days away from work for selected healthcare and protective service occupations, by ownership, 2018 [https://www.bls.gov/iif/soii-chart-data-2018.htm#BLS_table_17]. Accessed 22 June 2020.
McPhaul KM, London M, Lipscomb JA. A framework for translating workplace violence intervention research into evidence-based programs. Online J Issues Nurs. 2013;18(1):4.
OSHA. Guidelines for preventing workplace violence for healthcare and social service workers. Washington DC: Occupational Safety and Health Administration, U.S. Department of Labor; 2015.
Sherrill A. Workplace safety and health: additional efforts needed to help protect health care workers from workplace violence (GAO-16-11). Washington, DC: United States Government Accountability Office; 2016.
Blando J, Ridenour M, Hartley D, Casteel C. Barriers to effective implementation of programs for the prevention of workplace violence in hospitals. Online J Issues Nurs. 2015;20(1):5.
Bureau of Labor Statistics. Table R98. Incidence rates for nonfatal occupational injuries and illnesses involving days away from work per 10,000 full-time workers by occupation and selected nature of injury or illness, private industry, 2018. [https://www.bls.gov/web/osh/cd_r98.htm]. Accessed 22 June 2020.
Bureau of Labor Statistics. Occupational injuries and illnesses among registered nurses. [https://www.bls.gov/opub/mlr/2018/article/occupational-injuries-and-illnesses-among-registered-nurses.htm]. Accessed 22 June 2020.
Nonfatal Occupational Injuries and Illnesses Requiring Days Away From Work, 2015. [https://www.bls.gov/web/osh/cd_r100.htm]. Accessed 22 June 2020.
Kotejoshyer R, Punnett L, Dybel G, Buchholz B. Claim costs, musculoskeletal health, and work exposure in physical therapists, occupational therapists, physical therapist assistants, and occupational therapist assistants: a comparison among long-term care jobs. Phys Ther. 2019;99(2):183–93. https://doi.org/10.1093/ptj/pzy137.
Agrawal P, Maiya A, Kamath V, Kamath A. Musculoskeletal disorders among medical laboratory professionals-a prevalence study. JExercise Sci Physiother. 2015;10:77.
Salwe K, Kumar S, Hood J. Nonfatal occupational injury rates and musculoskeletal symptoms among housekeeping employees of a Hospital in Texas. J Environ Public Health. 2011;2011. https://doi.org/10.1155/2011/382510.
Boyer J, Galizzi M, Cifuentes M, d'Errico A, Gore R, Punnett L, Slatin C. Ergonomic and socioeconomic risk factors for hospital workers’ compensation injury claims. Amer J Industr Med. 2009;52(7):551–62. https://doi.org/10.1002/ajim.20702.
Kim H, Dropkin J, Spaeth K, Smith F, Moline J. Patient handling and musculoskeletal disorders among hospital workers: analysis of 7 years of institutional workers’ compensation claims data. Am J Ind Med. 2012;55(8):683–90. https://doi.org/10.1002/ajim.22006.
Burdorf A, Koppelaar E, Evanoff B. Assessment of the impact of lifting device use on low back pain and musculoskeletal injury claims among nurses. Occup Envir Med. 2013;70(7):491–7. https://doi.org/10.1136/oemed-2012-101210.
Engst C, Chhokar R, Miller A, Tate RB, Yassi A. Effectiveness of overhead lifting devices in reducing the risk of injury to care staff in extended care facilities. Ergonomics. 2005;48(2):187–99. https://doi.org/10.1080/00140130412331290826.
Evanoff B, Wolf L, Aton E, Canos J, Collins J. Reduction in injury rates in nursing personnel through introduction of mechanical lifts in the workplace. Am J Ind Med. 2003;44(5):451–7. https://doi.org/10.1002/ajim.10294.
Fujishiro K, Weaver JL, Heaney CA, Hamrick CA, Marras WS. The effect of ergonomic interventions in healthcare facilities on musculoskeletal disorders. Am J Ind Med. 2005;48(5):338–47. https://doi.org/10.1002/ajim.20225.
Schoenfisch AL, Myers DJ, Pompeii LA, Lipscomb HJ. Implementation and adoption of mechanical patient lift equipment in the hospital setting: the importance of organizational and cultural factors. Am J Ind Med. 2011;54(12):946–54. https://doi.org/10.1002/ajim.21001.
Teeple E, Dennerlein JT, Hashimoto D, Soto LA, Losina E, Katz JN. An ergonomic assessment of hospital linen bag handling. New Solutions. 2017;27(2):210–24. https://doi.org/10.1177/1048291117710783.
Jensen JN, Holtermann A, Clausen T, Mortensen OS, Carneiro IG, Andersen LL. The greatest risk for low-back pain among newly educated female health care workers; body weight or physical work load? BMC Musculoskelet Disord. 2012;13:87. https://doi.org/10.1186/1471-2474-13-87.
de Jonge J, Le Blanc PM, Peeters MC, Noordam H. Emotional job demands and the role of matching job resources: a cross-sectional survey study among health care workers. Internat J Nursing Studies. 2008;45(10):1460–9. https://doi.org/10.1016/j.ijnurstu.2007.11.002.
Eriksen W, Tambs K, Knardahl S. Work factors and psychological distress in nurses’ aides: a prospective cohort study. BMC Public Health. 2006;6:290. https://doi.org/10.1186/1471-2458-6-290.
van den Tooren M, de Jonge J. Managing job stress in nursing: what kind of resources do we need? J Advanced Nurs. 2008;63(1):75–84. https://doi.org/10.1111/j.1365-2648.2008.04657.x.
Miranda H, Punnett L, Gore RJ. Musculoskeletal pain and reported workplace assault: a prospective study of clinical staff in nursing homes. Hum Factors. 2014;56(1):215–27. https://doi.org/10.1177/0018720813508778.
Miranda H, Gore RJ, Boyer J, Nobrega S, Punnett L. Health behaviors and overweight in nursing home employees: contribution of workplace stressors and implications for worksite health promotion. Sci World J. 2015;2015. https://doi.org/10.1155/2015/915359.
Zhang Y, Punnett L, Gore R. Relationships among employees’ working conditions, mental health, and intention to leave in nursing homes. J Appl Gerontol. 2014;33(1):6–23. https://doi.org/10.1177/0733464812443085.
JCAHCO. Health care at the crossroads: strategies for addressing the evolving nursing crisis. In. Oakbrook Terrace: The Joint Commission on Accreditation of Health Care Organizations; 2002.
Jones CB. The costs of nurse turnover, part 2: application of the nursing turnover cost calculation methodology. J Nurs Adm. 2005;35(1):41–9. https://doi.org/10.1097/00005110-200501000-00014.
Weiner BJ, Lewis MA, Linnan LA. Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Educ Res. 2009;24(2):292–305. https://doi.org/10.1093/her/cyn019.
Nelson AL. Safe patient handling and movement: a practical guide for health care professionals. New York: Springer Publishing Company; 2005.
Nelson A, Matz M, Chen F, Siddharthan K, Lloyd J, Fragala G. Development and evaluation of a multifaceted ergonomics program to prevent injuries associated with patient handling tasks. Internat J Nurs Studies. 2006;43(6):717–33. https://doi.org/10.1016/j.ijnurstu.2005.09.004.
Marine A, Ruotsalainen J, Serra C, Verbeek J. Preventing occupational stress in healthcare workers. Cochrane Database of Syst Rev. 2006;4:Cd002892. https://doi.org/10.1002/14651858.CD002892.pub5.
Mark BA, Hughes LC, Belyea M, Chang Y, Hofmann D, Jones CB, Bacon CT. Does safety climate moderate the influence of staffing adequacy and work conditions on nurse injuries? J Saf Res. 2007;38(4):431–46. https://doi.org/10.1016/j.jsr.2007.04.004.
NIOSH. What is Total Worker Health? [https://www.cdc.gov/niosh/TWH/]. Accessed 22 June 2020.
Tamers SL, Chosewood LC, Childress A, Hudson H, Nigam J, Chang C-C. Total worker health® 2014–2018: the novel approach to worker safety, health, and well-being evolves. Internat J Envir Res Public Health. 2019;16(3):321. https://doi.org/10.3390/ijerph16030321.
Anger WK, Elliot DL, Bodner T, Olson R, Rohlman DS, Truxillo DM, Kuehl KS, Hammer LB, Montgomery D. Effectiveness of Total worker health interventions. J Occup Health Psychol. 2015;20(2):226–47. https://doi.org/10.1037/a0038340.
Feltner C, Peterson K, Weber RP, Cluff L, Coker-Schwimmer E, Viswanathan M, Lohr KN. The effectiveness of Total worker health interventions: a systematic review for a National Institutes of Health pathways to prevention workshop. Annals Internal Med. 2016;165(4):262–9. https://doi.org/10.7326/M16-0626.
Punnett L, Cavallari JM, Henning RA, Nobrega S, Dugan AG, Cherniack MG. Defining ‘Integration’ for Total worker health: a new proposal. Ann Work Exposures Health. 2020;64(3):223–35. https://doi.org/10.1093/annweh/wxaa003.
Cherniack M, Punnett L. A participatory framework for integrated interventions. In: Hudson HL, JAS N, Sauter SL, Chosewood LC, Schill AL, Howard J, editors. Total Worker Health. Washington, DC: US: American Psychological Association; 2019. p. 107–24.
Henning R, Warren N, Robertson M, Faghri P, Cherniack M. Workplace health protection and promotion through participatory ergonomics: an integrated approach. Public Health Rep. 2009;124(Suppl 1):26–35. https://doi.org/10.1177/00333549091244S104.
Caldwell-Brakefield W, Parker E. Successful models combining intervention and basic research in the context of community based participatory research. In: O'Fallon L, Tyson F, Dearry A, editors. Successful Models of Community-Based Participatory Research Final Report. Washington DC: National Institute of Environmental Health Sciences; 2000.
Baum F, MacDougall C, Smith D. Participatory action research. J Epidemiol Community Health. 2006;60(10):854–7. https://doi.org/10.1136/jech.2004.028662.
Kazutaka K. Roles of participatory action-oriented programs in promoting safety and health at work. Saf Health Work. 2012;3(3):155–65. https://doi.org/10.5491/2FSHAW.2012.3.3.155.
Tsutsumi A, Nagami M, Yoshikawa T, Kogi K, Kawakami N. Participatory intervention for workplace improvements on mental health and job performance among blue-collar workers: a cluster randomized controlled trial. J Occup Envir Med. 2009;51(5):554–63. https://doi.org/10.1097/JOM.0b013e3181a24d28.
Punnett L, Cherniack M, Henning R, Morse T, Faghri P. A conceptual framework for integrating workplace health promotion and occupational ergonomics programs. Public Health Rep. 2009;124(Suppl 1):16–25. https://doi.org/10.1177/00333549091244S103.
Nobrega S, Kernan L, Plaku-Alakbarova B, Robertson M, Warren N, Henning R. Field tests of a participatory ergonomics toolkit for Total worker health. Appl Ergon. 2017;60:366–79. https://doi.org/10.1016/j.apergo.2016.12.007.
Robertson M, Henning R, Warren N, Nobrega S, Dove-Steinkamp M, Tibirica L, Bizarro A. The intervention design and analysis scorecard: a planning tool for participatory design of integrated health and safety interventions in the workplace. J Occup Envir Med. 2013;55(12 Suppl):S86–8. https://doi.org/10.1097/JOM.0000000000000036.
Mohr DC, Warren N, Hodgson MJ, Drummond DJ. Assault rates and implementation of a workplace violence prevention program in the veterans health care administration. J Occup Envir Med. 2011;53(5):511–6. https://doi.org/10.1097/JOM.0b013e31820d101e.
Powell-Cope G, Toyinbo P, Patel N, Rugs D, Elnitsky C, Hahm B, Sutton B, Campbell R, Besterman-Dahan K, Matz M, Hodgson M. Effects of a national safe patient handling program on nursing injury incidence rates. J Nursing Admin. 2014;44(10):525–34. https://doi.org/10.1097/NNA.0000000000000111.
Commonwealth of Massachusetts. Executive Order No. 511: Establishing the Massachusetts Employee Safety and Health Advisory Committee. 2009.
Beard E, Lewis JJ, Copas A, Davey C, Osrin D, Baio G, Thompson JA, Fielding KL, Omar RZ, Ononge S, Hargreaves J, Prost A. Stepped wedge randomised controlled trials: systematic review of studies published between 2010 and 2014. Trials. 2015;16(1):353. https://doi.org/10.1186/s13063-015-0839-2.
Strickland JR, Kinghorn AM, Evanoff BA, Dale AM. Implementation of the Healthy Workplace Participatory Program in a Retail Setting: A Feasibility Study and Framework for Evaluation. Internat J Envir Res Public Health. 2019;16(4). https://doi.org/10.3390/ijerph16040590.
Chaudoir SR, Dugan AG, Barr CHI. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8(1):22. https://doi.org/10.1186/1748-5908-8-22.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. https://doi.org/10.1186/1748-5908-4-50.
Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Policy Mental Health Mental Health Services Res. 2011;38(2):65–76. https://doi.org/10.1007/s10488-010-0319-7.
Dugan AG, Punnett L. Dissemination and implementation research for occupational safety and health. Occup Health Science. 2017;1(1–2):29–45. https://doi.org/10.1007/s41542-017-0006-0.
Matthews RA, Gallus JA, Henning RA. Participatory ergonomics: development of an employee assessment questionnaire. Accid Anal Prev. 2011;43(1):360–9. https://doi.org/10.1016/j.aap.2010.09.004.
Campbell MK, Piaggio G, Elbourne DR, Altman DG. Consort 2010 statement: extension to cluster randomised trials. British Med J. 2012;345:e5661. https://doi.org/10.1136/bmj.e5661.
Kurowski A, Gore R, Roberts Y, Kincaid KR, Punnett L. Injury rates before and after the implementation of a safe resident handling program in the long-term care sector. Saf Sci. 2017;92:217–24. https://doi.org/10.1016/j.ssci.2016.10.012.
Haddix AC, Teutsch SM, Corso PS. Prevention effectiveness: a guide to decision analysis and economic evaluation. New York, NY: Oxford University Press; 2002.
Petterson IL, Donnersvärd HÅ, Lagerström M, Toomingas A. Evaluation of an intervention programme based on empowerment for eldercare nursing staff. Work Stress. 2006;20(4):353–69. https://doi.org/10.1080/02678370601070489.
Zhang Y, Flum M, Kotejoshyer R, Fleishman J, Henning R, Punnett L. Workplace participatory occupational health/health promotion program: facilitators and barriers observed in three nursing homes. J Gerontol Nurs. 2016;42(6):34–42. https://doi.org/10.3928/2F00989134-20160308-03.
Kelloway EK, Barling J. Leadership development as an intervention in occupational health psychology. Work & Stress. 2010;24(3):260–79. https://doi.org/10.1080/02678373.2010.518441.
Chaulk CP, Kazandjian VA. Moving beyond randomized controlled trials. Am J Public Health. 2004;94(9):1476. https://doi.org/10.2105/ajph.94.9.1476.
Griffiths A. Organizational interventions: facing the limits of the natural science paradigm. Scand J Work Envir Health. 1999;25(6):589–96. https://doi.org/10.5271/sjweh.485.
Simmons RK, Ogilvie D, Griffin SJ, Sargeant LA. Applied public health research - falling through the cracks? BMC Public Health. 2009;9(1):362. https://doi.org/10.1186/1471-2458-9-362.
The authors are grateful to Cesar Morocho for review of all citations and careful editing and formatting of the final manuscript.
This study is supported by Grant Number 1 U19 OH008857 from the U.S. National Institute for Occupational Safety and Health (Principal Investigator, Laura Punnett). NIOSH played no role in the design of the study, data collection and analysis, or preparation of this manuscript. The contents are solely the responsibility of the authors and do not necessarily represent the official views of NIOSH.
Ethics approval and consent to participate
All individual participants will fill out a written consent form as part of their questionnaire or prior to any interview or observational data being collected within meetings. The consent specifies that their de-identified data will be used for research purposes and will not be shared with anyone outside the research team. Participants must be aged 18 or over in order to participate. The study has been reviewed and approved by the Institutional Review Board of the University of Massachusetts Lowell (#16–131-PUN).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Punnett, L., Nobrega, S., Zhang, Y. et al. Safety and Health through Integrated, Facilitated Teams (SHIFT): stepped-wedge protocol for prospective, mixed-methods evaluation of the Healthy Workplace Participatory Program. BMC Public Health 20, 1463 (2020). https://doi.org/10.1186/s12889-020-09551-2
- Healthcare workers
- Mixed methods
- Occupational health
- Occupational safety
- Participatory methods
- Total worker health
- Worker participation