From: What is actually measured in process evaluations for worksite health promotion programs: a systematic review
Internal validity/study design
Positive if a random (unpredictable) assignment procedure sequence of subjects to the study groups was used and if there was a clear description of the procedure and adequate performance of the randomization
Similarity of companies
Positive if they controlled for variability in included companies
Similarity of study groups
Positive if the study groups were similar at the beginning of the study
Positive if the percentage of dropouts during the study period did not exceed 20% for short-term follow-up (≤ 3 months) or 30% for long-term follow-up (> 3 months) and adequately described
Timing of outcome measurement
Positive if timing of outcome assessment was identical for intervention and control groups and for all important outcomes assessments.
Positive if the person performing the assessments was blinded to the group assignment
Positive if co-interventions were avoided or comparable.
Positive when data on outcome was selected with standardized methods of acceptable quality
Eligibility criteria (in- and exclusion criteria)
Positive if in- and exclusion criteria of participants were specified
Positive if an adequate description of the study groups was given for demographic variables: gender, age, type of work, hours a week working, education level, baseline main outcome measures
Positive if an adequate description of the included companies was given (type of industry, organizational characteristics)
Positive if an adequate description was given of the interventions(s): number of intervention aspects, type of interventions, frequency of sessions, intensity of intervention(s)
Positive if a follow-up of 6 months or longer was described.
Positive if an adequate sample size calculation was described
Positive if the analysis controlled for potential confounders
Intention to treat
Positive if the intervention and control subjects were analyzed according to the group belonging to their initial assignment, irrespective of non-compliance and co-interventions.
Model used for evaluation
Positive if a theoretical framework for the evaluation was used and adequately described.
Level of evaluation
Positive if implementation was evaluated on 2 or more levels (i.e. macro, meso, micro)
Definition of outcome measure (process components)
Positive if the definition of the outcome measures (process variables and barriers and/or facilitators) were accurately described
Reported process variables
a. Positive if four or more process evaluation variables are evaluated (in process evaluation)
b. Positive if barriers or facilitators on 1 or more levels are presented
Positive if 2 or more techniques for data collection were used (triangulation).
Timing of data collection
Positive if measurements of barriers and/or facilitators were performed pre-, during and after implementation.
Quantitative outcome measures
Positive if data on quantitative outcome was selected with methods of acceptable quality and data on multiple process components was measured.
a. Positive if study design for qualitative data (theoretical framework, participant selection, setting, data collection) were adequately described
b. Positive if qualitative data was analyzed by two researchers.
Outcome related to implementation of intervention
Positive if outcomes (barriers and/or facilitators) are related to the quality of implementation