Table 2 Implementation and process evaluation questions and data sources for answering the questions, based on a modified version of the Conceptual Framework for Implementation Fidelity
Areas to measure | General questions | Specific questions | Question answering data sources |
|---|---|---|---|
Evaluation of adherence | |||
Content | To what extent was each of the components of the intervention design implemented as planned? | To what extent was the recruitment of deliverers (“Malakit facilitators”) compliant with what was planned? | Feedback from the project implementers |
To what extent was the process of inclusion, training, kit delivery, and follow-up visits implemented as planned? | Supervisory visits, Malakit intervention data | ||
To what extent were the messages conveyed during training delivered as planned, including use of tools and materials? | Supervisory visits | ||
Dose/exposure (availability of the intervention and reach/coverage) | What proportion of the target population was covered by the intervention? | Was the intervention optimized in terms of availability for potential participants? | Feedback from the project implementers, Malakit intervention data, supervisory visits |
What was the estimated proportion of the target population (recruited at resting sites) who knew about the project and who participated in the intervention? | Post-intervention survey | ||
What was the penetration of the intervention in very remote areas? | Medical outreach mission in Repentir | ||
Moderating factors | |||
Participant responsiveness (individuals who received the intervention and individuals responsible for delivering it) | What were the engagement and opinions of the participants and deliverers towards the intervention? | How did the participants perceive the fit of the intervention and what was the level of enthusiasm and participation among the study population? | Qualitative study, post-intervention survey, medical outreach mission in Repentir |
How satisfied were the participants with the intervention services? | Qualitative study, supervisory visits, facilitator videos | ||
How did the Malakit facilitators perceive the fit and what were the level of enthusiasm and the factors influencing their motivation? | Qualitative study, supervisory visits, facilitator videos | ||
What were the barriers to reach and participation? | Qualitative study, post-intervention survey, medical outreach mission in Repentir | ||
Quality of delivery | What was the quality of message delivery? | Supervisory visits, facilitator videos | |
Strategies to facilitate implementation | What strategies were used to support implementation? | What were the facilitation strategies to optimize and standardize implementation adherence? | Feedback from the project implementers |
Context | What internal and external contextual factors affected the implementation? | Did factors at the political, economic, organizational, geographical, or community level, and more specifically factors related to the research context, affect implementation? | Qualitative study, supervisory visits, feedback from the project implementers, facilitator videos |