Skip to main content

Table 2 Evaluation data collected for the PEACH™ QLD Project against the RE-AIM framework dimensions

From: CONSORT to community: translation of an RCT to a large-scale community intervention and learnings from evaluation of the upscaled program

RE-AIM dimension and definition

Level (source) of data

Data collected (O/I/P)a

Tool used/items generated

Further detail and references

REACH

Proportion of the target population that participated in the intervention

Individual (Family)

Number of families enrolled (P)

Purpose-developed database

Recruitment and enrolment databases developed, unique nine-digit ID allocated at enrolment

Family demographics (P)

Questionnaire

Family demographics included family composition, parent education, ethnic background and income level. It is adapted from a previously used data collection form [34].

EFFICACY/EFFECTIVENESS

Success rate if implemented as in guidelines; defined as positive outcomes minus negative outcomes

Individual (Facilitator)

Changes in knowledge, skills and confidence (I)

Purpose-developed questionnaire

Self-rated on a Likert scale for the practice areas of family-focussed weight management, lifestyle support, behaviour modification

Satisfaction with program training and resources (P)

Purpose-developed questionnaire

Parent facilitator satisfaction with program training workshop and program resources was collected pre- and post-training, and post delivery

Individual (Child)

Child anthropometric measures (O)

Standardized measures for weight, height, waist circumference

WHO2007 [35], US-CDC2000 [36] and UK1990 [37] BMI z-scores and UK1990 WC z-scores; children categorised using IOTF thresholds [38, 39]

Parent-reported child diet (O)

Children’s Dietary Questionnaire (CDQ) scores for 1) Fruits & vegetables; 2) Sweetened beverages; 3) Fat from dairy products; 4) Discretionary foods; and 5) Food behaviours

Forty-item semi-quantitative dietary questionnaire validated to assess diet quality and food behaviours of school-aged children against the Australian Dietary Guidelines [40, 41]

Core food group serves for: 1) Fruits; 2) Vegetables; 3) Grains; 4) Meats and alternatives; and 5) Dairy and alternatives

Ten-item, parent completed questionnaire to assess intake of the five core food groups of Australian Guide to Healthy Eating (AGHE) validated in a sample of 45 [31].

Parent-reported child physical activity and sedentary behaviours (O)

Children’s Leisure Activities Study Survey (CLASS)

Assessed using the Children’s Leisure Activities Study Survey (CLASS) questionnaire [42], modified to focus on active pastimes and screen-time only. Provides a quantitative estimate of children’s time spent in moderate, vigorous and total physical activity, and in screen-based sedentary activities per day. The parent-completed version was used as it is equal in validity and reliability to the child-completed questionnaire [42], and allowed consistency in survey administration of diet and PA outcomes.

Child-reported health-related quality of life (I)

Child Health Utility 9D (CHU9D)

9 item self-completed paediatric generic preference-based measure of health-related quality of life [43]. It gives a utility value for each health state described from which quality adjusted life years (QALYs) can be calculated. Validated in 7 to 17 year olds [44].

Child program satisfaction (P)

Purpose-developed group activity and questionnaire

Children’s views of their group sessions were captured via a brief questionnaire and informal group discussion in the last session.

Individual (Family)

Parenting self-efficacy (I)

Parenting self-efficacy

Four-item questionnaire from the Longitudinal Study of Australian Children [45].

Parent barriers, confidence and health beliefs (I)

Purpose-developed questionnaire

Five-item purpose-developed tool to assess parent beliefs about their child’s health, and perceived (pre-program) or actual barriers (post-program) to changing their child’s and family’s health. A further 3 items ask parents to report their confidence to 1) make healthy changes to child and family eating and activity patterns; 2) set limits regarding child food and eating; and 3) set limits regarding child activity/inactivity patterns. These questions are conceptually based on the Health Belief Model [46, 47].

Attendance rates (P)

Program sign-in sheets

Purpose-developed sign in sheets for parents at each session

Satisfaction with program and materials (P)

Purpose-developed questionnaire

Completed by parents at the end of program delivery. Includes satisfaction with program delivery and changes the family has made during the program.

ADOPTION

Proportion of settings, practices, and plans that will adopt this intervention

Organisation (Facilitator)

Number of facilitators trained (P)

Purpose-developed database and questionnaire

PEACHâ„¢ parent facilitator training logs

Demographics (facilitators and services) (P)

Facilitator descriptors included gender, age, education, current employment status and experience in adult and child weight management in groups and 1:1

Number of health services/other organisations engaged (P)

For purpose database containing details on each PEACHâ„¢ group including organisational setting

Stakeholder interviews (P)

Purpose-developed interviews

Semi-structured interviews with facilitators, organisations and stakeholders

IMPLEMENTATION

Extent to which the intervention is implemented as intended in the real world

Organisation (Facilitator)

Number of facilitators who delivered groups and number of groups (P)

Purpose-developed database

For purpose database tracking facilitator involvement in the program (including demographics, training and program delivery)

Adherence to program protocol and session outlines (fidelity) (P)

Purpose-developed questionnaire and session monitoring forms

Facilitators self-rate the quality of the group facilitation and content fidelity, for each session. It is based on a checklist developed for the NOURISH RCT [48].

MAINTENANCE

Extent to which a program is sustained over time

Organisation (Facilitator)

Workforce capacity change

This is beyond the scope of the PEACHâ„¢ delivery stage

To be determined

Organisation (Health System)

Funding committed

Individual (Family)

Long term family impact

  1. a I Impact evaluation, O Intervention outcomes, P Process evaluation