Skip to main content

Table 3 Delivery Agent Fidelity to Intervention Delivery and Implementation Strategy Activities

From: SIPsmartER delivered through rural, local health districts: adoption and implementation outcomes

  Overall District 1 District 2 District 3 District 4
Intervention Delivery
Group Classes
 Number of classes expected based on enrolled cohorts 36 6 12 9 9
 Classes delivered 31/36 (86%) 5/6 (83%) 9/12 (75%) 7/9 (78%) 10/9 (111%)
 Division of teaching tasks between delivery agents Varied by district The 1 identified delivery agent taught all classes The 2 identified agents co-taught all classes ▪ Delivery agent #1: solo taught 3 classes and co-taught 2 classes with Delivery Agent #2
▪ Delivery agent #2:
taught 1 class and co-taught 2 classes with Delivery Agent #2
▪ Delivery agent #3: taught 1 class
▪ Researcher taught 1 class
▪ Two cohorts had a combined class
The 1 identified delivery agent taught all classes
Researcher observed
lesson fildelity a*
93% 97% 92% 87% 96%
 Researcher observed modificationsb 17% 19% 18% 14% 19%
Teach-Back and Missed Class Calls
 Number of delivery agents attempting teach-back calls 3/7 (43%) 1/1 (100%) 1/2 (50%) 0/3 (0%) 1/1 (100%)
 Number of teach-back calls successfully completed by delivery agents (compared to research staff) 3 (of 66, 5%) 0 (of 10, 0%) 1 (of 17, 6%) 0 (of 28, 0%) 2 (of 18, 2%)
 Number of delivery agents attempting missed class calls 5/7 (71%) 1/1 (100%) 1/2 (50%) 2/3 (67%) 1/1 (100%)
 Number of missed class calls successfully completed by delivery agents (compared to research staff) 6 (of 59, 10%) 0 (of 10, 0%) 0 (of 15, 0%) 6 (of 22, 27%) 0 (of 11, 0%)
Implementation Strategy
 Delivery agents completing 2 day training 6/7 (86%) 1/1 (100%) 2/2 (100%) 2/3 (67%) 1/1 (100%)
 Expected pre-meetings completedc 9/12 (75%) 1/3 (33%) 3/3 (100%) 3/4 (75%) 3/3 (100%)
 Additional pre-meetings completed 9 3 3 3
 Classes co-delivered with researcher 3/32 (10%) 2/5 (40%) 0/0 (0%) 1/8 (13%) 0/10 (0%)
 Fidelity check lists completed by delivery agent for each class taught 43/43 (100%) 5/5 (100%) Delivery Agent #1 = 9/9 (100%)
Delivery Agent #2 = 9/9 (100%)
Delivery Agent #1 = 6/6 (100%)
Delivery Agent #2 = 3/3 (100%)
Delivery Agent #3 = 1/1 (100%)
10/10 (100%)
 Delivered classes observed by researcher 27/32 (84%) 5/5 (100%) 6/9 (67%) 8/8 (100%) 8/10 (80%)
 Post-meetings completedc 27/27 (100%) 5/5 (100%) 6/6 (100%) 8/8 (100%) 8/8 (100%)
  1. a Score for each lesson is an average of the fidelity ratings or modifications from all the classes observed by the researcher for that lesson
  2. b Score for each lesson is an average of the fidelity ratings or modifications from all the classes reported by delivery agents for that lesson
  3. c Number of expected pre- and post-meetings varied vary based on division of teaching responsibilities and co-teaching. Pre-meetings were expected to be completed prior to the first time each educator (or pair of educators) delivered a lesson. Post-meetings were expected after each completed and observed class
  4. * difference between research observed and delivery agent reported fidelity p < 0.01