Table 3 Phase 3 reliability results (n = 13 paired responses; SEA Change and GenR8 Change coalition members)
Construct and domains | # items | Max. score | Mean score (SD)a | Two-week test-retest reliability | Internal scale consistency (Cronbach’s α) | |||
|---|---|---|---|---|---|---|---|---|
ICC (95% CI) | WSCV (95% CI) | Test | Retest | Average | ||||
Knowledge | ||||||||
Composite | 18 | 25 | 22.24 (1.28) | 0.84 (0.62–0.95) | 0.02 (0.01–0.03) | 0.83 | 0.81 | 0.81 |
Domain-specific | ||||||||
1. Problem | 3 | 5 | 4.74 (0.43) | 0.43 (0.11–0.82) | 0.06 (0.04–0.09) | 0.95 | 0.23 | 0.68 |
2. Intervention factors | 6 | 5 | 4.60 (0.30) | 0.67 (0.35–0.89) | 0.03 (0.02–0.05) | 0.72 | 0.44b | 0.58 |
3. Roles | 3 | 5 | 4.64 (0.35) | 0.82 (0.57–0.94) | 0.03 (0.02–0.05) | 0.14 | 0.58 | 0.35 |
4. Sustainability | 3 | 5 | 4.00 (0.51) | 0.59 (0.25–0.86) | 0.08 (0.05–0.11) | 0.76 | 0.89 | 0.82 |
5. Resources | 3 | 5 | 4.26 (0.58) | 0.78 (0.51–0.92) | 0.06 (0.04–0.09) | 0.78 | 0.68 | 0.74 |
Engagement | ||||||||
Composite | 25 | 25 | 21.34 (1.77) | 0.58 (0.23–0.86) | 0.05 (0.03–0.08) | 0.88 | 0.94 | 0.91 |
Domain-specific | ||||||||
1. Dialogue & mutual learning | 7 | 5 | 4.73 (0.32) | 0.54 (0.20–0.85) | 0.05 (0.04–0.08) | 0.79 | 0.93 | 0.88 |
2. Flexibility | 3 | 5 | 4.28 (0.56) | 0.40 (0.09–0.82) | 0.09 (0.06–0.14) | 0.85 | 0.77 | 0.82 |
3. Influence & power | 2 | 5 | 3.81 (0.83) | 0.55 (0.21–0.85) | 0.13 (0.09–0.21) | 0.93 | 0.66 | 0.84 |
4. Leadership & stewardship | 10 | 5 | 4.32 (0.43) | 0.53 (0.19–0.84) | 0.06 (0.04–0.09) | 0.81 | 0.80 | 0.81 |
5. Trust | 3 | 5 | 4.21 (0.32) | 0.25 (0.02–0.84) | 0.10 (0.07–0.15) | 0.56 | 0.84 | 0.78 |