Skip to main content

Advertisement

Table 4 Reliability of Denver II-Jimma at item level indicated by inter-ratera and test re- testb kappa values, and at domain-level indicated by inter-rater and test-retest intraclass correlation coefficients

From: Adaptation and standardization of a Western tool for assessing child development in non-Western low-income context

Reliability Measures PS (26 items) FM (29 items) LA (39 items) GM (32 items) Total (126 items)
Inter-rater (kappa values)
Excellent (0.81–1.00) 21 (80.8 %) 24 (82.8 %) 34 (87.2 %) 27 (84.4 %) 124 (98.4 %)
4 (15.4 %)*** 4(13.8 %)*** 5(12.8 %)*** 5(15.6 %)***
Substantial (0.61–0.80) 1(3.8 %) 1 (3.4 %) - - 2 (1.6 %)
Acceptable (0.41–0.60) - - - - -
Poor (<0.41) - - - - -
Inter-rater (ICC)C, [95 % CI] 0.983, [0.979-0.986] 0.982, [0.978-0.985] 0.951, [0.940-0.959] 0.967, [0.961-0.973]  
Test retest (kappa values)
Excellent (0.81–1.00) 15 (57.7 %) 4(13.8 %) 14 (35.9 %) 14 (43.8 %) 69 (54.8 %)
4 (15.4 %)*** 5 (17.24 %)*** 6 (15.4 %)*** 5 (15.6 %)***
1(3.45)* 1(2.6 %)**
Substantial (0.61–0.80) 5 (19.2 %) 13 (44.8 %) 16 (41 %) 11 (34.4 %) 45 (35.7 %)
Acceptable (0.41–0.60) 2 (7.7 %) 5 (17.24 %) 2 (5.1 %) 2 (6.3 %) 11 (8.7 %)
Poor (<0.41)   1 (3.45 %) - - 1 (0.8 %)
Test-retest (ICC)d, [95 % CI] 0.802, [0.721–0.859] 0.831, [0.736–0.888] 0.840, [0.773–0.887] 0.793, [0.711–0.852]  
  1. PS Personal social, FM Fine motor-adaptive, LA Language, GM Gross motor, ICC intraclass correlation coefficient, CI confidence interval
  2. ***Kappa value not calculated but percentage of agreement is 100
  3. **Kappa value not calculated but percentage of agreement is 93.3
  4. *Kappa value not calculated but percentage of agreement is 90.91
  5. aAgreement between two measurements done independently at a time
  6. bAgreement between measurements repeated at a different time
  7. cOne-way random effect model is used and shows very high correlation
  8. dTwo-way random effect model is used and shows high correlation