Skip to main content

Table 4 Reliability of Denver II-Jimma at item level indicated by inter-ratera and test re- testb kappa values, and at domain-level indicated by inter-rater and test-retest intraclass correlation coefficients

From: Adaptation and standardization of a Western tool for assessing child development in non-Western low-income context

Reliability Measures

PS (26 items)

FM (29 items)

LA (39 items)

GM (32 items)

Total (126 items)

Inter-rater (kappa values)

Excellent (0.81–1.00)

21 (80.8 %)

24 (82.8 %)

34 (87.2 %)

27 (84.4 %)

124 (98.4 %)

4 (15.4 %)***

4(13.8 %)***

5(12.8 %)***

5(15.6 %)***

Substantial (0.61–0.80)

1(3.8 %)

1 (3.4 %)

-

-

2 (1.6 %)

Acceptable (0.41–0.60)

-

-

-

-

-

Poor (<0.41)

-

-

-

-

-

Inter-rater (ICC)C, [95 % CI]

0.983, [0.979-0.986]

0.982, [0.978-0.985]

0.951, [0.940-0.959]

0.967, [0.961-0.973]

 

Test retest (kappa values)

Excellent (0.81–1.00)

15 (57.7 %)

4(13.8 %)

14 (35.9 %)

14 (43.8 %)

69 (54.8 %)

4 (15.4 %)***

5 (17.24 %)***

6 (15.4 %)***

5 (15.6 %)***

1(3.45)*

1(2.6 %)**

Substantial (0.61–0.80)

5 (19.2 %)

13 (44.8 %)

16 (41 %)

11 (34.4 %)

45 (35.7 %)

Acceptable (0.41–0.60)

2 (7.7 %)

5 (17.24 %)

2 (5.1 %)

2 (6.3 %)

11 (8.7 %)

Poor (<0.41)

 

1 (3.45 %)

-

-

1 (0.8 %)

Test-retest (ICC)d, [95 % CI]

0.802, [0.721–0.859]

0.831, [0.736–0.888]

0.840, [0.773–0.887]

0.793, [0.711–0.852]

 
  1. PS Personal social, FM Fine motor-adaptive, LA Language, GM Gross motor, ICC intraclass correlation coefficient, CI confidence interval
  2. ***Kappa value not calculated but percentage of agreement is 100
  3. **Kappa value not calculated but percentage of agreement is 93.3
  4. *Kappa value not calculated but percentage of agreement is 90.91
  5. aAgreement between two measurements done independently at a time
  6. bAgreement between measurements repeated at a different time
  7. cOne-way random effect model is used and shows very high correlation
  8. dTwo-way random effect model is used and shows high correlation