Skip to main content

Table 2 Validity of written survey items

From: Validity of a measure to assess healthy eating and physical activity policies and practices in Australian childcare services

Category

Label

Written survey source

Response levels

Sample

Percentage agreement

Kappa

95% lower CI

95% upper CI

Validity assessment

Physical activity

 

Free play

How much of the daily operating time, do 3 to 5 year old children have for child-initiated free playb

Room Leader

2 (<4.5 hrs/> = 4.5 hrs)

40

63%

0.25

−0.05

0.55

Fair

 

For how much of the child-initiated, free play time can children be physically activeb

Room Leader

2 (<2.5 hrs/> = 2.5 hrs)

40

55%

0.1a

−0.21

0.41

Slight

 

Average proportion of children active during free play time

Room Leader

2 (<=75%/>75%)

38

66%

0.32a

0.01

0.62

Fair

Small screen recreation

Were computers or tablets used by children aged 3 to 5

Room Leader

2 (yes/no)

35

77%

0.54a

0.26

0.83

Moderate

 

Were television (TV), videos and DVDs, including educational programs and videos, viewed by children aged 3 to 5

Room Leader

2 (yes/no)

36

94%

0.89a

0.74

1.04

Almost Perfect

 

Purpose for watching TV/videos

Nominated Supervisor

2 (active vs not active)

12

58%

0.17a

−0.42

0.75

Slight

Structured educator led physical activity

Did educators in the 3–5 room provide structured, educator-led physical activity

Room Leader

2 (yes/no)

35

94%

0.89a

0.73

1.04

Almost Perfect

 

How much time spent in structured educator led physical activityb

Room Leader

2 (<30 min/> = 30 min)

37

54%

0.08a

−0.24

0.41

Slight

 

Average proportion of children active during structured, educator led physical activityb

Room Leader

2 (<90%/> = 90%)

23

52%

0.04a

−0.37

0.46

Slight

Structured educator led Fundamental Movement Skills (FMS)

Did educators in this room lead structured activity to develop FMS

Room Leader

2 (yes/no)

34

53%

0.06a

−0.28

0.4

Slight

 

Average proportion of children active during structured, educator-led physical activity to develop FMSb

Room Leader

2 (<96%/> = 96%)

10

60%

0.2

−0.36

0.76

Slight

Healthy eating

         

Child beverages

Cordial available

Room Leader

2 (yes/no)

36

100%

1a

1

1

Almost Perfect

 

Flavoured milk available

Room Leader

2 (yes/no)

36

100%

1a

1

1

Almost Perfect

 

Fruit juice available

Room Leader

2 (yes/no)

36

100%

1a

1

1

Almost Perfect

 

Only water and/or plain milk available

Room Leader

2 (yes/no)

33

100%

1a

1

1

Almost Perfect

 

Plain milk available

Room Leader

2 (yes/no)

36

94%

0.88

0.73

1

Almost Perfect

 

Type of milk served to children

Nominated Supervisor

2 (regular vs reduced fat)

14

79%

0.57a

0.13

1.02

Moderate

 

Soft drink available

Room Leader

2 (yes/no)

36

100%

1a

1

1

Almost Perfect

 

Water available

Room Leader

2 (yes/no)

36

89%

0.78a

0.57

0.99

Substantial

Child food

Only Healthy Foods offered

Nominated Supervisor

2 (yes/no)

11

73%

0.45

-.10

1.01

Moderate

 

Confectionary, chocolate, ice cream

Nominated Supervisor

2 (yes/no)

14

86%

0.71

0.33

1.09

Substantial

 

Fruit or vegetable pieces, salad or platters

Nominated Supervisor

2 (yes/no)

14

93%

0.86

0.58

1.14

Almost Perfect

 

Pretzels, plain popcorn or oven-baked chips (not oiled)

Nominated Supervisor

2 (yes/no)

14

100%

1

1

1

Almost Perfect

 

Sweet biscuits with chocolate or cream filling

Nominated Supervisor

2 (yes/no)

14

100%

1

1

1

Almost Perfect

 

No foods

Nominated Supervisor

2 (yes/no)

14

86%

0.71

0.33

1.09

Substantial

Lunchbox monitoring

Do educators monitor lunchboxes?

Room Leader

2 (yes/no)

32

84%

0.69a

0.43

0.94

Substantial

 

Do educators monitor lunchboxes and provide feedback to families?

Room Leader

2 (yes/no)

25

68%

0.34

−0.03

0.71

Fair

 

Did parents provide any foods that weren’t compliant with guidelines

Room Leader

2 (yes/no)

21

86%

0.71a

0.41

1.02

Substantial

Role modelling

         

Food & drink

Did staff members consume fruit in front of children

Room Leader

2 (yes/no)

41

88%

0.76a

0.55

0.96

Substantial

 

How many staff consumed fruit in front of children

Room Leader

2 (all vs fewer staff)

40

68%

0.35a

0.06

0.64

Fair

 

Did staff members consume vegetables in front of children

Room Leader

2 (yes/no)

41

49%

−0.02a

−0.33

0.29

Poor

 

How many staff consumed vegetables in front of children

Room Leader

2 (all vs some staff)

41

88%

0.76a

0.55

0.96

Substantial

 

Did educators make positive comments about healthy foods

Room Leader

2 (yes/no)

35

86%

0.71a

0.48

0.95

Substantial

 

Did staff consume sweets, salty or sugary snacks or drinks in front of children

Room Leader

2 (yes/no)

35

94%

0.89a

0.73

1.04

Almost Perfect

Active free play

Did educators from this room participate alongside children in active play

Room Leader

2 (yes/no)

36

69%

0.39a

0.08

0.69

Fair

 

How many educators participated alongside children in active play

Room Leader

2 (all vs fewer staff)

41

61%

0.22a

−0.08

0.52

Fair

 

How often did educators join in with children in active play

Room Leader

2 (Never or Sometimes vs often or always)

40

38%

−0.06

−0.28

0.16

Poor

 

Did educators provide verbal prompts to encourage child activity

Room Leader

2 (yes/no)

35

80%

0.6a

0.33

0.87

Moderate

 

How many educators provided prompts to encourage child activity

Room Leader

2 (all vs fewer staff)

34

62%

0.24a

−0.1

0.57

Fair

Policy

         
 

Written small screen recreation policy

Nominated Supervisor

2 (yes/no)

35

89%

0.77

0.56

0.98

Substantial

 

Written physical activity policy

Nominated Supervisor

2 (yes/no)

38

79%

0.59

0.36

0.82

Moderate

 

Written nutrition policy

Nominated Supervisor

2 (yes/no)

40

75%

0.5a

0.23

0.77

Moderate

 

Written nutritional guidelines for families

Nominated Supervisor

2 (yes/no)

35

54%

0.09a

−0.25

0.42

Slight

  1. aPABAK is reported where positive agreement > =75% or < =25%.
  2. bItem required continuous response.