Skip to main content

Table 3 Number of items, per scale, in each kappa category of relevance and clarity in result of expert evaluation (version 0.2 and 0.3)

From: Portuguese Physical Literacy Assessment Questionnaire (PPLA-Q) for adolescents (15–18 years) from grades 10–12: development, content validation and pilot testing

Module

Element (items)

Relevance

Clarity

Kappa1

S-CVI (Ave2/UA3)

Kappa4

Elimination

Good

Excellent

Revision

Clear

1st round (version 0.2)

Cognitive

   

.87 / .60

  

  Nutrition (C1 & C2)

1

1

1

1

  Fitness and training (C3 & C4)

2

 

2

  Safety and risk (C5 & C6)

2

1

1

  Health benefits of PA (C7 & C8)

2

1

1

  Body composition (C9 & C10)

2

2

Psychological

   

.98 / .93

  

  Motivation (P1-P9, P37)

10

1

9

  Confidence (P10-P18, P38)

10

10

  Emotional Regulation (P19-P27, P39)

10

10

  Physical Regulation (P28-P36, P40)

10

1

9

Social

   

.90 / .68

  

  Culture & Society (S1-S9, S37)

1

4

5

4

6

  Ethics (S10-S18, S38)

10

10

  Collaboration (S19-S27, S39)

4

6

3

7

  Relationships (S28-S36, S40)

2

1

7

2

8

2nd round (version 0.3)

      

Social

   

.96* / .84*

  

  Culture & Society

10

5

5

  1. 1Multirater modified kappa designating agreement on relevance: κ = (I-CVI - pc)/(1 -pc), with pc (probability of a chance occurrence) computed using the formula for a binomial random variable, with one specific outcome [77];evaluation criteria for kappa [87, 88]: Elimination <.40, Fair kappa of .40 to .59; Good kappa .60 to .74; and Excellent kappa > .74
  2. 2 S-SCI/ Ave - Scale CVI Average: Calculated by averaging all I-CVI in scale/module
  3. 3 S-SCI/ UA - Scale CVI Universal Agreement: Calculated by dividing the sum of items with I-CVI of 1.0 by module’s total number of items
  4. 4Modified criteria for kappa: Needs Revision < .74; Clear > .74
  5. *Calculation included all scales of social module