The development and validation of an instrument to measure the quality of health research reports in the lay media

Table 6 Generalizability coefficients generated from G study

Rater	Domain	Item	Absolute Coefficient	Relative Coefficient	Interpretation
Fixed	Fixed	Random	0.84	0.87	Internal consistency
Fixed	Random	Fixed	0.51	0.72	Inter-domain reliability
Random (2 raters)	Fixed	Fixed	0.68	0.68	Inter-rater reliability
Random (3 raters)	Fixed	Fixed	0.76	0.76	Inter-rater reliability
Random (4 raters)	Fixed	Fixed	0.81	0.81	Inter-rater reliability
Random (3 raters)	Random (main effects removed)	Random (main effects removed)	0.54		overall, adjusted for multiple (3) raters

Bolded values indicate whether absolute or relative coefficients should be interpreted

ISSN: 1471-2458