The Back-care Behavior Assessment Questionnaire (BABAQ) for schoolchildren: development and psychometric evaluation

Abstract

Background

Back pain is an important public health problem and the leading cause of adult disability worldwide and is rising among schoolchildren populations. Despite numerous studies reporting on back care interventions in pediatric population; there is currently no existing theory-based instrument to assess impact and outcome of these programs. This paper reports on development and psychometric testing of a theory based back-care behavior instrument for use among elementary schoolchildren.

Methods

This was a three-phases study that included the following steps: a) a literature research to review existing instruments that assess healthy spine-related behavior in elementary schoolchildren; b) development of a new instrument namely the Back-care Behavior Assessment Questionnaire (BABAQ) based on the Social Cognitive Theory and existing instruments, and c) conducting a cross sectional study to test psychometric properties of the BABAQ by estimating the content validity ratio (CVR), the content validity index (CVI), performing confirmatory factor analysis (CFA), reliability analysis, and convergent validity as estimated by the Average Variance Extracted (AVE).

Results

First, a questionnaire (the BABAQ) was developed. It contained of 49 items tapping into 5 pre-defined constructs (skills, knowledge, self-efficacy, expectation beliefs, and behavior). Then, 610 fifth-grade female schoolchildren were entered into a cross sectional study and they completed the BABAQ. The CVR and the CVI of the questionnaire was found to be ≥0.54 and > 0.7, respectively. The CFA confirmed the five constructs and showed good fit for the data. The intraclass correlation (ICC) and the Cronbach’s alpha coefficients for the BABAQ were 0.84 (P < 0.001) and 0.93, respectively. The convergent validity as measured by the AVE also showed satisfactory results.

Conclusion

The findings suggest that the Back-care Behavior Assessment Questionnaire (BABAQ) is a valid instrument for measuring healthy spine-related behaviors among schoolchildren.

Background

Musculoskeletal disorders (MSDs), including back pain, are among the most important problems causing excessive absenteeism in the workplace, imposing high economic costs on health care systems, and suffering nearly 540 million people [1,2,3,4,5]. As described by the World Health Organization (WHO), back pain comprises low back and neck pain (mild, moderate, severe, and most severe). An individual who develops back, leg, and arm pain might thus experience difficulty dressing, sitting, standing, walking, turning one’s head, holding arms up, as well as lifting things. They might also sleep poorly, have headaches, feel tired and worried, and lose some enjoyments of life [6]. Although the burden of back pain among adults has been thus far well documented, this subject matter in children is underreported. According to the WHO statistics in 2015, back pain ranked 9th place in years living with disability in 10-to-14-year-olds and 4th in children and young adolescents aged 15–19 years, even much higher than non-communicable diseases such as cancer and anxiety disorders [7]. It is of note that the lifetime prevalence rate of low back pain (LBP) in children varies from 13 to 51% [8] and increases with age wherein a sharp rise is evident. As transition occurs from childhood to adolescence, the boundary is approximately at the age of 10–13 years. In addition, previous studies have reported higher prevalence rates among adolescent girls than boys (38.9% vs. 35.0%) [3, 9]. As such, implementation of educational interventions for back-care among children and young adolescents are increasingly becoming popular. Therefore, it is argued that measuring healthy spine-related behaviors during daily life activities among children, as a key outcome in evaluation of educational interventions for back-care, is of prime importance [10].

Up until now, a number of questionnaires have been developed for such purposes. For instance, Spence et al. [11] and Sheldon [12] introduced written and practical tests to assess pupils’ knowledge and performance with regard to correct lifting techniques among 3th, 5th, 6th, and 8th-grade public-school children. As well, Monfort et al. [1] developed and evaluated the psychometric properties of a health questionnaire on back-care knowledge in daily life physical activities (known as HEBACAKNOW), consisting of 24 items examining levels of back-care knowledge among adolescents. Similarly, Noll et al. [2] designed the Back Pain and Body Posture Evaluation Instrument (BackPEI) for schoolchildren, relevant to the evaluation of back pain and its associated behavior risk factors. In addition, Cardon et al. [13,14,15] utilized a battery of questionnaires consisting of different constructs including general and specific back-care knowledge, fear-avoidance beliefs, self-efficacy, attitudes, self-reported behaviors, practical tests, social support, program commitment, and perceived behaviors for children, parents, and teachers.

Despite the effectiveness of such questionnaires in advancing knowledge on the subject matter, none has been theory-based. In addition, some discrepancies have been also found for constructs and psychometric properties of the questionnaires introduced. In fact, assessment of back-care behavior has been scarcely investigated from the theoretical point of view and most of the previous studies have not reflected on construct validity, especially, exploratory or confirmatory factor analyses (namely, EFA and CFA).

To this end we believe that despite numerous studies reporting on back care intervention in pediatric populations [8, 11, 13, 14], there is currently no existing a theory-based measure to assess impact and outcome of these programs. Thus, this study aimed to develop a theory based back-care behavior assessment questionnaire for pupil populations attending elementary schools. The specific objectives were to evaluate: content, face, and structural validity as well as reliability of its subsections.

Methods

Theoretical framework

The conceptual framework for this study and development of an instrument was based on the Social Cognitive Theory (SCT). It has been shown that this theory has a good power to predict behavior changes especially in pupils [16]. According to the SCT, three main psychological determinants of any behavior changes are: self-efficacy (SE); behavioral capability (skills and knowledge to perform a given behavior); and outcome expectation beliefs (behavioral beliefs) [17, 18]. The proposed cognitive factors of behavior are important set of modifiable factors that are assumed to combine in different ways to determine health related behavior and distinguish between those performing and not performing behaviors [17, 18]. Therefore, we thought an instrument that intends to measure back care behavior among elementary schoolchildren should address the constructs that proposed by this theory in order to achieve the desired behavior change of back care during daily activity.

Design and procedure

This study comprised of three parts: a broad literature searches in order to review existing questionnaires for assessing of healthy spine-related behavior in elementary schoolchildren; compiling items to fulfill pre-defined constructs based on the social cognitive theory; and conducting a cross sectional study in order to validate the questionnaire among 5th-grade students attending elementary schools in Tehran, Iran.

Preliminary questionnaire

The early version of the Back-care Behavior Assessment Questionnaire (BABAQ) was developed based on the content of other existing questionnaires (Table 1). The draft instrument yielded 55 items in five predefined constructs as follows:

• 1. A checklist for practical assessment of skills for back care principles. The checklist consisted of seven tasks and 24 items. Each item is rated on a 3-point scale ranging from 0 (not fulfilling the criteria) to 2 (correct completion of the task) giving score ranging from 0 to 48 points where higher scores indicate better fulfillment of tasks [14, 19].

• 2. Back care knowledge containing 13 multiple-choice questions. Scores on this construct range from 0 to 13 where the higher scores indicate better knowledge [12,13,14, 19].

• 3. Self-efficacy subscale containing 4 items. Each item is rated on a four-point scale (from difficult to easy) giving score ranging from 4 to 16 where the higher scores indicate higher self-efficacy [10, 13].

• 4. Expectation beliefs containing 6 items. Each item is rated on a five-point scale (strongly disagree to strongly agree) giving score ranging from 6 to 30 where higher score indicate stronger beliefs [10, 13].

• 5. Back care behavior containing 8 items regarding daily activity. Response categories ranged from never (1) to ever (5) giving a score ranging from 8 to 40 where higher scores indicate better preventive behavior [10, 13].

Table 1 Description of the constructs and the related citations that served as a basis for item generation for the Back-care Behavior Assessment Questionnaire (BABAQ)

Then, content and face validity of the preliminary version of the questionnaire was assessed. To determine the content validity, a panel of 13 specialists in health education and health promotion, epidemiology and physiotherapy reviewed the questionnaire in order to estimate the content validity ratio (CVR) and the content validity index (CVI). They rated items based on three evaluation options: unnecessary, useful but unnecessary, and necessary. The CVR was then calculated via following equations for each item; CVR = (n_E – N/2) / (N/2), where n_E is the number of specialists who indicate that an item is “essential” and N is the total number of specialists. In order to determine whether to remain or discard specific questions, the CVR values of each item were then compared with the Lawshe table. In the present study, values ≥0.54 were considered reasonable to verify each item [20]. The specialists were also asked to assess the relevance of each questions to measure the CVI. To obtain the CVI value, the expert panel rated the relevance of each questions as 1 (not relevant), 2 (somewhat relevant), 3 (quite relevant), and 4 (very relevant). To this end, the CVI value was calculated using the following formula, CVI = (n/N), where n is the number of specialists who give score of 3 or 4 and N is the total number of experts [21]. Values > 70% were regarded as appropriate to verify each question according to the Lawshe. At the end of this process 4 items were removed yielding a total of 51 items. Then, qualitative method was used for face validity. A group of six 5th-grade girls were asked to examine the questionnaire and indicate whether they could read and understand the questions. As a result, 2 additional items were removed yielding a 49-item provisional version of the questionnaire. As such the total score for the BABAQ range from 16 (lowest) to 132 (highest). We assigned the following criteria to interpret the scores: high (above the third quartile, 104–132); intermediate (between the first and third quartiles, 45–103); and low (less than the first quartile, 16–44).

Psychometric evaluation

The provisional questionnaire with 49 items [Additional file 1] then was administered to a sample of female students in Tehran Iran. Since previous studies reported higher prevalence and incidence among girls than boys (38·9% vs 35·0%) [3, 9], female students were selected from district 22 where the district represents a population with a variety of socio-economic backgrounds.

Data analysis

Data was analyzed using the SPSS version 24 software; the level of significance was set at p < 0.05. The descriptive statistics was used to present the demographic characteristics of participant and self-reported back and neck pain prevalence during the last week. To assess psychometric properties of the questionnaire the following statistical procedures were applied:

Item analysis: In order to analyze the correlation of items and predefined constructs, item-total correlation analysis was performed. As such the correlation between items and hypothesized constructs was calculated using the Pearson correlation coefficient.

Structural validity

Confirmatory factor analysis (CFA) was conducted to investigate predefined construct of the BABAQ (see Table 1). The CFA is the best method for evaluating the structural validity of an instrument when there is a theoretical approach to analyze the instrument with specified constructs and for the direct representation of a hypothesized factor model, leading to a measure of model fit [21,22,23,24]. Since, in most forms of factor analysis, the assumption is made that the items follow a normal distribution [25] and in this study data were normally distributed, thus for estimation method, maximum likelihood (ML) estimator was applied. To test the goodness-of-fit of the model, the Comparative Fit Index (CFI), Root Mean Squared Error of Approximation (RMSEA), and Standard Root of Mean Square Residual (SRMR) were examined. The data was analyzed using LISREL 8.80 to test for significance of item loadings on each relating factor, and to evaluate overall model fit intended by the SCT framework. The following values were considered acceptable for the model fit: χ2/df < 5, CFI > 0.95, RMSEA < 0.10, SRMR < 0.08 [21]. We also used the Average Variance Extracted (AVE) statistic in order to test the convergent validity of the constructs. The AVE values above 0.50 shows adequate convergent validity.

Reliability

Internal consistency was estimated using the Cronbach’s alpha coefficient. The value of 0.70 or above was considered satisfactory [26]. The test-retest reliability also was used to examine stability by calculating intraclass correlation coefficient (ICC). A sample of 50 students who did not participate in the main study completed the questionnaire twice within 2 weeks’ interval. The ICC also used to evaluate inter-rater reliability on each group of items for the practical skill domain as rated by two independent and trained raters. Values higher than 0.70 considered excellent agreement [14]. In addition, we estimated the standard error of measurement (SEM). The standard error of measurement (SEM = SD × $\sqrt{1- ICC}$) is an estimate of the amount of error in a test and is directly related to a test’s reliability. The larger the SEM, the lower the test’s reliability. Furthermore, minimal detectable change (MDC) for the BABAQ was calculated. The minimal detectable change (MDC = 1.96 × SEM × $\sqrt{2}$) is the lowest change in the BABAQ score, that ensures the change is not a result of measurement error.

Results

Participants

In all, 610 5th-grade girls participated in the study; 50.3% of the participants (n = 307) were the only child in family, 74.1% of their father (n = 452) and 73.9% of their mother (n = 451) had secondary and higher education, respectively; about a quarter of students (n = 144) reported back pain during last week. The demographic characteristics of the pupils are shown in Table 2.

Table 2 Demographic characteristics of pupils in CFA step (n = 610)

Item-total correlation

The correlation between items and predefined constructs are presented in Table 3. As shown the correlation between items and its own predefined construct was satisfactory.

Table 3 Item-total correlation matrix for the BABAQ indicating the correlation between items and predefined constructs

Structural validity

The results obtained from confirmatory factor analysis for the BABAQ were as follows: Chi-Square = 3921.78, df = 1117 (χ2/df = 3.51, P = 0.53), CFI = 0.97, RMSEA = 0.091 (P < 0.001), and SRMR = 0.078. Figure 1. shows the factor weighting value results in the standard estimation mode.

Fig. 1

The results ontained form confirmatory factor analysis for the BABAQ

Reliability

The Cronbach’s alpha coefficients for all subscales were high ranging from 0.93 to 0.97. The intraclass correlation coefficient of the four self-reported subscales of the BABAQ ranged from 0.76 to 0.83. Table 4 represents the Cronbach’s alpha coefficients, ICC values, SEM, and MDC for the questionnaire.

Table 4 Descriptive statistics, Cronbach’s alpha coefficient, ICC, SEM, and MDC for the BABAQ

Convergent validity

The calculated Average Variance Extracted (AVE) values for skills, knowledge, self-efficacy, beliefs, and behavior were 0.54, 0.73, 0.79, 0.49, and 0.86 respectively indicating adequate convergent validity, although expectation beliefs had AVE value close to 0.50. In addition, we estimated values for the skills subscale inter-rater agreement (Table 5).

Table 5 Intraclass correlation coefficient for Skills (checklist) inter-rater agreement (n = 50)

Discussion

This study is a modest contribution to ongoing discussions on development and psychometric testing of the Back-Care Behavior Assessment Questionnaire (BABAQ) among 5th-grade girls in some Iranian elementary schools. Particular attention is thus paid to measure validity and reliability of the BABAQ sub-scales. For a few reasons, this study has a novel approach and is important. First, the originality of this study lies in the fact that it is a theory-based instrument in evaluating healthy spine-related behaviors in pupils. It is also significant because the BABAQ can provide the opportunity to assess behaviors and their determinants according to the Social Cognitive Theory (SCT). As such, the instrument developed might help create a theory-based intervention in order to change unsafe behaviors among pupils. Secondly, the psychometric properties of the BABAQ are evaluated while four groups including the research team (academics), the 5th-grade girls, their teachers, and health specialists are involved. Thirdly, to the best of authors’ knowledge, this is the first attempt reporting on construct validity of an instrument for back pain prevention, employed for evaluating education programs.

Content validity verification in this study indicated that three items associated with knowledge section including ‘Who is sitting the best way’, ‘If you have to move equipment in the gym, you should ...’, and ‘Which posture is the best?’ had no acceptable values. As well, one item related to behavior section, i.e., ‘No twisting while moving heavy objects’ had the same conditions. Accordingly, all the mentioned items removed from the final version. The panelists also believed that these items were irrelevant. However, these results are in good agreement with Dolphens et al., using almost similar items in their questionnaires [9].

The further contribution of this study is recruiting construct validity and CFA to test multiple variables, while there was a theoretical framework [20]. Moreover, various indicators such as the Chi-square (χ2)/degree of freedom (df) ratio, the comparative fit index (CFI), the standardized root mean square residual (SRMR), and the root mean square error of approximation (RMSEA) RMSEA verified the fitness of the models. In addition, the findings demonstrated that each of the five sub-scales in the BABAQ had appropriate fit within the SCT framework.

Empirical results from the Cronbach’s alpha, test-retest, and inter-rater reliability also confirmed that the BABAQ showed acceptable internal consistency (ranged from 0.93 to 0.97) within the five sub-scales, providing reliable results over repeated administrations (ranged from 0.76 to 0.83), and producing significant inter-rater agreement (ranged from 0.73 to 0.95) at the 5th-grade level. Likewise, the higher values of the BABAQ scores were associated with greater standard deviations (SDs) (expected knowledge), accounting for the remarkably higher standard error of measurement (SEM) scores for each sub-scale. The higher scores for the BABAQ could be due to the small sample size in this study. In previous studies, the reliability of the questionnaires had been assessed only from the aspect of test-retest stability and internal consistency. For example, Cardon et al. had evaluated different instruments, based on previous literature, indicating reliability ranged from 0.42 to 0.82 [13]. Cronbach’s alpha coefficient of the expectation beliefs was also 0.70 and other intended sections were not applicable in the present study. In order to verify face and content validity, 150 children, 20 parents, and 10 teachers had completed the questionnaire to identify unclear items, which had been then modified. Moreover, they had not used panelists. Inter-rater reliability results in the present study are accordingly in relative agreement with the findings reported by Cardon et al., obtaining the intra-class correlation coefficient (ICC) to determine inter-rater agreement on the sum scores of the practical test items, ranged from 0.785 to 0.980 [14]. Other results were also better than previous studies.

It is argued that the BABAQ is suitable for a wide variety of potential applications to measure back-care behaviors and their main determinants among the 5th-grade girls. One unique feature of the BABAQ is the reliability and validity of its sub-scales, which contain back-care skills and knowledge, self-efficacy towards proper back-care behaviors, expectation beliefs, and healthy spine-related behaviors. These sub-scales may be measured, evaluated, and modified by potential change strategies, thereby providing back pain prevention and ultimately back health promotion.

Limitations

In this study, there are limitations that must be noted. First, data were only collected from the 5th-grade girls’ population attending public elementary school in capital Tehran’s region 22; and other independent elementary schools, grades, as well as male pupils didn’t enroll to study; therefore, the generalizability of outcomes to the overall population may be limited. In addition, due to decrease recall bias, back pain report was limited within the last week. Subscales of the BABAQ were limited to main psychological determinants of behavior in SCT and the other constructs (environmental determinants of behavior), in other to decrease the questions’ burden on participants, didn’t use. In skills items construct validity verification phase, sample was limited to fewer population because difficulty of assessing. However, future studies should test CFA with an adequate number of participants. Despite these limitations that have been explained, the BABAQ is a valid and reliable instrument to measure healthy spine-related behavior in girls as young as 11 years of age.

Conclusion

The Back-care Behavior Assessment Questionnaire (BABAQ) demonstrated to be a valid instrument to measure healthy spine-related behavior including behavioral capability (skills and knowledge), self-efficacy, expectation beliefs and performance spine. Future attempts should focus on to assess whether the BABAQ is applicable in diverse pupils’ populations.