Skip to main content

Reliability and validity of the Chinese version of the achievement emotions questionnaire for physical education in university students

Abstract

Background

Achievement emotions have a significant impact on both the learning process and outcomes. However, there is currently no brief and effective questionnaire available to evaluate Chinese university students' achievement emotions in physical education courses. This study aimed to examine the reliability and validity of the Achievement Emotions for Physical Education Questionnaire (AEQ-PE) in a sample of Chinese university students, while also investigating its measurement invariance across gender and grade levels.

Methods

A cluster randomization sampling method was used to select 694 first- and second-year university students in Shanghai, China for the survey. Descriptive statistics, item analysis, reliability testing, and measurement invariance testing were conducted on the full sample (n = 694). Subsequently, the full sample was randomly divided into two groups, with Sample 1 (n = 347) undergoing exploratory factor analysis (EFA), and Sample 2 (n = 347) undergoing confirmatory factor analysis (CFA) to test the structural validity, convergent validity, and discriminant validity of the Chinese version of the Achievement Emotions Questionnaire for Physical Education (AEQ-PE-C). Finally, Sample 3 (n = 45), which was retested one month later, was used to evaluate test–retest reliability.

Results

The Chinese version of the Achievement Emotions Questionnaire for Physical Education consists of 6 dimensions and 24 items, with good item discrimination. The EFA supported a 6-factor structure model, while the CFA demonstrated good model fit indices (χ2/df = 3.086, CFI = 0.928, TLI = 0.916, RMSEA = 0.078) and good convergent and discriminant validity. The questionnaire exhibits high internal consistency reliability (0.794) and excellent test–retest reliability (0.792). Furthermore, the multi-group analysis confirms that the AEQ-PE-C questionnaire has measurement invariance across gender and grade levels.

Conclusion

The Chinese version of the Achievement Emotions Questionnaire for Physical Education has good reliability and validity, as well as measurement invariance across gender and grade levels, making it an effective tool for measuring achievement emotions in physical education among Chinese university students.

Peer Review reports

Introduction

Emotions are widely recognized as a crucial factor influencing individuals' behavior and are significantly associated with complex psychological processes such as cognition, motivation, and attitude [1, 2]. The term emotion is defined as an organism's attitudinal experience that reflects the relationship between objective things and the subject's needs [3]. In 1998, the American Educational Research Association held a workshop on "The Role of Emotion in Student Learning and Achievement," which set the stage for subsequent research on the use of emotion in pedagogy. Since then, researchers have increasingly focused on students' achievement emotions [4].

The concept of achievement emotions was first defined in 2002 by the German psychologist Pekrun et al., who stated that achievement emotions is emotions directly linked to school learning, classroom instruction, and academic achievement [5]. Achievement emotions is typically intense and can cause significant effects on students' attention, motivation, use of learning strategies, self-regulation of learning, and academic performance [6,7,8]. In addition, Pekrun et al. proposed the Control-Value Theory of Achievement Emotions (CVTAE), which extends the categories of achievement emotions and provides a comprehensive framework for analyzing the emotions experienced in learning contexts. To gain an accurate understanding of students' achievement emotions, it is essential to use valid and reliable measurement questionnaires [9]. Based on the CVTAE, the Achievement Emotions Questionnaire (AEQ) was designed by Pekrun in 2005 [10]. This questionnaire has been widely discussed and applied in several countries and regions worldwide [11,12,13].

However, as research deepens, it has been found that achievement emotions manifest differently in various subjects. Research conducted by Goetz et al. indicates a weak and inconsistent relationship among the academic emotions experienced by students in mathematics, physics, German, and English subjects [14]. Therefore, AEQ was developed by later scholars as a tool to measure students' emotions in different subjects, such as the Academic Emotions Questionnaire-Mathematics (AEQ-M) [15] and the Achievement Emotions Questionnaire-Foreign Language Class (AEQ-FLC) [16]. As a unique subject, physical education places a dual changes on students, demanding both mental and physical engagement. Consequently, emotions experienced during physical education learning exhibit greater depth and breadth than those experienced in other subjects. In recent years, there has been a growing body of international research focused specifically on the study of achievement emotions in physical education [17,18,19].

Currently, regarding the measurement of achievement emotions in physical education, Trigueros et al. have developed The Scale of Emotions in Physical Education (SEPE) through expert survey methods, which includes 8 categories of emotions with a total of 40 items [20]. However, this scale lacks theoretical support and does not provide a clear explanation of the inherent logical relationships between the indicators included in the scale. Simonton et al. have revised the AEQ questionnaire for physical education to create the Discrete Emotions in Physical Education Scale (DEPES), which focuses solely on three categories of negative emotions—boredom, shame, and anger—without accounting for positive emotions [21]. Notably, Fierro-Suero et al. have revised the AEQ questionnaire to form the Achievement Emotions Questionnaire for Physical Education (AEQ-PE), which comprises 24 questions and encompasses six emotions: pride, enjoyment, anger, anxiety, hopelessness, and boredom [22]. Each emotion can be further divided into three dimensions. The first dimension is valence, which categorizes emotions into positive and negative, such as enjoyment as a positive emotion and anxiety as a negative emotion. The second dimension is arousal level, which divides emotions into high and low arousal levels, such as high arousal positive emotions (enjoyment and pride). The third dimension is object focus, which divides emotions into activity emotions and outcome emotions. Outcome emotions include prospective outcome emotions (hope and anxiety) and retrospective outcome emotions (pride). The AEQ-PE has been translated into multiple languages (including Spanish, English, and Malay) and has been shown to have good reliability and validity in several countries [19, 22, 23].

China has a vast number of university students, with the current number of university students exceeding 44.3 million, constituting one-fifth of the total number of university students worldwide [24]. According to the "Basic Standards for Physical Education in Higher Education Institutions" issued by the Chinese Ministry of Education, first- and second-year undergraduate students are required to take at least 144 h of physical education courses, with a minimum of 2 h per week and no less than 45 min per class [25]. Despite such a huge teaching group for physical education courses in Chinese universities, there is currently no brief and effective questionnaire available to evaluate the achievement emotions of university students in physical education courses. So far, the only questionnaire that measures achievement emotions in Chinese physical education classes is the General College Student Physical Education Achievement Emotion Scale revised by Yang based on the AEQ questionnaire, which comprises a total of 56 questions [26]. While this scale provides a comprehensive evaluation of achievement emotions in physical education, its limitations are also apparent. For instance, the large number of questions may result in longer response times, leading to response fatigue and bias, and may also reduce response rates. This may be one of the reasons why the questionnaire has not been widely adopted.

In summary, this study takes the AEQ-PE questionnaire developed by Fierro-Suero as its benchmark. It examines the reliability and validity of Chinese version of the Achievement Emotions Questionnaire for Physical Education (AEQ-PE-C) and explores its measurement invariance across gender and academic years. Based on this, the study proposes the following hypotheses: the revised AEQ-PE-C questionnaire demonstrates strong applicability and effectiveness, serving as a robust tool for in-depth investigation of Chinese university students' academic emotions in physical education. This questionnaire can provide researchers with a preliminary understanding of academic emotions in sports and lay the foundation for subsequent relevant academic research. Through the utilization of this questionnaire, physical education teachers and researchers can gain profound insights into university students' academic emotional states, enabling targeted adjustments of pedagogical strategies based on different emotional characteristics, thereby significantly enhancing the effectiveness of education.

Methods

Participants

In China, Physical education classes are mandatory for first- and second-year undergraduate students. Therefore, first- and second-year undergraduate students in Shanghai were selected as the target population for this study. The survey questionnaire was designed using the online platform "Wenjuanxing," which is the functional equivalent of the Amazon Mechanical Turk platform. We employed a cluster randomization sampling method within classes and distributed the questionnaire via a combination of online and offline methods from October to November 2022. The exclusion criteria for the questionnaire included non-freshman and sophomore students, missing data values, and regularity or continuity in responses. A total of 707 questionnaires were collected, of which 13 were invalid and excluded from the analysis. Finally, 694 valid questionnaires were included, with a valid response rate of 98.16%. The study protocol adhered to the guidelines of the Declaration of Helsinki and was approved by the Science and Technology Ethics Committee of Shanghai Jiao Tong University. All participants completed the questionnaires voluntarily.

To meet the requirements of data analysis, the full sample data of subjects (n = 694) was randomly divided into two parts: sample 1 (n = 347) and sample 2 (n = 347). Additionally, 50 subjects from the full sample were randomly selected for a test–retest of the questionnaire after a one-month interval. Following the elimination of invalid questionnaires, 45 matched pairs of data were obtained to form sample 3.

Instruments

The Achievement Emotions Questionnaire for Physical Education (AEQ-PE) was developed by Fierro-Suero et al. [22]. It comprises 24 items divided into 6 categories of achievement emotions, including enjoyment, pride, anger, anxiety, hopelessness, and boredom, each encompassing 4 items. The questionnaire utilizes a 5-point Likert scale, ranging from 1 (completely disagree) to 5 (completely agree), to score responses. Higher scores in the categories of enjoyment and pride indicate a greater degree of positive emotions, while higher scores in the categories of anger, anxiety, hopelessness, and boredom suggest a higher degree of negative emotions.

Translation procedure

The AEQ-PE questionnaire was initially translated into Chinese by two graduate students proficient in both Chinese and English, and with a background in sports science. During the translation process, these two students actively sought guidance from professional translators. When necessary, they engaged in consultations and discussions to ensure the accuracy of each translation. Subsequently, a professor of psychology and a professor of physical education were consulted to refine the language presentation and account for cultural differences. To ensure accuracy and consistency, native English-speaking international students were then invited to back-translate the Chinese version into English, and each item was compared with the original English version. This rigorous process determined the accuracy of the AEQ-PE-C presentation, and the final version of the questionnaire was completed.

Statistical analysis

The data collected were analyzed using statistical analysis software, specifically SPSS 26.0 and AMOS 23.0.

In the full sample (n = 694), descriptive statistics were conducted to analyze the participants' demographic characteristics and scores on each questionnaire item. The item analysis first calculates the correlation coefficient between each item and the total score, with a minimum critical value of r ≥ 0.4. Subsequently, using the total score sorting method, the top 27% of scores are categorized as the high-score group, and the lowest 27% as the low-score group. Following this, an independent two-tailed t-test is conducted. If the scores of each item in both groups reach a significant level, it is considered as indicating a good discriminant validity [27]. Cronbach alpha coefficients were calculated to test the questionnaire's internal consistency. Hair et al. (1988) suggested that a Cronbach's alpha coefficient greater than 0.7 indicates high reliability of the questionnaire [28]. Additionally, a series of nested models were constructed in Amos 23.0 to test the measurement invariance of the questionnaire across gender and grade levels.

In sample 1 (n = 347), Kaiser–Meyer–Olkin (KMO) values and Bartlett's sphericity test were utilized to assess the suitability of the data for factor analysis. The assessment criteria are a Kaiser–Meyer–Olkin (KMO) value greater than 0.60 and the significant result of the Bartlett's test of sphericity [29, 30]. Exploratory factor analysis (EFA) was then conducted to initially test the factor structure and factor loading of the questionnaire.

In sample 2 (n = 347), we conducted Confirmatory Factor Analysis (CFA) to assess the construct validity of the questionnaire. The criteria for evaluating the fit of construct models are as follows: the chi-square degree of freedom (χ2/df) should be less than 5, indicating reasonable fit; the Comparative Fit Index (CFI) and Tucker Lewis Index (TLI) should both exceed 0.9, signifying good fit; the Standardized Root Mean Square Residual (SRMR) is considered good if values are below 0.08; and the Root Mean Square Error of Approximation (RMSEA) should not exceed 0.08 for well-fitted models [31,32,33]. Convergent validity of the model was assessed through two measures, namely Average Variance Extracted (AVE) and Construct Reliability (CR). According to Fornell and Larcker (1981), AVE > 0.50 and CR ≥ 0.70 are considered acceptable [34]. To assess the discriminant validity of the model, the square root of the Average Variance Extracted (AVE) was used. If the square root of the AVE of a factor is greater than the correlation coefficient of that factor with all other factors, it indicates good discriminant validity [35, 36].

In sample 3 (n = 45), we utilized the intra-class correlation coefficient (ICC) to evaluate the test–retest reliability of the questionnaire. An ICC above 0.7 is generally considered to indicate good test–retest reliability of the questionnaire [37]. This analysis aimed to determine the stability and consistency of scores obtained from the questionnaire across various time points.

Results

Descriptive statistics

Table 1 provides an overview of the demographic characteristics of the study participants, including gender, Ethnical groups, registered residence, and grade. Meanwhile, Table 2 presents the Mean (SD) scores for each subdomains and items of the AEQ-PE-C questionnaire.

Table 1 Demographic characteristics of the participants (n = 694)
Table 2 Mean (SD) scores for each subdomains and items of the AEQ-PE-C (n = 694)

Item analysis

After reversing the scores for the items related to boredom, hopelessness, anxiety, and anger, an item-to-total score correlation analysis was conducted. The findings indicated a significant correlation between each item and the total score, with correlation coefficients ranging from 0.54 to 0.79 (p < 0.001). Furthermore, independent sample t-tests were conducted for the high and low groups, revealing significant differences in scores for all items (p < 0.001). These results suggest that the AEQ-PE-C items were well-discriminated, as illustrated in Table 3.

Table 3 Results of item analysis (n = 694)

Exploratory factor analysis

To examine the factor structure and factor loading of the data from sample 1 (n = 347), exploratory factor analysis (EFA) was conducted. The results in Table 4 indicate that the Kaiser–Meyer–Olkin (KMO) value was 0.945, and the Bartlett's sphericity test was significant (χ2 = 6326.614, df = 276, p < 0.001). These findings demonstrate that the data meet the necessary requirements for factor analysis, as the KMO value exceeds the recommended criterion of 0.6, and the Bartlett's sphericity test is significant.

Table 4 KMO values and Bartlett's spherical test of the questionnaire (n = 347)

Given that the AEQ-PE-C measures six dimensions of achievement emotions, we initially extracted six common factors to ensure consistency between the Chinese version of the questionnaire and the original version. Principal component analysis was then performed, revealing that the cumulative variance explained by the six common factors with eigenvalues greater than 1 was 79.157% (see Appendix 1). Subsequently, the maximum variance method was used to orthogonal rotate the factors, and the overall factor loadings of the questionnaire ranged from 0.532 to 0.848. Specific factor loadings for each dimension were as follows: pride (dimension 1) = 0.805–0.846; enjoyment (dimension 2) = 0.699–0.797; anger (dimension 3) = 0.650–0.812; anxiety (dimension 4) = 0.613–0.803; hopelessness (dimension 5) = 0.532–0.684; boredom (dimension 6) = 0.758–0.848 (see Appendix 2 for detailed results). It is important to note that the EFA output differed from the expected factor structure, as the two dimensions of pride and enjoyment, constructed by the original questionnaire, converged into one dimension. However, given the definition of both emotions, the two dimensions are somewhat distinct. Therefore, we conducted EFA again for both emotions by extracting two fixed factors. The results showed that the four items related to pride (factor loadings:0.682–0.854) and the four items related to enjoyment (factor loadings:0.722–0.853) loaded onto the two dimensions respectively, which was consistent with the expected structure (see Appendix 3). Thus, we chose to retain the original 6-factor model.

Confirmatory factor analysis

In order to test the validity of the AEQ-PE-C (Fig. 1), a first-order six-factor confirmatory factor analysis model was constructed using the data from sample 2 (n = 347). The fit indices of the model were analyzed and found to meet the statistical criteria, indicating that the model was a good fit and demonstrated good construct validity for the AEQ-PE-C. Please refer to Table 5 for further details.

Fig. 1
figure 1

First-order six-factor structural model

Table 5 Fitting indicators of the first-order six-factor structural model (n = 347)

Convergent and discriminant validity

As shown in Table 6, the factor loadings of the items corresponding to the six factors of pride, enjoyment, anger, anxiety, hopelessness, and boredom exceeded 0.6, indicating high representativeness of the items. Furthermore, all six dimensions had AVE values (ranging from 0.606 to 0.834) greater than 0.5 and CR values (ranging from 0.859 to 0.953) greater than 0.7, indicating ideal convergent validity of the AEQ-PE-C.

Table 6 Convergent validity of the AEQ-PE-C model (n = 347)

As shown in Table 7, significant correlations were found among the six dimensions of pride, enjoyment, anger, anxiety, hopelessness, and boredom (p < 0.001). Furthermore, the absolute values of the correlation coefficients were all less than 0.5 and were all less than the corresponding square root of AVE. These results demonstrate a good degree of discrimination among the dimensions, indicating that the AEQ-PE-C has ideal discriminant validity.

Table 7 Discriminant validity of the AEQ-PE-C model (n = 347)

Reliability analysis

To evaluate the reliability of the AEQ-PE-C, two indicators were used: internal consistency reliability (Cronbach's alpha) and test–retest reliability (intra-class correlation coefficient, ICC). The Cronbach's alpha coefficients for the six dimensions of the AEQ-PE-C ranged from 0.853 to 0.952, with an overall Cronbach's alpha coefficient of 0.794. Furthermore, the reliability of each individual item ranges from 0.770 to 0.811, as detailed in Appendix 4. These results demonstrate good internal consistency reliability of the AEQ-PE-C. Additionally, test-retesting 45 subjects one month after the initial test revealed an ICC of 0.792 for the total questionnaire and between 0.690 and 0.828 for each of the six dimensions. These results suggest that the AEQ-PE-C has good test–retest reliability. Please refer to Table 8 for further details.

Table 8 Internal consistency reliability and test–retest reliability of AEQ-PE-C

Measurement invariance testing

The test followed four progressively more stringent steps (configural invariance, metric invariance, scalar invariance, and strict invariance), as outlined in Table 9. Measurement invariance was determined based on the amount of variation in Comparative Fit Index (CFI) and Root Mean Square Error of Approximation (RMSEA) between models. Specifically, a difference of less than 0.01 in both CFI and RMSEA (|ΔCFI|< 0.01 and |ΔRMSEA|< 0.01) indicates invariance [38].

Table 9 AEQ-PE-C measurement invariance fit indices and model comparison results (n = 694)

The cross-gender invariance test was conducted in four steps. First, a structural equivalence model (configural invariance) was established, and the fit indices of this model reached an acceptable level, satisfying the conditions for conducting the invariance test. Second, a factor loading equivalence model (metric invariance) was established, and the difference values between model 2 and model 1 (ΔCFI = 0 and ΔRMSEA = 0.001) were less than the standard values, confirming the factor loading cross-gender equivalence. Third, an intercept equivalence model (scalar invariance) was constructed and compared with model 2, with the difference values (ΔCFI = 0.006 and ΔRMSEA = 0.001) smaller than the standard values, indicating that the assumption of intercept cross-gender equivalence was valid. Finally, a residual equivalence model (strict invariance) was constructed and compared with model 3, and the difference values (ΔCFI = 0.007 and ΔRMSEA = 0.001) were both smaller than the standard value, indicating that the residual cross-gender equivalence holds. These results suggest that the AEQ-PE-C six-factor model has measurement invariance between groups of different genders.

Similarly, in the cross-grade invariance test, we established four models to evaluate the measurement invariance of the AEQ-PE-C six-factor model across different grade groups. The first model, the structural equivalence model 1, showed good fit indices and met the requirements for the invariance test. The second model, the factor loading equivalence model 2, confirmed that the cross-grade equivalence of factor loadings held as the difference values between model 2 and model 1 were smaller than the standard values (ΔCFI = 0.001 and ΔRMSEA = 0.001). The third model, the intercept equivalence model 3, demonstrated that the assumption of intercept equivalence across grades was valid, as the difference values were smaller than the standard value (ΔCFI = 0.006 and ΔRMSEA = 0.001). Finally, the fourth model, the residual equivalence model 4, showed that the residual cross-grade equivalence held as the difference values were smaller than the standard value (ΔCFI = 0.004 and ΔRMSEA = 0). These results indicate that the AEQ-PE-C six-factor model has measurement invariance across grade groups.

Discussion

This study aimed to translate and revise the AEQ-PE questionnaire, resulting in the development of a brief Chinese version of the Achievement Emotions Questionnaire for Physical Education (AEQ-PE-C) suitable for Chinese university students. Furthermore, we conducted reliability and validity tests on the AEQ-PE-C questionnaire and assessed its measurement invariance across gender and grade groups.

The results of the study indicated that the AEQ-PE-C had good item discrimination. The overall questionnaire, its six dimensions, and individual items all exhibit good performance in terms of internal consistency, indicating strong reliability. Additionally, the questionnaire also demonstrated good test–retest reliability over a one-month interval, indicating its good temporal stability. The revised AEQ-PE-C questionnaire consisted of 24 items across six dimensions, including pride, enjoyment, anger, anxiety, boredom, and hopelessness. The dimensions and corresponding items of the AEQ-PE-C were consistent with the original scale. However, it should be noted that during exploratory factor analysis, the pride and enjoyment dimensions were grouped into the same factor. Although both pride and enjoyment are positive emotions, based on the control-value theory upon which the original scale was constructed, pride is considered a retrospective outcome emotion, while enjoyment is defined as an activity emotion with a different object focus [39]. Simultaneously, within China's social values and emotional expression, enjoyment is often closely associated with positive emotional experiences, inner joy, and a liking for the activity itself. In contrast, pride in Chinese culture places a stronger emphasis on an individual's sense of achievement, performance, or behavior, giving rise to feelings of pride and self-assurance. Given these distinctions, we employed the expert consultation method, seeking experts' opinions on separating these two dimensions, which received validation. Therefore, we subsequently conducted exploratory factor analysis on the enjoyment (four items) and pride (four items) dimensions, and the results showed that each item loaded onto its corresponding dimension. Consequently, we continued to use the six-factor structure in subsequent analyses. Given that EFA is primarily employed for preliminary data analysis, subsequently, we conducted CFA to revalidate the model's factor structure. Concurrently, we assessed convergent validity by calculating AVE values and CR values, while also examining discriminant validity using the square root of AVE. The research findings indicate that the questionnaire demonstrates a favorable level of structural validity. As a result, the AEQ-PE-C can be considered an effective tool for assessing the achievement emotions of physical education among Chinese university students.

The recent revision of the Malaysian version of the AEQ-PE questionnaire mentioned, among the limitations, that future revisions of this questionnaire should consider invariance testing to provide further evidence for the questionnaire's validity [23]. As such, another significant contribution of this study was to investigate whether the AEQ-PE-C maintained the same meaning and underlying structure across various groups, including gender and grade level. The study results indicate that the AEQ-PE-C exhibits gender measurement invariance, which was established after conducting a series of tests. Firstly, the model constructed separately with data from male and female participants demonstrated equivalent structural relationships between the six dimensions of the AEQ-PE-C and their corresponding items. This is a prerequisite for meaningful subsequent steps in the measurement invariance test. Secondly, the relationship between the measurement items and the dimensions of the AEQ-PE-C is equivalent across gender groups, indicating that males and females have a consistent understanding of the construct. Thirdly, the intercept between observed variables is invariant, which implies that males and females have the same systematic tendency to understand the content of the measure. Fourthly, the residual equivalence of individual terms between the two groups suggests that the actual scores of the test variables are consistent between males and females. Additionally, cross-grade measurement invariance for the AEQ-PE-C was also demonstrated across different grades. Therefore, the revised questionnaire in this study can be used to examine the characteristics of achievement emotions in physical education among Chinese university students across genders and grade levels.

Compared to the revised "General College Student Physical Education Achievement Emotion Scale" by Li Yangyang, the AEQ-PE-C questionnaire used in this study has fewer items, making it more convenient to use and saving time and effort. Additionally, following the validation and reliability testing, this questionnaire underwent tests for measurement invariance across different grade levels and genders, as well as a test for temporal stability. These characteristics provide a brief and effective measurement tool for assessing academic emotions in physical education instruction.

Currently, numerous international studies have demonstrated that achievement emotions in physical education play a crucial role in the curriculum and learning experience [40,41,42]. According to a study, pride, enjoyment, and hopelessness are the primary emotions that explain physical activity intentions, while enjoyment and boredom significantly impact academic performance [19]. Another study has highlighted the significant correlation between students' achievement emotions in physical education and their classroom participation [43]. Therefore, the revised AEQ-PE-C questionnaire holds educational significance for physical education instructors and researchers in various aspects. It allows researchers to gain a preliminary understanding of the domain of academic emotions in physical education, providing a foundation for future explorations into influencing factors, mechanisms, and related aspects. The questionnaire can accurately capture each student's emotional states and needs, offering personalized guidance and support. Moreover, it enables insight into students' emotional requirements during physical education classes, assisting them in better recognizing, understanding, and managing negative emotions. This ultimately enhances their mental well-being and enriches their experiences in physical activities. Additionally, the questionnaire allows for the comprehension of changes in student emotions. It assists instructors in optimizing course design and teaching methods, ultimately contributing to the creation of a positive and efficient learning environment.

There are several limitations to this study. Firstly, the survey population is limited to university students in Shanghai, China, and may not fully represent the situation of Chinese university students as a whole. Future studies should aim to expand the sample to include university students from other regions in China. Secondly, the reliability analysis of the AEQ-PE-C questionnaire was based on a small sample size of only 45 subjects who participated in the test–retest. As a result, the reliability of the study results may be compromised. Future studies should consider increasing the sample size of subjects to improve the reliability of the study results. Thirdly, this study employed a cross-sectional research design. In the future, a longitudinal approach could be adopted to accurately explore individual emotions related to physical education and their evolving processes, thereby offering more targeted and practical guidance for physical education instructors. Fourthly, the sample of this study exhibited a relatively low representation of females, ethnic minorities, individuals from rural backgrounds, and sophomore students. This could potentially undermine the extent to which these findings can be applied to these specific demographic groups. Hence, it is recommended that future research endeavors incorporate additional validation measures.

Conclusion

The Chinese version of the Achievement Emotions Questionnaire for Physical Education (AEQ-PE-C) consists of 6 dimensions and 24 items. The questionnaire has demonstrated good reliability and validity and exhibits measurement invariance across both gender and grade groups, making it an effective tool for measuring achievement emotions related to physical education among Chinese university students.

Availability of data and materials

The datasets used and/or analyzed during the current study available from the corresponding author on reasonable request.

References

  1. Scherer KR. The dynamic architecture of emotion: Evidence for the component process model. Cognition Emotion. 2009;23(7):1307–51. https://doi.org/10.1080/02699930902928969.

    Article  Google Scholar 

  2. Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev. 1977;84(2):191. https://doi.org/10.1037/0033-295X.84.2.191.

    Article  CAS  PubMed  Google Scholar 

  3. Ling CD, Yang ZL, Huang XT. The Comprehensive Dictionary of Psychology. Shanghai: Shanghai Educational Publishing House; 2003.

    Google Scholar 

  4. Schutz PA, Lanehart S. Emotions in education. Educ Psychol-US. 2002;37(2):67–8.

    Article  Google Scholar 

  5. Pekrun R, Goetz T, Titz W, Perry RP. Academic emotions in students’ self-regulated learning and achievement: A program of qualitative and quantitative research. Educ Psychol-US. 2002;37(2):91–105. https://doi.org/10.1207/S15326985EP3702_4.

    Article  Google Scholar 

  6. Pekrun R. Emotion and achievement during adolescence. Child Dev Perspect. 2017;11(3):215–21. https://doi.org/10.1111/cdep.12237.

    Article  Google Scholar 

  7. Pekrun R, Stephens EJ. Achievement emotions: A control-value approach. Soc Personal Psychol. 2010;4(4):238–55. https://doi.org/10.1111/j.1751-9004.2010.00259.x.

    Article  Google Scholar 

  8. Pekrun R. The control-value theory of achievement emotions: assumptions, corollaries, and implications for educational research and practice. Educ Psychol Rev. 2006;18:315–41. https://doi.org/10.1007/s10648-006-9029-9.

    Article  Google Scholar 

  9. Crossman J. The role of relationships and emotions in student perceptions of learning and assessment. High Educ Res Dev. 2007;26(3):313–27. https://doi.org/10.1080/07294360701494328.

    Article  Google Scholar 

  10. Pekrun R, Goetz T, Perry RP. Achievement emotions questionnaire (AEQ). User’s manual. Unpublished Manuscript, University of Munich, Munich. 2005.

  11. Zhao SY, Cai TS. Reliability and validity of AEQ in Chinese version. Chin J Clin Psychol. 2012;20(04):448–50+7. https://doi.org/10.16128/j.cnki.1005-3611.2012.04.024.

    Article  Google Scholar 

  12. Azad Abdolahpour M, Dortaj F, Ahadi H. Evaluation of factorial structure of the achievement emotions questionnaire (AEQ) among Iranian students. Educ Meas Eval Stud. 2015;4(8):161–86.

    Google Scholar 

  13. Peixoto F, Mata L, Monteiro V, Sanches C, Pekrun R. The achievement emotions questionnaire: validation for pre-adolescent students. Eur J Dev Psychol. 2015;12(4):472–81. https://doi.org/10.1080/17405629.2015.1040757.

    Article  Google Scholar 

  14. Goetz T, Frenzel AC, Pekrun R, Hall NC, Lüdtke O. Between-and within-domain relations of students’ academic emotions. J Educ Psychol. 2007;99(4):715. https://doi.org/10.1037/0022-0663.99.4.715.

    Article  Google Scholar 

  15. Frenzel AC, Thrash TM, Pekrun R, Goetz T. Achievement emotions in Germany and China: a cross-cultural validation of the academic emotions questionnaire—mathematics. J Cross Cult Psychol. 2007;38(3):302–9. https://doi.org/10.1177/0022022107300276.

    Article  Google Scholar 

  16. Davari H, Karami H, Nourzadeh S, Iranmehr A. Examining the validity of the achievement emotions questionnaire for measuring more emotions in the foreign language classroom. J Multiling Multicul. 2022;43(8):701–14. https://doi.org/10.1080/01434632.2020.1766054.

    Article  Google Scholar 

  17. Yli-Piipari S, Watt A, Jaakkola T, Liukkonen J, Nurmi J-E. Relationships between physical education students’ motivational profiles, enjoyment, state anxiety, and self-reported physical activity. J Sport Sci Med. 2009;8(3):327. https://doi.org/10.2320/matertrans1989.41.1168.

    Article  Google Scholar 

  18. Simonton KL, Garn AC. Negative emotions as predictors of behavioral outcomes in middle school physical education. Eur Phys Educ Rev. 2020;26(4):764–81. https://doi.org/10.1177/1356336X19879950.

    Article  Google Scholar 

  19. Fierro-Suero S, Sáenz-López P, Carmona-Márquez J, Almagro BJ. Achievement emotions, intention to be physically active, and academic achievement in physical education: gender differences. J Teach Phys Educ. 2022;1(aop):1–9. https://doi.org/10.1123/jtpe.2021-0230.

    Article  Google Scholar 

  20. Trigueros R, Aguilar-Parra JM, Cangas AJ, Álvarez JF. Validation of the scale of emotional states in the physical education context. Sustainability. 2019;11(18):5006. https://doi.org/10.3390/su11185006.

    Article  Google Scholar 

  21. Simonton KL, Garnf AC, Mercier KJ. Development of the discrete emotions in physical education scale. Res Q Exercise Sport. 2018;89:A52-A.

    Google Scholar 

  22. Fierro-Suero S, Almagro BJ, Sáenz-López P. Validation of the achievement emotions questionnaire for physical education (AEQ-PE). Int J Env Res Pub He. 2020;17(12):4560. https://doi.org/10.3390/ijerph17124560.

    Article  Google Scholar 

  23. Ibrahim MF, Kuan G, Hashim HA, Hamzah NA, Kueh YC. Measuring achievement emotions questionnaire for physical education (AEQ-PE): a confirmatory study in Malay language. BMC Public Health. 2021;21(1):1–8. https://doi.org/10.1186/s12889-021-11869-4.

    Article  Google Scholar 

  24. UNESCO. Education. https://www.unesco.org/en. Accessed 1 Mar 2023.

  25. Ministry of Education of the People's Republic of China. The basicstandard of higherschool sports work. http://www.moe.gov.cn/. Accessed 1 Mar 2023.

  26. Li YY. Research on Achievement Emotions of University Student in PE Class [Doctor]: Liaoning Normal University; 2020.

  27. Wu ML. Practical Application of SPSS Statistics: Questionnaire Analysis and Applied Statistics. Science Press, 2003.

  28. Hair JF, Anderson RE, Tatham RL, Black WC. Multivariate Data Analysis, 5th Ed. all publications. 1998.

  29. Kaiser HF, Rice J. Little jiffy, mark IV. Educ Psychol Meas. 1974;34(1):111–7. https://doi.org/10.1177/001316447403400115.

    Article  Google Scholar 

  30. Song ZG, Xie LL, He XH. Practical Tutorial for SPSS 16: People's Posts and Telecommunications Press; 2008.

  31. Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35(6):382–6. https://doi.org/10.1097/00006199-198611000-00017.

    Article  CAS  PubMed  Google Scholar 

  32. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6(1):1–55. https://doi.org/10.1080/10705519909540118.

    Article  Google Scholar 

  33. Browne MW, Cudeck R. Alternative ways of assessing model fit. Sociol Method Res. 1992;21(2):230–58. https://doi.org/10.1177/0049124192021002005.

    Article  Google Scholar 

  34. Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Marketing Res. 1981;18(1):39–50. https://doi.org/10.1177/002224378101800104.

    Article  Google Scholar 

  35. Henseler J, Hubona G, Ray PA. Using PLS path modeling in new technology research: updated guidelines. Ind Manage Data Syst. 2016;116(1):2–20. https://doi.org/10.1108/IMDS-09-2015-0382.

    Article  Google Scholar 

  36. Butler K, Dedrick RF. Content and internal structural validity of the motivation for mathematics abbreviated instrument. SN SS. 2021;1:1–27. https://doi.org/10.1007/s43545-021-00276-6.

    Article  Google Scholar 

  37. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J clin epidemiol. 2007;60(1):34–42. https://doi.org/10.1016/j.jclinepi.2006.03.012.

    Article  PubMed  Google Scholar 

  38. Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Model Multidiscip J. 2007;14(3):464–504. https://doi.org/10.1080/10705510701301834.

    Article  Google Scholar 

  39. Pekrun R, Stephens EJ. Achievement emotions: a control-value approach. Soc Personal Psychol. 2010;4(4):238–55. https://doi.org/10.1111/j.1751-9004.2010.00259.x.

    Article  Google Scholar 

  40. Zimmermann J, Tilga H, Bachner J, Demetriou Y. The effect of teacher autonomy support on leisure-time physical activity via cognitive appraisals and achievement emotions: a mediation analysis based on the control-value theory. Int J Env Res Pub He. 2021;18(8):3987. https://doi.org/10.3390/ijerph18083987.

    Article  Google Scholar 

  41. Simonton KL, Garn AC, Solmon MA. Class-related emotions in secondary physical education: a control-value theory approach. J Teach Physl Educ. 2017;36(4):409–18. https://doi.org/10.1123/jtpe.2016-0131.

    Article  Google Scholar 

  42. Simonton KL, Garn A. Exploring achievement emotions in physical education: the potential for the control-value theory of achievement emotions. Quest. 2019;71(4):434–46. https://doi.org/10.1080/00336297.2018.1542321.

    Article  Google Scholar 

  43. Simonton KL, Garn AC, Washburn N. Caring climate, emotions, and engagement in high school physical education. J Teach Physl Educ. 2021;41(3):401–10. https://doi.org/10.1123/jtpe.2021-0086.

    Article  Google Scholar 

Download references

Acknowledgements

The authors sincerely thank all the participants.

Funding

This work was supported by the Shanghai Jiao Tong University Teaching Development Fund Project (No. CTLD22J0007).

Author information

Authors and Affiliations

Authors

Contributions

J.T. conceptualized the research idea, data collection and analysis, and wrote the manuscript; Q.Z., S.S. and S.A. played roles in data collection, data extraction, data analysis; P.L. played role in review and editing; H.Y. contributed to the study design, critically reviewed the manuscript and supervised the whole study. All the authors read and approved the final manuscript.

Corresponding author

Correspondence to Hongyan Yu.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Human Science and Technology Ethics Review Committee of Shanghai Jiao Tong University (No. H20222481). All procedures were conducted in accordance with the ethical standards of the institution and/or national research committee, as well as the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. Participants were fully informed of the content and purpose of the research before participating and provided informed consent.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

Appendix 1. Principal component analysis. Appendix 2. Component matrix after orthogonal rotation (24 items). Appendix 3. Component matrix after orthogonal rotation (8 items). Appendix 4. Reliability of individual items.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tian, J., Liu, P., Zhang, Q. et al. Reliability and validity of the Chinese version of the achievement emotions questionnaire for physical education in university students. BMC Public Health 23, 1839 (2023). https://doi.org/10.1186/s12889-023-16759-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-023-16759-5

Keywords