- Research article
- Open Access
A confirmatory factor analysis of the knowledge, attitude and practice questionnaire towards prevention of respiratory tract infections during Hajj and Umrah
BMC Public Health volume 20, Article number: 1684 (2020)
Respiratory tract infections are one of the common infection associated with Hajj pilgrimage that is of great public health and global concern. This study is aimed at determining the factor structure of the knowledge, attitude, and practice questionnaire for the prevention of respiratory tract infections during Hajj by confirmatory factor analysis (CFA).
A multistage cluster sampling method was conducted on Malaysian Umrah pilgrims during the weekly Umrah orientation course. A total of 200 Umrah pilgrims participated in the study. The knowledge, attitude and practice (KAP) questionnaire was distributed to pilgrims at the beginning of the orientation and retrieved immediately at the end of the orientation. Data analysis was done using R version 3.5.0 after data entry into SPSS 24. The robust maximum likelihood was used for the estimation due to the multivariate normality assumption violation. A two-factor model was tested for measurement model validity and construct validity for each of the attitude and practice domains.
CFA of a 25-item in total, the two-factor model yielded adequate goodness-of-fit values. The measurement model also showed good convergent and discriminant validity after model re-specification. A two-factor model was tested for measurement model validity and construct validity for each of the attitude and practice domains. The result also showed a statistically significant value (p < 0.001) with χ2 (df) values of 76.8 (43) and 121 (76) for attitude and practice domains, respectively.
The KAP questionnaire was proven to have a valid measurement model and reliable constructs. It was deemed suitable for use to measure the KAP of Hajj and Umrah pilgrims towards the prevention for all respiratory tract infections.
The Holy pilgrimage to Mecca, Saudi Arabia is one of the five cardinal pillars of worship upon every financially and physically able Muslim individual. Hajj is among the largest mass gathering in the world, with approximately 2 million pilgrims participating from different countries every year . This poses a great risk to public health considering the overcrowding, presence of comorbidities among the pilgrims and adverse climatic condition are huge challenges to both participating and the host countries especially regarding infectious diseases such as respiratory tract infections . On the other hand, Umrah also known as Lesser Hajj can be performed at any time of the year and is not obligatory on Muslims; however, is a highly significant religious practice .
Respiratory tract infections are the most prevalent illnesses spread throughout the Hajj period, and influenza virus and rhinovirus are the most commonly reported respiratory viruses among pilgrims . However, a high prevalence of respiratory tract illnesses is still reported among Malaysian Hajj pilgrims at over 90% despite the implementation of different preventive measures over recent years .
The current pandemic due to the novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) which was first reported in Hubei province of China in December 2019 has prompted many researchers with the development of a valid and reliable tool for the measurement its knowledge, attitude and practice (KAP) among various communities . The World Health Organization (WHO) declared the infection as a pandemic in March 2020  with more than 9 million confirmed cases and 469,239 deaths due to of Covid-19 from 188 countries across the world based on the figures from the Johns Hopkins University Coronavirus resource centre . Similarly, Saudi Arabia, being the sole host of the Hajj and Umrah pilgrimage, has recorded 161,005 confirmed cases of COVID-19 resulting in more than 1300 deaths . This has prompted Saudi Arabia authorities to initiate more proactive protective precautions such as temporary suspension of Umrah pilgrimage and limiting Hajj 2020 pilgrimage to only a few Saudi residents with strict guidelines on the rules of social distancing, the use of face mask and proper hand hygiene [9,10,11].
Confirmatory factor analysis (CFA) is advance construct validity and superior to exploratory factor analysis (EFA) and simple reliability analysis (test-retest and internal consistency reliabilities) in several ways. CFA is also a kind of structural equation modelling (SEM) that is related to measurement models . The application of CFA is worthwhile to support the links connecting items and their respective domains. This permits the fixing of these relations in the measurement model and presents measures to evaluate the fit of the proposed theoretical model to the collected data . Therefore, CFA is regarded as a vital means for validation in the social and behavioural sciences . Measurement scale development involves numerous processes and protocols to establish its validity and reliability. The content and characteristics of the basic constructs and the choice of items to be included can also be established in a pilot study or adopted from a previous similar study and validated by CFA . The application of improper measurement tools that are not validated can lead to inaccurate and misleading findings, resulting in a poor plan for interventions and therefore, too unreliable efficacy . The Item Response Theory models (Rasch model) utilizes the principle of true Score models which comprises a collection of dogmatic formulae for systematic analysis to achieve the desired objective .
So far, few studies specifically reported the knowledge, attitude and practice of various respiratory tract infections preventive behaviours by Hajj pilgrims [17,18,19,20,21,22,23], however, none of these studies were documented to have employed a questionnaire that is properly developed and validated. Therefore, this study was aimed at determining the construct validity and reliability of the knowledge, attitude and practice (KAP) questionnaire towards the prevention of respiratory tract infections during Hajj and Umrah among Malaysian Hajj pilgrims.
Research design and study population
A cross-sectional study was carried out among Malaysian Umrah pilgrims attending a weekly Umrah orientation course organized by private Umrah tour companies from March to June 2018. This study was the second stage of a large study [24,25,26]. In the first stage, we conducted an exploratory factor analysis of the measurement tool .
Sample size and sampling method
A total of 200 Umrah pilgrims were recruited through a multistage sampling method for the 72 items in the KAP questionnaire for prevention of respiratory tract infection (RTI) during Hajj. The sample size for this study was based on a simulation study, as recommended by Hair et al. (2010)  for CFA. Therefore the sample size for this study was fixed at n = 200 when the anticipated domains were seven or less, and items commonality was less than 0.5 and no under identified domains.
The sampling method used was done in two stages. The first stage was a purposive selection of private Hajj and Umrah companies as clusters. Hajj/Umrah travel companies were eligible if: 1) they were located in Kota Bharu, Kelantan; 2) they conduct weekly Hajj/Umrah orientation courses, and if; 3) the management was willing to participate actively in the study and to collaborate with the researcher from Universiti Sains Malaysia. Five Hajj/Umrah tour companies were identified and contacted about the project, and only two companies agreed to participate. The participants were approached during the routine orientation courses conducted by the Hajj/Umrah travel companies for the pilgrims after being briefed about the validation study and seeking consent from them by research assistants in Malay language by three (3) research assistants. The questionnaires were distributed to the pilgrims at the beginning of the course and collected back at the end of the day’s session. Incentives were provided to the participants.
A self-administered questionnaire for the measurement of pilgrim’s KAP towards the prevention of RTIs as used in a previous study  was used in this study. All the domains, as well as the sub-domains, have been developed and exploratory factor analysis (EFA) was done .
Data collection procedures
All data were collected from June 2018 to August 2018. A self-administered questionnaires were distributed to the Umrah pilgrims before their weekly course that met the inclusion criteria. Pilgrims that are aged 18 years and above, able to write and speak in Bahasa Malay and are willing to participate are considered to have fulfilled the inclusion criteria. Participants were briefed on the purpose of the study, the procedures, and the confidentiality of their responses. Informed consent was obtained from the participants that are willing to be part of the study prior to the administration of the questionnaire. The pilgrims were also instructed to give their honest responses when answering the questionnaire. The completed questionnaire was immediately retrieved from the participants at the end of the day’s orientation. The time to complete the questionnaire was approximately 10 to 15 min.
Data management and preliminary analysis
All data were entered and checked for missing data using SPSS software version 24 and then transferred to R version 3.5.0 for Item Response Theory (IRT) and Confirmatory factor analysis (CFA) analysis. Data analysis was done using R version 3.5.0 in the R Studio environment.
Item response theory (IRT)
Considering the dichotomous outcome of the responses of the items in the knowledge section, two-parameter logistic item response theory (2-PL IRT) analysis was done using the ltm package version 1.0.0 6.
Confirmatory factor analysis (CFA)
Confirmatory factor analysis (CFA) was conducted to confirm the factorial structure of the KAP questionnaire identified in the EFA published in the other part of this study. The attitude and practice domains were analysed as recommended by lavaan package version 0.5–22 . Several indices indicated a good model fit for the construct, they include: the ratio of chi-square to degree of freedom (χ2/df) < 5.0, root mean square error of approximation (RMSEA) ≤0.08, comparative fit index (CFI) > 0.9, Tucker Lewis Index (TLI) > 0.9, and p > 0.05 for the chi-square test . For composite reliability, semTools package version 0.4–14 5–6 was used to determine the Raykov’s rho [29, 30]. Hair et al.  suggested that model fitness can be decided by at least a minimum of three different indices. A good relationship between items and respective factors are shown by a standardized factor loading greater than 0.5 as well as a p-value of less than 0.05 and it therefore further proves the validity of the construct. Composite reliability of the domains was calculated with a value of 0.7 and above was considered acceptable [27, 31].
A total of 200 Umrah pilgrims responded to this study. On data screening, no missing data was found. The age of the participants from this study ranged from 18 to 80 years old with, a mean age of 39.13 (SD 16.03). The females (65.5%) dominated the number of pilgrims. The socio-demographic characteristics of the participants are shown in Table 1.
In the knowledge section, IRT analysis results showed an acceptable range for both difficulty (− 3 to + 3) and the discrimination parameter on each of the items in all the sub domains. The sub-domains are SD1 (K1i, K1ii, K1iii), SD2 (K2i, K2ii, K2iii, K2iv, K2v, K3), SD3 (K4i, K4ii, K4iii, K4iv, K4v and K4vi), SD4 (K5i, K5ii, K5iii, K5iv and K5v), prevention practices (K6i, K6ii, K6iii, K6iv and K6v) and SD5 (K7i, K7ii, K7iii, K8 and K9) covering the aetiology, transmission, risk factors, complications, preventive practices and the use of personal protective equipment (PPE). However, all the items were retained because they had acceptable difficulty and discrimination values. The amount of information tapped by the items between − 3 and + 3 difficulty range was 93.1%. The unidimensionality assumption was not supported by the modified parallel test at α = 0.05 (p = 0.010). In terms of internal consistency reliability, Cronbach’s alpha was 0.9. IRT analysis for the psychometric characteristics of the domain, as shown in Table 2.
For the attitude domain, the two-factor model was then tested by CFA using an MLR estimation method. MLR was used because the data did not follow a multivariate normal distribution required by the MLR. Satisfactory model fitness was not demonstrated by the initial 12-item factor. To achieve the model fitness, the maximum likelihood (ML) values were examined and re-analysed to achieve a better model fit. To be included in the model, items with high correlated errors within the same factor will be considered. The two-factor model showed a good fit (χ2 [df = 6] = 43, p < 0.001; CFIrobust = 0.928; TLIrobust = 0.890; RMSEArobust = 0.063; SRMR = 0.079) as shown in Table after correlated errors (A12A↔A13, r = 0.341; A3↔A9, r = − 0.267; A5A↔A5B, r = 0.265; A8↔A7, r = 0.268; A8↔A9, r = 0.240; A10↔A4, r = − 0.237; A10↔A7, r = − 0.191; A3↔A5B, r = 0.267; A9↔A5B, r = − 0.168; A10↔A5B, r = 0.205) were added. However, the two sub-domains under attitude (barriers to compliance and self-motivation) have a correlation between them of r = 0.444. The composite reliability of the barriers to compliance and self-motivation factor all have a satisfactory cut-off value of > 0.7 as summarize in Table 3.
For practice domain which comprises of 13 items, the two-factor model was analyzed by CFA. The model showed an acceptable fitness, as shown in Table 4 (χ2 [df = 64] = 31.49, p < 0.001; CFIrobust = 0.903; TLIrobust = 0.882; RMSEArobust = 0.073; SRMR = 0.067). The correlations between the factors were: Healthy-lifestyle↔Prevention-practices (r = 0.471). The composite reliability of the healthy lifestyle and prevention practices factors were above the cut-off value of 0.7 (Raykov’s rho = 0.863 and 0.827), despite the low standardized loading for item P7.
The model showed an acceptable fitness for both attitude and practice. In the attitude domain, two-factor model showed a good fit (χ2 [df = 6] = 43, p < 0.001; CFIrobust = 0.928; TLIrobust = 0.890; RMSEArobust = 0.063; SRMR = 0.079) after correlated errors (A12A↔A13, r = 0.341; A3↔A9, r = − 0.267; A5A↔A5B, r = 0.265; A8↔A7, r = 0.268; A8↔A9, r = 0.240; A10↔A4, r = − 0.237; A10↔A7, r = − 0.191; A3↔A5B, r = 0.267; A9↔A5B, r = − 0.168; A10↔A5B, r = 0.205) were added. For the practice domain, the fitness indices (χ2 [df = 64] = 31.49, p < 0.001; CFIrobust = 0.903; TLIrobust = 0.882; RMSEArobust = 0.073; SRMR = 0.067) are well represented. The fitness indices are summarized in Table 5.
This study validated a Malay questionnaire for the KAP evaluation of Hajj pilgrims towards the prevention of respiratory tract infections. Overall, the results of the CFA for all the domains indicated that the measurement models for each construct are fit except the attitude domain that undergone through a model modification to improve the model fit. Finding from this study could not be compared with the psychometric properties from other studies conducted on the knowledge, attitudes and practices on respiratory tract infection due to the paucity of documented and described the validation process. Our findings support the originally developed two-factor sub-domain for each of the attitude and practice.
Based on the assumptions checking for multivariate, the data were not normally distributed for CFA. Therefore, MLR was the preferred method for fitting the CFA model to turn over the violation of the normality of the multivariate analysis. Due to the aforementioned reason, estimation of MLR was done using robust (Huber-White) with standard errors and a scaled test statistic that is hypothetically matched the Yuan-Bentler test statistic [31,32,33].
Our findings showed a reasonably good fit for the questionnaire, giving confirmatory details for the factor structure for both domains. All the fit indices (RMSEA, CFI, TLI, SRMR) are within acceptable values and therefore supported the construct validity . There are numerous studies done in Malaysia which support the accepted values of the fit indices, which is similar to the present study results [35,36,37].
The reliability of the various domains was based on the Raykov’s rho which accounts for what of each individual item stands for and its latent error; however, they provide much less biased estimate of Cronbach’s alpha. The attitude and practice factors of the KAP questionnaire had good reliability, as shown by the reliability coefficients exceeding 0.70.
In this study, like much other research, has some limitations. Firstly, data were collected from Umrah pilgrims using a sampling that is non-random in nature and thus should not necessarily be considered representative of the population and may not be a similar experience to Hajj pilgrimage. Secondly, majority of the participants are of Malay race, future research should incorporate other race to make it heterogenous population. Finally, as stated earlier, this is the first study on confirmatory factor analysis of KAP on respiratory tract infection prevention in Malaysia and therefore comparison to other studies is not possible.
The KAP questionnaire has shown to have good validity, reliability and psychometric properties towards measuring knowledge, attitude and practice of Malaysian Hajj pilgrims towards prevention of respiratory tract infection. This article could serve as a template for the implementation of various studies in community settings amidst the current Covid19 pandemic for effective prevention and control strategies.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
- RTI :
Respiratory tract infection
- IRT :
Item response theory
- CFA :
Confirmatory factor analysis
- KAP :
Knowledge, attitude, and practice
Shirah BH, Zafar SH, Alferaidi OA, Sabir AMM. Mass gathering medicine (hajj pilgrimage in Saudi Arabia): the clinical pattern of pneumonia among pilgrims during hajj. J Infect Public Health. 2017;10(3):277–86.
Memish ZA, Zumla A, Alhakeem RF, Assiri A, Turkestani A, Al Harby KD, et al. Hajj: infectious disease surveillance and control. Lancet. 2014;383(9934):2073–82.
Yezli S, Yassin Y, Awam A, Attar A, Al-Jahdali E, Alotaibi B. Umrah. An opportunity for mass gatherings health research. Saudi Med J. 2017;38(8):868–71.
Gautret P, Benkouiten S, Al-Tawfiq JA, Memish ZA. Hajj-associated viral respiratory infections: a systematic review. Travel Med Infect Dis. 2016;14(2):92–109.
Hashim S, Ayub ZN, Mohamed Z, Hasan H, Harun A, Ismail N, et al. The prevalence and preventive measures of the respiratory illness among Malaysian pilgrims in 2013 Hajj season. J Travel Med. 2016;23(2):tav019.
Zhu H, Wei L, Niu P. The novel coronavirus outbreak in Wuhan, China. Glob Health Res Policy. 2020;5:6.
Organization WH. Coronavirus disease 2019 (COVID-19): situation report, 72. 2020.
John Hopkins University Corona Virus Resource Center. Coronavirus COVID-19 Global Cases by the Center for Systems Science and Engineering (CSSE) 2020 [Available from: https://coronavirus.jhu.edu/map.html. Accessed 12 Apr 2020.
Arab News. Saudi Arabia: Hajj 2020 to be held with limited number of pilgrims 2020 [Available from: https://www.arabnews.com/node/1693856/saudi-arabia. Accessed 23 June 2020.
Ahmed QA, Memish ZA. The cancellation of mass gatherings (MGs)? Decision making in the time of COVID-19. Travel Med Infect Dis. 2020;101631.
Ebrahim SH, Memish ZA. Saudi Arabia’s drastic measures to curb the COVID-19 outbreak: temporary suspension of the Umrah pilgrimage. J Travel Med. 2020;27(3):taaa029.
Brown TA. Confirmatory factor analysis for applied research. New York: Guilford Publications; 2014.
Stevens JP. Applied multivariate statistics for the social sciences. University of Cincinati, USA: Routledge; 2012.
Alumran A, Hou X-Y, Hurst C. Validity and reliability of instruments designed to measure factors influencing the overuse of antibiotics. J Infect Public Health. 2012;5(3):221–32.
Hewlett S, Hehir M, Kirwan JR. Measuring fatigue in rheumatoid arthritis: a systematic review of scales in use. Arthritis Care Res. 2007;57(3):429–39.
Mohamad MM, Sulaiman NL, Sern LC, Salleh KM. Measuring the validity and reliability of research instruments. Procedia Soc Behav Sci. 2015;204:164–71.
Alhomoud F, Alhomoud F, Editors. Hajj pilgrims' knowledge, attitude and practices regarding Middle East respiratory syndrome coronavirus (MERS-CoV). International journal of clinical pharmacy; 2017; Chicago: SPRINGER VAN GODEWIJCKSTRAAT 30, 3311 GZ DORDRECHT, NETHERLANDS.
Alqahtani AS, Wiley KE, Mushta SM, Yamazaki K, BinDhim NF, Heywood AE, et al. Association between Australian Hajj Pilgrims’ awareness of MERS-CoV, and their compliance with preventive measures and exposure to camels. J Travel Med. 2016;23(5):1–5.
Gautret P, Benkouiten S, Salaheddine I, Belhouchat K, Drali T, Parola P, et al. Hajj pilgrims’ knowledge about Middle East respiratory syndrome coronavirus, august to September 2013. Eurosurveillance. 2013;18(41):20604.
Sahin MK, Aker S, Tuncel EK. Knowledge, attitudes and practices concerning Middle East respiratory syndrome among Umrah and hajj pilgrims in Samsun, Turkey, 2015. Eurosurveillance. 2015;20(38):30023.
Dumyati MS, Bakr Balubaid SA, Althobaiti FA, Azizurrehman HA, Sindi BZ. Knowledge, Attitude and Practices About Pneumococcal Infection among Algerian Hajj Pilgrims. Egyptian J Hospital Med. 2018;70(5):806–17.
Sridhar S, Belhouchat K, Drali T, Benkouiten S, Parola P, Brouqui P, et al. French hajj pilgrims' experience with pneumococcal infection and vaccination: a knowledge, attitudes and practice (KAP) evaluation. Travel Med Infect Dis. 2015;13(3):251–5.
Alqahtani AS, Wiley KE, Tashani M, Willaby HW, Heywood AE, BinDhim NF, et al. Exploring barriers to and facilitators of preventive measures against infectious diseases among Australian hajj pilgrims: cross-sectional studies before and after hajj. Int J Infect Dis. 2016;47:53–9.
Goni MD, Naing NN, Hasan H, Wan-Arfah N, Deris ZZ, Arifin WN, et al. Development and validation of knowledge, attitude and practice questionnaire for prevention of respiratory tract infections among Malaysian hajj pilgrims. BMC Public Health. 2020;20(1):1–10.
Goni MD, Hasan H, Naing NN, Wan-Arfah N, Deris ZZ, Arifin WN, et al. Assessment of knowledge, attitude and practice towards prevention of respiratory tract infections among hajj and Umrah pilgrims from Malaysia in 2018. Int J Environ Res Public Health. 2019;16(22):4569.
Goni MD, Naing NN, Hasan H, Arfah NW, Arifin WN, Baaba AA. Uptake of recommended vaccines and its associated factors among Malaysian pilgrims during hajj and Umrah 2018. Front Public Health. 2019;7:268.
Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis: A Global Perspective. 7th Edition, Pearson Education: Upper Saddle River; 2010.
Rosseel Y. Lavaan: an R package for structural equation modeling and more. Version 0.5–12 (BETA). J Stat Softw. 2012;48(2):1–36.
Hou D, Al-Tabbaa A, Chen H, Mamic I. Factor analysis and structural equation modelling of sustainable behaviour in contaminated land remediation. J Clean Prod. 2014;84:439–49.
Hassim SR, Arifin WN, Kueh YC, Yaacob NA. Confirmatory factor analysis of the Malay version of the smartphone addiction scale among medical students in Malaysia. Int J Environ Res Public Health. 2020;17(11):3820.
Raykov T, Marcoulides GA. Scale reliability evaluation under multiple assumption violations. Struct Equ Model Multidiscip J. 2016;23(2):302–13.
Geldhof GJ, Preacher KJ, Zyphur MJ. Reliability estimation in a multilevel confirmatory factor analysis framework. Psychol Methods. 2014;19(1):72.
Beaujean AA. Latent variable modeling using R: a step-by-step guide. New York: Routledge; 2014.
Perry JL, Clough PJ, Crust L, Earle K, Nicholls AR. Factorial validity of the mental toughness questionnaire-48. Personal Individ Differ. 2013;54(5):587–92.
Zahiruddin WM, Arifin WN, Mohd-Nazri S, Sukeri S, Zawaha I, Bakar RA, et al. Development and validation of a new knowledge, attitude, belief and practice questionnaire on leptospirosis in Malaysia. BMC Public Health. 2018;18(1):331.
Abdullah M, Azib W, Harun M, Burhanuddin M. Reliability and construct validity of knowledge, attitude and practice on dengue fever prevention questionnaire. Am Int J Contemp Res. 2013;3:69–75.
Hiew C, Chin Y, Chan Y, Mohd N. Development and validation of knowledge, attitude and practice on healthy lifestyle questionnaire (KAP-HLQ) for Malaysian adolescents. J Nutri Health Sci. 2015;2(4):1–11.
We would like to thank the Management and staff of Andalusia Travel and Al Quds Umrah & Tours Sdn Bhd for the collaboration as well as all the participants in this study.
This study was funded by the Universiti Sultan Zainal Abidin Special Research Grant Scheme 2017 (UniSZA/2017/SRGS/16) and Keputusan Permohonan Tabung Insentif Pembangunan Penganjian Siswazah PPSP (TIPPS) 2017. We would like to acknowledge the USM Global Fellowship awarded to the first author. The funding bodies had no role in the design of the study, data collection, analysis and interpretation of data, and writing of the manuscript.
Ethics approval and consent to participate
Ethical approvals were obtained from the Human Research Ethics Committee of Universiti Sains Malaysia [ref no: USM/JEPeM/17020146]. The questionnaire was designed to be anonymous, and informed written consent was obtained from every respondent. The data were kept confidential and the results would not identify the respondents personally.
Consent for publication
The authors declare that they have no competing interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Goni, M.D., Naing, N.N., Hasan, H. et al. A confirmatory factor analysis of the knowledge, attitude and practice questionnaire towards prevention of respiratory tract infections during Hajj and Umrah. BMC Public Health 20, 1684 (2020). https://doi.org/10.1186/s12889-020-09756-5
- Respiratory tract infection
- Confirmatory factor analysis