Development and validation of knowledge, attitude and practice questionnaire for prevention of respiratory tract infections among Malaysian Hajj pilgrims
BMC Public Health volume 20, Article number: 189 (2020)
Hajj pilgrimage faces numerous challenges including a high prevalence of respiratory tract infection as well as its prevention strategies. The aim of this study was to develop and validate a questionnaire to evaluate knowledge, attitude and practice (KAP) towards respiratory tract infections (RTIs) prevention among Malaysian Hajj pilgrims.
This study was conducted among Malaysian Umrah pilgrims in Malaysia from Kuala Lumpur and Kelantan. The questionnaire then underwent a series of validation process that included content, face validity and exploratory part. Item response theory (IRT) analysis was utilized for the validation of the knowledge domain. The attitude and practice were validated using the exploratory factor analysis (EFA).
The validation process resulted in a questionnaire that comprised of four main sections: demography, knowledge, attitude, and practice. Following IRT analysis of the knowledge domain, all items analyzed were within the acceptable range of difficulty and discrimination. The Kaiser-Meyer-Olkin measure of sampling adequacy (KMO) was 0.72 and 0.84 for attitude and practice domain respectively and Bartlett’s test of Sphericity for both domains were highly significant (P < 0.001). The factor analysis resulted in two factors with total of 12 items in attitude domain, and 2 factors with total of 13 items in the practice domain with satisfactory factor loading (> 0.3). The Cronbach’s alpha for reliability of the knowledge, attitude and practice domains all showed acceptable values of > 0.6 (0.92, 0.77 and 0.85).
The findings of this validation and reliability study showed that the developed questionnaire had a satisfactory psychometric property for measuring KAP of Malaysian Hajj pilgrims.
Annually, over 2 million Muslim pilgrims across the globe including thousands from Malaysia set out on the holy pilgrimage of Hajj in the Kingdom of Saudi Arabia . This event is characterized by high density of crowding and posed a potential risk for confined outbreaks as well as the spread of infectious agents to different parts of the world upon pilgrims return to their various countries. Consequently, respiratory tract infections are the leading cause of hospital admission during the pilgrimage [2, 3].
The usual basic procedure in KAP evaluation is the questionnaire . For the past four decades, KAP research has been the main educational intervention strategy for respiratory diseases control across the globe . Various researchers had reported that an individual’s level of KAP is linked to competent control and prevention of illness, response to medical treatment, and advancement of one’s individual health [6,7,8,9]. KAP level at lower standard had been one of the foremost pointers of poor health, unproductive health care practice, the drop of the disease screening rate, and unrealistic preventive behavior toward various infections in various settings [10, 11]. Similarly, reliability is similar with precision and shows the extent to which the measurement tool is reproducible by determining its internal consistency .
The World Health Organization (WHO), the US Centre for Disease Control and prevention (CDC) and Saudi’s health authority have recommended preventive behaviors and practices for mitigating the risk, impact and spread of respiratory tract infections among pilgrims during Hajj pilgrimage which include practicing hand hygiene, proper use of a face mask, cough etiquette, social distancing, and contact avoidance . However, the prevalence of RTI during Hajj has continued to rise over the recent years among Malaysian and other pilgrims across the world [14, 15]. Currently, there is a paucity of standardized and validated measurement tool on its KAP towards prevention of RTIs during Hajj.
Therefore, this research was conducted to develop and validate an instrument meant to evaluate the knowledge, attitude and practice in terms of face validity, content validity, exploratory factor analysis and reliability towards prevention of respiratory tract infection among Malaysian Hajj pilgrims in order to understand and improve prevention strategies using health educational intervention.
The questionnaire development and factor analysis took place in two stages, the first stage consisted of the questionnaire development stage, and the second stage comprised of psychometric evaluation. The psychometric evaluation comprised Exploratory Factor Analysis (EFA) and Item Response Theory (IRT) analysis.
First stage: items and domains development
For the first stage, a meticulous study of the literature was conducted to discover available resources on KAP, as well as to identify relevant items and scales in existing questionnaires on prevention of respiratory tract infection during Hajj pilgrimage. In-depth interviews were conducted on Hajj pilgrims attending weekly Umrah and Hajj orientation courses to qualitatively explore their baseline knowledge of RTIs, its prevention and control, risk factors, its mode of transmission and signs and symptoms as well as their attitude towards the risk of contracting the infection and prevention practices such as the use of face mask, vaccination, hand hygiene, cough etiquette and social distancing/crowd avoidance. An interview guide was used during the in-depth interview, and it consists of 70 items that emerged from the literature review covering the three domains. The interviews were transcribed and analyzed using content analysis. The first draft of the questionnaire was judged by a panel of experts that included a Medical Doctor, statistician, microbiologist, nurse and educationist to validate its contents with the intended constructs and theories.
The conclusions from the interviews on the extent of knowledge among the respondents were then used to generate suitable domains for the questionnaire.
The knowledge section was developed based on the etiology, transmission, risk, complications and symptoms of RTI. However, the attitude section of the questionnaire was developed based on the theory of Health Belief Model (HBM) , while the practice was based on the preventive strategies for respiratory tract infections recommended by the World Health Organization and the Centre for Disease Control and Prevention. Based on this, individuals who have accurate knowledge of respiratory tract infections and perceived susceptibility to and results of the infections and are informed of the interests of taking preventive actions are more likely to make significant lifestyle choices to prevent the onset of infection during Hajj pilgrimage.
Content validity of the KAP questionnaire was conducted with panel of experts which consisted of an epidemiologist, a microbiologist, a health educationist and a medical statistician. The panel select the best items for clarity of the questions, accuracy of the knowledge, attitude and practice domains and interpretability. This panel also helped in identifying and judging the content validity (relevance, coverage and representativeness) of the items initially selected for inclusion in the questionnaire.
The original draft of the questionnaire was developed in English and then translated to the Malay language which is the official national language for easy administration to local participants. Therefore, the questionnaire was translated based the standard translation guidelines. It underwent two forward translations by a language communication expert and an epidemiologist into Malay. Subsequently, the two sets of translated Malay questionnaire were subjected to a backward translation into English by another language communication expert as well as an epidemiologist. The aim of this process was to recognize and harmonize the translated items from the original English version and to produce accurate Malay version of the questionnaire .
Face validity was conducted on 10 Umrah pilgrims to evaluate the understanding of a layman towards comprehending the questionnaire and determine how meaningful the items were to target participants . The participants were requested to describe and evaluate every questionnaire item following the open-ended discussion. Their various responses and understanding regarding the questions, how it was presented (layout and setting) and lack of vagueness were assessed. A revised and finalized version of the questionnaire was produced from the findings of the face validation for use throughout the rest of the research.
The questionnaire is self-administered and consisted of open-ended and closed-ended questions and was well received by participants. There was a total of four domains in the final questionnaire consisting of 80 questions, the domains were (1) demography of participants; (2) knowledge of RTIs; (3) attitude towards RTIs; (4) prevention practices towards RTIs. Socio demographic characteristics studied included age, gender, race and marital status, occupational status, level of education, how many times have you performed Hajj or Umrah in the last 5 years, vaccinations history, and presence of comorbidities and presence of RTI prior to departure to Hajj. The main domains, theories covered as well as the choices of response in the questionnaire are shown in Table 1.
Second stage: validation
The data collection for this study was conducted from January 2018 to May 2018. In total, 350 participants were recruited from Kuala Lumpur and Kelantan through a multistage sampling method during the weekly Umrah orientation session organized by a private Hajj and Umrah tour company and then retrieved back at the end of the day’s session to explore the psychometric property of the measurement tool. First, a briefing was done to the participants about the study and informed consent was then obtained from the respondents who agreed to be involved in the study. The KAP questionnaire forms were given to each participant for self-administration. Data were analyse using R software version 3.5.0, in the R Studio environment. The level of significance was set at 0.05.
Item response theory
The sample size required for 2-PL IRT is unspecified, although some studies suggest a range from 100 to 500 samples [19, 20]. For this study, the sample size was 350 participants after adding expected 30% drop-out rate. The unidimensionality of the knowledge domain with responses in dichotomous output as either correct answer or wrong answer, two-parameter logistic item response theory (2-PL IRT) analysis, using the ltm package version 1.0.0 was employed to analyse the knowledge domain. An acceptable range of difficulty (− 3 to + 3) and discrimination (0.25 to infinity) will serve as the cut off value for the psychometric properties’ evaluation of the domain. Item fit was evaluated by the chi-square goodness-of-fit per item, and unidimensionality was analyzed by modified parallel analysis.
Exploratory factor analysis (EFA)
The sample size required for EFA is 2 to 5 participants per item based on a recommendation by Kline . As the number of the items was intended to be 62, a sample size estimated was 260 participants. The EFA was done to determine the construct validity of the attitude and practice domains of the questionnaire due to their ordinal responses. Kaiser-Meyer-Olkin measure of the sampling adequacy (KMO) and Bartlett’s test of the sphericity was done for sampling adequacy. The sample was considered adequate if the KMO value was more than 0.5 and Bartlett’s test was significant (P < 0.001). The Principal axis factoring method for the component extraction was used. Oblimin rotation with Kaiser normalization was applied in order to optimize the loading factor of each item on the extracted components. Dimensionality of the items in each domain was considered as continuous output and to facilitate its evaluation . Components with Eigen values of over one was retained as components using parallel analysis and scree plot. Items with a loading factor of more than plus or minus 0.3 were considered as an acceptable loading factor .
In this study the internal consistency (IC) of the items was measured by using Cronbach’s alpha coefficient. The items of the Questionnaire were considered to represent a measure of good internal consistency if the total of Cronbach’s alpha value was more than 0.7 .
Questionnaire development and content and face validity
The extensive literature review on RTIs identified various useful concepts and ideas in generating important items and domains for the relevant sections of the questionnaire. Following an extensive review of the questionnaire by the panel, they collectively concurred that the incorporated domains and items were appropriate and consistent with the intended domains. The in-depth interview was conducted to aid the development of appropriate domains and items for incorporation in the questionnaire. This process assisted in distinguishing the items and local languages relating to respiratory tract infection (RTI) that were meaningful to the Hajj and Umrah pilgrims. Subsequently, the questionnaire was pretested by another session of in-depth interview on Umrah pilgrims during weekly orientation course to determine its face validity. Based on their opinions, most of wordings and terminologies were clear and easy to understand, however, the very few confusing ones were changed for easy understanding. Overall, they had no difficulty in understanding the items. The final draft of the questionnaire at this stage contained 4 domains and 68 items (14 items on demography, 29 items on knowledge, 12 items on attitude and 13 items on practice).
Descriptive statistics of the participants
The mean age of the respondents was 43.85 (SD = 15.80) years with more than half (62.6%) being females as shown in Table 2. However, majority of the respondents were of Malay ethnicity (98.7%) with more than half of them married (67.4%).
Item response theory
The knowledge section analysed by IRT analysis showed the psychometric properties of the domain as shown in Table 3. The sub-domains are Aetiology (K1i, K1ii, K1iii), transmission (K2i, K2ii, K2iii, K2iv, K2v, K3), risk factors (K4i, K4ii, K4iii, K4iv, K4v and K4vi), complications (K5i, K5ii, K5iii, K5iv and K5v), prevention practices (K6i, K6ii, K6iii, K6iv and K6v) and Use of personal protective equipment (K7i, K7ii, K7iii, K8 and K9). The difficulty parameter indicated that all the items were within the acceptable range of − 3 to + 3. With regards to the range of values for items for discrimination, items K1ii, K2i, K2iii, K2v, K3, K4i, K4v, K4vi, K6i, K6ii, K6iv, K8 and K9 were within the acceptable range of 0.8 to 2.5. as shown in Table 3 . The item K19 was exempted from the IRT analysis because of its poor performance in the questionnaire. The remaining items were above the cut-off values. However, all the items that were above the range were retained based on expert advice due to the importance of their content in determining knowledge of the participants . The item goodness-of-fit showed that all the items did not fit well with the exception of K1iv, K6iii, K6v and K7i (P < 0.05). Similarly, all questions in the knowledge domain were retained based on expert advice due to their importance and relevance to the study. The amount of information tapped by the items between − 3 and + 3 difficulty across the 6 sub-domains of the knowledge section ranged from 98.44 to 99.94%. The unidimensionality assumption of the items were supported by the modified parallel analysis in three knowledge sub-domains only namely: Aetiology, risk factors and prevention practices (P = 0.2376, 0.5248, 0.2574). Furthermore, the Cronbach’s alpha for all the sub-domains were demonstrating acceptable internal consistency reliability (0.80, 0.78, 0.79, 0.79, 0.84, 0.71, 0.71).
Exploratory factor analysis
For the attitude domain, the items were subjected to EFA to examine the Kaiser-Meyer-Olkin (KMO) test and Bartlett’s test of sphericity were to evaluate the factorability. The KMO measure of sampling adequacy was 0.72 and the significance of Bartlett’s test of sphericity was less than 0.001, meaning that EFA could be applied . Parallel analysis for attitude sub-domain suggested a 4-factor model, however EFA was proceeded by fixing the number of factors to two based on the eigenvalue greater than one criterion. Those factors obtained were rotated using Oblimin method to make the factors more meaningful which propitiously resulted to two interpretable factors based on the relation among the items and the proposed domain. All the items had acceptable factor loading of > 0.3 in the attitude domain with the exception of items A1, A2, and A12B and therefore they were removed.
The validity of the 2-factor model was further confirmed by the communalities of each attributes as all the communalities were close to one. The 2 domains are barriers to compliance (items A3, A8, A9, A10 and A11), and self-motivation (A4, A5A, A5B, A6, A7, A12A and A13) as shown in Table 4.
For practice domain, the data matrix was factorable and assumptions to conduct EFA were met as indicated by a KMO value of 0.84 and Bartlett’s test of sphericity being significant (P = 0.005). The EFA was continued by fixing the number of factors to two as suggested by parallel analysis. All the items in the practice section had factor loading of more than 0.3 and were retained with the exception of item P8D which was removed due to cross loading. The two sub-domains factored are healthy life-style (items P1, P2 and P5) and prevention practices (P4, P6, P7, P8A, P8B, P8C, P9A, P9B, P9C and P10) as shown in Table 5.
In order to measure the reliability, the Cronbach’s alpha of the overall questionnaire was 0.92, 0.60, 0.86 for knowledge, attitude and practice sections respectively. For the attitude domain, the two factors (barriers to compliance and self-motivation) have acceptable internal consistency (0.81 and 0.70). Similarly, the practice domain also has an acceptable value for Cronbach’s alpha of 0.83 for both sub-domains (health life-style and prevention practices) as shown in Table 5.
To the best of our knowledge, this is the first study that describes the development of a validated questionnaire with satisfactory content and face validity and reliability examining the knowledge, attitude and practice of Malaysian Hajj pilgrims towards prevention of respiratory tract infections. The present study reported the stages of designing and developing a questionnaire for determining the knowledge, attitude and practice of Hajj pilgrims from Malaysia towards prevention of respiratory tract infections indicated satisfactory psychometric properties for the questionnaire.
Based on the content validity evaluation of the questionnaire, some items were deleted as they were shown to be problematic validity in terms of their relevance in measuring KAP of prevention of respiratory tract infections. Performing both exploratory factor analyses, the results indicated a good structure for this new instrument. The IRT on the knowledge section showed a good difficulty psychometric property of the domain. The ideal parameter range for discrimination value range from minus infinity to plus infinity; nonetheless, questions with negative figures of discrimination are recognized as problematical because they infer that participants with a high score are less expected to support more stringent response alternatives . Our findings showed all discrimination parameters are positive and less problematic as seen in various studies .
For the attitude section, EFA indicated a two-factor structure of the questionnaire could jointly account for 72.3% of the total observed variance which was what was hypothesized. All factor loadings were above 0.3, revealing close relations between factors and items . The reliability analysis of the attitude section indicated acceptable Cronbach’s alpha value demonstrating internal consistency. In the practice section, the analysis resulted in a good-fitting two-factor model as well, with good reliability and internal consistency (> 0.6). The two- factor model extracted in EFA for this domain explained 62.52% of the total variance, which was higher than the criterion of 50%.
The limitation of this study was that item response theory and exploratory factor analysis was used to assess the reliability and validity, however, it is recommended that a confirmatory factor analysis should be conducted in the future to validate the knowledge, attitude and practice questionnaire of respiratory tract infection prevention.
In this study, a new validated questionnaire for determining KAP of respiratory tract infection prevention in Malay language was developed among samples Malaysian Hajj pilgrims. The final questionnaire consisted of 4 sections and 76 items (14 items on demography and general information, 29 items on knowledge domains, 12 items in attitude and 14 items in practice domain. The knowledge, attitude and practice sections showed acceptable psychometric properties and has good reliability result.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Exploratory factor analysis
Health Belief Model
Item response theory
Knowledge, attitude, and practice
Respiratory tract infection
Ahmed QA, Memish ZA. Hajj 2016: required vaccinations, crowd control, novel wearable tech and the Zika threat. Travel Med Infect Dis. 2016;14(5):429–32.
Al-Abdallat MM, Rha B, Alqasrawi S, Payne DC, Iblan I, Binder AM, et al. Acute respiratory infections among returning hajj pilgrims—Jordan, 2014. J Clin Virol. 2017;89:34–7.
Memish ZA, Assiri A, Turkestani A, Yezli S, al Masri M, Charrel R, et al. Mass gathering and globalization of respiratory pathogens during the 2013 Hajj. Clin Microbiol Infect. 2015;21(6):571. e1–8.
Jiang H, Zhang S, Ding Y, Li Y, Zhang T, Liu W, et al. Development and validation of college students’ tuberculosis knowledge, attitudes and practices questionnaire (CS-TBKAPQ). BMC Public Health. 2017;17(1):949.
Kempinski R, Krasnik A. Prevention of arteriosclerotic heart disease. An epidemiological study of knowledge, attitudes and practices in a community in Israel. Ugeskr Laeger. 1974;136(34):1931–8.
Suleiman M, Sahal N, Sodemann M, Elsony A, Aro AR. Tuberculosis awareness in Gezira, Sudan: knowledge, attitude and practice case-control survey. East Mediterr Health J. 2014;20(2):120.
Khalil A, Abdalrahim M. Knowledge, attitudes, and practices towards prevention and early detection of chronic kidney disease. Int Nurs Rev. 2014;61(2):237–45.
Matsumoto-Takahashi ELA, Tongol-Rivera P, Villacorte EA, Angluben RU, Jimba M, Kano S. Patient knowledge on malaria symptoms is a key to promoting universal access of patients to effective malaria treatment in Palawan, the Philippines. PLoS One. 2015;10(6):e0127858.
Turkestani A, Balahmar M, Ibrahem A, Moqbel E, Memish Z. Using health educators to improve knowledge of healthy behaviour among hajj 1432 (2011) pilgrims. East Mediterr Health J. 2013;19(Suppl 2):S9–12.
Terán Calderón C, Gorena Urizar D, González Blázquez C, Alejos Ferreras B, Rubio OR, Bolumar Montrull F, et al. Knowledge, attitudes and practices on HIV/AIDS and prevalence of HIV in the general population of Sucre. Bolivia Brazilian J Infect Dis. 2015;19(4):369–75.
Alkot M, Albouq MA, Shakuri MA, Subahi MS. Knowledge, attitude, and practice toward MERS-CoV among primary health-care workers in Makkah Al-Mukarramah: an intervention study. Int J Med Sci Public Health. 2016;5(05):952.
Vaske JJ, Beaman J, Sponarski CC. Rethinking internal consistency in Cronbach's alpha. Leis Sci. 2017;39(2):163–73.
Balaban V, Stauffer WM, Hammad A, Afgarshe M, Abd-Alla M, Ahmed Q, et al. Protective practices and respiratory illness among US travelers to the 2009 hajj. J Travel Med. 2012;19(3):163–8.
Hashim S, Ayub ZN, Mohamed Z, Hasan H, Harun A, Ismail N, et al. The prevalence and preventive measures of the respiratory illness among Malaysian pilgrims in 2013 hajj season. J Travel Med. 2016;23(2):tav019.
Annan A, Owusu M, Marfo KS, Larbi R, Sarpong FN, Adu-Sarkodie Y, et al. High prevalence of common respiratory viruses and no evidence of Middle East respiratory syndrome coronavirus in hajj pilgrims returning to Ghana, 2013. Tropical Med Int Health. 2015;20(6):807–12.
Jones CL, Jensen JD, Scherr CL, Brown NR, Christy K, Weaver J. The health belief model as an explanatory framework in communication research: exploring parallel, serial, and moderated mediation. Health Commun. 2015;30(6):566–76.
Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract. 2011;17(2):268–74.
Hajizadeh E, Asghari M. Statistical methods and analyses in health and biosciences a research methodological approach, vol. 395. Tehran: Jahade Daneshgahi Publications; 2011.
Edelen MO, Reeve BB. Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Qual Life Res. 2007;16(Suppl 1):5–18.
Zahiruddin WM, Arifin WN, Mohd-Nazri S, Sukeri S, Zawaha I, Bakar RA, et al. Development and validation of a new knowledge, attitude, belief and practice questionnaire on leptospirosis in Malaysia. BMC Public Health. 2018;18(1):331.
Kline R. Principles and practice of structural equation modeling 2011 3rd ed. New York: NY Guilford Press Google Scholar; 2011.
Brown TA. Confirmatory factor analysis for applied research. 2nd ed. New York: The Guilford Press; 2015.
Floyd FJ, Widaman KF. Factor analysis in the development and refinement of clinical assessment instruments. Psychol Assess. 1995;7(3):286.
Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis, vol. 7; 2010.
Arifin WN, Yusoff MSB. Item Response Theory for Medical Educationists. Educ Med J. 2017;9(3):69-81.
Kaiser HF. An index of factorial simplicity. Psychometrika. 1974;39(1):31–6.
Yang FM, Kao ST. Item response theory for measurement validity. Shanghai Arch Psychiatry. 2014;26(3):171–7.
Ghani A, TK TH, Arifin W, Chew K. Development and psychometric evaluation of flood disaster management questionnaire-(Flooddmq-Bm): exploratory factor analysis and item response theory analysis. Int J Public Health Clin Sci. 2016;3(3):59–70.
Li WH, Chung JO, Chui MM, Chan PS. Factorial structure of the Chinese version of the 12-item general health questionnaire in adolescents. J Clin Nurs. 2009;18(23):3253–61.
The authors gratefully acknowledge the School of Medical Sciences, Universiti Sains Malaysia and Universiti Sultan Zainal Abidin (UniSZA) Malaysia which provided the Special Research Grant Scheme to fund the research. We would also like to thank the Management and staff of Andalusia Travel and Tours for the collaboration as well as all the participants in this study.
This study was funded by the Universiti Sultan Zainal Abidin Special Research Grant Scheme 2017 (UniSZA/2017/SRGS/16) and Keputusan Permohonan Tabung Insentif Pembangunan Penganjian Siswazah PPSP (TIPPS) 2017. We would like to acknowledge the USM Global Fellowship awarded to the first author. The funding bodies had no role in the design of the study, data collection, analysis and interpretation of data, and writing of the manuscript.
Ethics approval and consent to participate
Ethical approvals were obtained from the Human Research Ethics Committee of Universiti Sains Malaysia [ref no: USM/JEPeM/17020146]. The questionnaire was designed to be anonymous, and informed written consent was obtained from every respondent. The data were kept confidential and the results would not identify the respondents personally.
Consent for publication
The authors declare that they have no competing interest.
About this article
Cite this article
Goni, M.D., Naing, N.N., Hasan, H. et al. Development and validation of knowledge, attitude and practice questionnaire for prevention of respiratory tract infections among Malaysian Hajj pilgrims. BMC Public Health 20, 189 (2020). https://doi.org/10.1186/s12889-020-8269-9