Development and psychometric assessment an instrument for investigating Women’s attitude toward home safety
BMC Public Health volume 22, Article number: 948 (2022)
Approximately half of the Iranian population are women, and they play a vital role in the home. The women’s attitude can play a critical role in the safety of homes. Best of our knowledge, there is not a valid and reliable instrument to measure their attitude toward home safety. So, the present study aimed to design a psychometrics tool to assess women’s attitudes toward home safety.
The researchers designed an instrument based on the home safety concept as the first instrument to measure housewives’ attitudes toward home safety. The developed instrument distributed among 686 women in Tabriz health centers. Content validity, confirmatory, and exploratory factor analysis were used to examine the construct validity, and Cronbach’s alpha and test-retest were employed to examine the reliability and reproducibility of the instrument.
In the face validity section, the impact score of all items was determined to be above 1.5. In the content validity section, 4 items were excluded from the 39 questionnaire items due to low Content Validity Ratio (CVR). The mean CVR of all items was 0.842. By conducting exploratory factor analysis, it was found that the questionnaire has six dimensions. Three questions were removed from the study due to lack of connection with other items. Also, Cronbach’s alpha coefficient of the questionnaire is equal to 0.924, which indicates the appropriate reliability of the instrument.
This study aimed to develop a questionnaire to assess the safety attitudes of housewives toward home safety. It was found that the prepared tool has acceptable validity and reliability.
According to the World Health Organization (WHO), an accident is an event that occurs suddenly and unexpectedly, which leads to physical and mental injuries [1, 2]. Most of the accidents are preventable [2,3,4]. Home accidents occur within or around a home that can damage the house or resident. Falling, poisoning, electricity, choking, injuries, burns, and explosions are the most common accidents at home. These accidents could be due to different causes (e.g. poor home quality, children’s unsafe behaviors, and poor socioeconomic status) [1, 5].
Literature shows that approximately 25% of fatal accidents are home accidents . Coty et al. (2015) examined the beliefs and practices of the elderly about fire safety in residential homes. They used ethnography and semi-structured interviews to investigate the beliefs of the elderly about fire safety . Colver et al. investigated the impact of two health education approaches to improve the safety of children in residential homes using a randomized controlled trial . Kendrick et al. (2013) examined the role of home safety training in controlling home accidents. Barbara et al. (2004) examined the factors that determine mothers’ safety performance at home in taking control measures to prevent accidental injury to children. They found that the factors influencing the control measures were more likely related to the type of injury .
People’s attitudes are crucial to home safety. In many Eastern cultures, such as Iran, women are responsible for household chores. For example, mothers play a significant role in preventing children’s accidents . In general, women have two major roles (external and internal) in society. The external role includes activity in society, and the internal role is about motherhood and home . As a result, women have a long presence in the home environment and are generally more responsible for housekeeping and taking care of their children, the elderly and domestic appliances. Therefore, it seems that women have a significant role in the safety of their homes. Consequently, investigating women’s attitudes toward home safety can help reduce these incidents. This study aimed to design and psychometrically evaluate the questionnaire on women’s attitudes toward safety at home.
Materials and methods
Subjects and study design
This study is a cross-sectional descriptive-analytic study. It was carried out from January to June 2019. The general population in this study is Iranian women, and the target population consists of all housewives in 2019. Also, the accessible population is Iranian housewives who have children and are referred to Tabriz city health centers to perform their own or their children’s health activities . The sampling was multi-cluster type that in the first stage, 5 centers were randomly selected from 20 health centers in Tabriz. In the nex stage, Samples were randomly selected from within these clusters relative to the population of each cluster (in a health center with more housewives, more samples were selected). The questionary was pen-and-paper. Inclusion criteria were: having children, willing to participate in research, having at least a high school degree, and being over 18 years old. Exclusion criteria were evident mental illness (all target populations were previously registered with the health center, and the research team was able to identify people with mental health) and unwillingness to participate in the study. The purpose of the study and the importance of the study for home safety was explained to the participants participating in the study. The sample size needed to perform factor analysis to determine construct validity varies among researchers. Some literature considers a minimum of 200 for the sample size [12,13,14,15]. Klein also argues that exploratory factor analysis requires 10 or 20 samples per variable, but the minimum of 200 for sample size is also defensible . Thirty-nine items were identified for the initial questionnaire using a literature review. Therefore, ten samples per tool item were selected (390 samples). The final sample size was 645, considering a 10% samples loss and a design effect coefficient of 1.5.
In the first step, terms or concepts equivalent to home safety was extracted through a literature review. Electronic databases, including Pro-Quest, Scopus, Google Scholar, Science direct, and SID and Magiran’s Persian-language databases from 2000 to 2019, searched for related studies. Studies in Persian and English were selected. The search string comprised of (home OR house) AND (checklist OR questionnaire OR instrument) AND (safety). Two experts collected the concepts from the literature. In total, 45 terms and expressions of the questionnaire were collected. Then, these concepts were merged and finalized by a third person. After reviewing, removing, and merging common phrases, 39 phrases remained. Finally, these items were turned into questions by the research team. All statements were designed on a 5-point Likert scale (strongly agree = 1, agree = 2, no idea = 3, disagree = 4, completely disagree = 5).
To determine the instrument’s validity, face validity, content validity, and construct validity of the made instrument were evaluated [16,17,18]. The designed questionnaire was presented to a panel of experts, including 9 Occupational Safety and Health PhD experts (8 of these experts were with a PhD and one of them was a PhD student, but all of them had at least 2 years of experience in this filed).
Qualitative and quantitative methods were used to perform face validity. To determine qualitative face validity, ten experts were asked to comment on the level of difficulty, relevancy, and ambiguity of items in writing. Then, if the research team approved these comments, we would apply them to the item. For the quantitative approach, nine experts were asked to rate the importance of each item on a 5-point Likert scale: Completely important, important, moderately important, slightly important and not important. Then impact scores were calculated using formula 1, and items with scores less than 1.5 were excluded [19, 20]. Since all obtained impact scores were greater than 1.5 (mean score: 4.35), all items were retained for subsequent analysis.
In formula 1, frequency refers to the percentage of people who gave the item a score of 4 and 5, and importance is the average total score of people on importance based on the Likert scale.
To determine content validity, both qualitative and quantitative methods were used based on the assessment of experts. The content validity ratio (formula 2) and content validity index (formula 3) were measured to assess quantitative content validity. In order to determine the content validity ratio, nine experts (different from prior step experts) were asked to examine each phrase on a three-part scale (necessary, useful but not necessary, not necessary). Due to the number of experts and considering the Lowsheh table, items whose content validity ratio was equal to or greater than 0.78 were retained [21, 22].
In formula 2, “n” represents the number of experts who have chosen the necessary option and “N” represents the total number of experts. According to the content validity ratio decision table, if the panel of experts is nine people, the minimum acceptable validity for each item will be 0.78, which means that the relevant item with a significant level of reliability (P < 0.050) is essential in this tool [21, 23]. In the qualitative study of the questionnaire’s content, ten experts were asked to comment on issues such as Persian grammar, use of the right words, correct placement of items, and scoring in writing form. Then this comment was considered by the research team. In this regard, the questionnaire’s four items and rating system were corrected, and CVI and CVR were recalculated.
Waltz and Bausell method was used for Content validity . For this purpose, a designed questionnaire was provided to the experts. They were asked to determine the relevance of each item in the questionnaire based on Waltz and Bausell content validity index. Thus, the degree of relevance, simplicity, and clarity was separately assessed for each item by experts using the 4-point Likert Scale. The content validity index was determined by formula 3. According to the Waltz and Bausell method, items with a score higher than 0.79 are appropriate, between 0.70–0.79 need revision, and less than 0.70 are unacceptable.
At this point, none of the items had scores below 0.7. Also, after revising, the CVI of one of the items ranged from 0.70 to 0.79. Consequently, the content validity index of the item was re-evaluated for the second time by experts. The mean content validity index of the questionnaire was 0.94 and is considered appropriate based on the opinion of Polit and Beck .
The two-stage strategy of Muliak and Millsap model was used to determine the construct validity . For doing Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) a split-half method was used. In the first step, exploratory factor analysis was used to extract factors (latent variables). Kaiser-Meyer-Olkin (KMO) was performed to check the adequacy of the samples. The Bartlett Test of Sphericity was used in the sample to ensure that the correlation matrix underlying the factor analysis is not zero. Values above 0.7 in the KMO test and p-value less than 0.050 in Bartlett’s test were considered as the criterion of suitability for factor analysis . The principal component method with direct oblimin was used for data exploratory factor analysis. To determine the number of main factors of the questionnaire, three indices, including eigenvalue, fine-grained diagram, and contribution of each factor to the sum of the total variance, were used. The milestone of 0.3 was considered the minimum factor load needed to maintain each expression in the factors extracted from factor analysis . After extracting the factors and expressions in each factor, the degree of consistency of these factors with the main concept and dimensions was investigated. As a result, two sentences were omitted, and the instrument’s expression count reached 37. In the second step, confirmatory factor analysis was used to evaluate the relationships between the indicator and latent variables to validate the EFA model on a sample separately from the exploratory step. Confirmatory factor analysis shows whether tool items are appropriated and fitted to relevant factors based on theoretical expectations. The estimated method was maximum likelihood .
Confirmatory factor analysis
Structural equation modelling with confirmatory factor analysis was used to test the relationships between variables and the instrument’s psychometric properties. Model fit was evaluated using the chi-square statistic (χ2), chi-square ratio, and degrees of freedom (χ2 / df). Goodness-of-fit index (GFI), adjusted goodness-of-fit index (AGFI), mean square root approximate Error (RMSEA) and CFI > 0.9, χ2 / d < 5, GFI > 0.9, and AGFI≥0.8, RMSEA < 0.08 are considered as appropriate indices and reasonable values .
The reliability of the questionnaire means to what extent the questionnaire yields the same results under the same conditions . The reliability of the study questionnaire was calculated using Cronbach’s alpha coefficient and test-retest. Therefore, 20 participants were asked to complete the questionnaire in two steps with 2 weeks intervals . Cronbach’s alpha coefficient was used to investigate the internal consistency of the questionnaire. An alpha coefficient greater than or equal to 0.70 was considered as a satisfactory criterion . The reliability of stability and test-retest of the questionnaire were also assessed by repeated sampling and by calculating the intra-class correlation coefficient (ICC) . The whole process of designing and developing the questionnaire is shown in Fig. 1.
Results of statistical analysis
The mean age of participants in the panel of experts was 37.22 (4.96), and the mean of their work experience was 10.66 (4.55) years. One of the experts had a master’s degree, and the rest had a PhD. Of 800 distributed questionnaires for the construct validity survey, 686 (86% of the participants) were returned. The mean age of participants was 37.56 (7.53) years. Other demographic characteristics of the study population are listed in Table 1.
Collected data were analyzed using IBM SPSS Statistics for Windows, Version 24.0. (Armonk, NY: IBM Corp; 2016). The variables were described as Mean (SD) and frequency (percent). The skewness indices (absolute values less than 3) and kurtosis (absolute values less than 10) along whit Q-Q plot, were considered to evaluate the normality of the quantitative variables [26, 28]. A p-value of less than 0.050 was considered statistically significant in all tests. Finally, a total of 39 items were selected by the literature review. Four questions were excluded in the content validity section due to a CVR of less than 0.78. The mean CVR of all items was 0.842.
Confirmatory factor analysis results
In the construct validity section, the KMO sampling index value (0.935) is at the optimum level , and also the Bartlett, The test of Sphericity with a score of 6414.941 is significant (p ≤ 0.000) . Therefore, it is justified to perform factor analysis. Through factor analysis, seven dimensions were extracted, two of these seven dimensions having the same concepts and were placed in the same dimension (child safety). Three questions were excluded from the study for lack of relevance to any of the dimensions. Thus, the final questionnaire consisted of 32 questions and six dimensions as follows (Table 2):
Prevention dimension (F3): 5 questions
Safe thinking dimension (F1): 7 questions
Child safety dimension (F4): 6 questions
Commuting safety dimension (F5): 5 questions
Home safety requirements dimension (F2): 5 questions
Hazard identification dimension (F6): 4 questions
After performing the factor analysis process using IBM SPSS Amos 24.0 software, the model fit was evaluated according to the model output. Based on factor analysis, the fitting of the final model confirmed based on the following indices [27, 28]:
RMSEA = 0.048 < 0.08 and; CFI = 0.91 > 0.9; GFI = 0.91 > 0.9.
AGFI = 0.88 > 90 and IFI = 0.89 < 1, x2/df = 2.53 < 5.
Evaluation of the relationship between parameters and factors based on the final model showed that the items have significant loading on six factors. As shown in Fig. 2, the standardized factor loadings range from 0.32 to 0.85. According to the figure, all variables have a high correlation with their respective constructs. Question 23 (0.32) variables had lower correlations with other factor 5 variables and question 10 (0.48) variables than other factor 3 variables (prevention).
Cronbach’s alpha coefficient of the whole instrument was 0.901. The Cronbach’s alpha coefficient of each dimension is presented in Table 3. Three dimensions of the questionnaire have acceptable reliability, but the other three have low reliability, so the tool has relative internal reliability. The Intraclass Correlation Coefficient (ICC) ranged from 0.993 to 0.996 for all variables, confirming test-retest reliability. The results of the structural model evaluation and final questions are presented in Table 3. The final questionnaire consisted of 32 questions. The questionnaire items classified on a 5-point Likert scale from strongly agree to strongly disagree. Because the questionnaire was a 5-point scale, the options were scored from 1 to 5 (160–32). By adding the scores of each question, the scale score was obtained. Finally, by summing the scores of all scales, the individual’s attitude score was calculated.
Women in Iran and similar countries have a decisive role in the arrangement, decoration and protection of the home. Therefore, it is very important to examine their attitude towards home safety. This will be very helpful in determining remedial action (e.g. training). Previous studies have focused mostly on accident statistics and their types (1, 4, 5). Best of our Knowledge, no instrument has been introduced to examine people’s attitudes toward basic safety principles at home. Therefore, this study aimed to design and psychometrically evaluate a questionnaire to determine women’s attitudes toward basic safety principles at home. The CVI was 0.84 and the CVR was 0.94, which is quite appropriate considering the number of expert panels (n = 9). The reported results for CVI and CVR are appropriate (22–24). Also, the Adaptive Fit Index (CFI) results indicate the suitability of the model . The factor loadings of the questions posed for each structural factor in confirmatory factor analysis were above 0.5. This finding indicates that factors are well connected to questions . Also, the values obtained for RMSEA, GFI, and x2/df were 0.048, 0.91, and 2.53, respectively, all of which values, together with CFI, could indicate the suitability of the used model [26, 28].
Cronbach’s alpha criterion was used to assess the reliability of the questionnaire. Cronbach’s alpha coefficient was 0.901, which is higher than the acceptable value of this index (0.7). This value indicates that the internal correlations between the questionnaire questions are high, and therefore the questions asked are homogeneous . Also, the intra-class correlation coefficient results show that the designed instrument can have similar results at different times . Therefore, the final questionnaire has acceptable validity and reliability.
When developing questionnaires, there was some error (e.g. coverage error, sampling error, non-response bias, measurement error) [38, 39]. Researchers are aware of these errors and try to reduce them as much as possible. Our respondent rate was 86%, while Babbie (1998) suggests that a response rate of 70% or more is perfect . Measurement errors in the survey may be caused by interviewers, respondents, data processors, and other survey personnel . The researcher tried to use a component team to lower the effect of this error. The respondents may feel threatened by controversial questionnaire items or their sensitive nature, such as race, gender, or income. So, the study was explained to all participants, and the anonymous questionary was used; the principle of confidentiality was observed, and the research team tried to use positive or neutral questions [40, 41].
This study aimed to develop a questionnaire to assess the safety attitudes of housewives toward home safety. It was found that the prepared tool has acceptable validity and reliability. In this regard, governments and private institutions can benefit from the results of this questionnaire for planning to reduce housing accidents.
Limitations and future studies
The questionnaire was pen-and-paper, and all participants had at least a high school degree. As the accessible population were registered in health centers, the researcher used purposive site selection, which could lead to both coverage and sampling error . Researchers can use this questionnaire in future studies to examine women’s attitudes toward home safety in different societies and to examine possible factors affecting this attitude, including education level and household income. Also, by examining the validity and reliability of this questionnaire in another group of society, a tool can be obtained to examine the attitudes of different groups in society towards home safety.
Availability of data and materials
All data used for the analysis are available from the corresponding author upon request.
Content Validity Index
Content Validity Ratio
World Health Organization
Hamzaoglu O, Özkan Ö, Janson S. Incidence and causes of home accidents at Ankara Çigiltepe apartments in Turkey. Accid Anal Prev. 2002;34(1):123–8.
Cheraghi P, Poorolajal J, Hazavehi S, Rezapur-Shahkolai F. Effect of educating mothers on injury prevention among children aged< 5 years using the health belief model: a randomized controlled trial. Public Health. 2014;128(9):825–30.
Ramazani A, IZAD KM, Gholeenejad B, Amirabadizadeh H. Epidemiologic study and relationship factors of home injuries in clienteles to Birjand, s hospital in 2004; 2011.
Neghab M, Habibi M, RAJAEIFARD A, Choubineh A. Home accidents in shiraz during a 3-year period (2000–2002); 2008.
Falcone RA Jr, Edmunds P, Lee E, Gardner D, Price K, Gittelman M, et al. Volunteer driven home safety intervention results in significant reduction in pediatric injuries: a model for community based injury reduction. J Pediatr Surg. 2016;51(7):1162–9.
Coty M-B, McCammon C, Lehna C, Twyman S, Fahey E. Home fire safety beliefs and practices in homes of urban older adults. Geriatr Nurs. 2015;36(3):177–81.
Colver AF, Hutchinson PJ, Judson E. Promoting children’s home safety. Br Med J (Clin Res Ed). 1982;285(6349):1177–80.
Morrongiello BA, Kiriakou S. Mothers’ home-safety practices for preventing six types of childhood injuries: what do they do, and why? J Pediatr Psychol. 2004;29(4):285–97.
Gaines J, Schwebel DC. Recognition of home injury risks by novice parents of toddlers. Accid Anal Prev. 2009;41(5):1070–4.
Lantara N. The roles of woman as leader and housewife. Def Manag. 2015;5(1):2167–0374 1000125.
Asiamah N, Mensah HK, Oteng-Abayie EF. General, target, and accessible population: demystifying the concepts for effective sampling. Qual Rep. 2017;22(6):1607.
Garver MS, Mentzer JT. Logistics research methods: employing structural equation modeling to test for construct validity. J Bus Logist. 1999;20(1):33.
Hoe SL. Issues and procedures in adopting structural equation modeling technique. J Applied Quant Methods. 2008;3(1):76–83.
Hoelter JW. The analysis of covariance structures: goodness-of-fit indices. Sociol Methods Res. 1983;11(3):325–44.
Sivo SA, Fan X, Witta EL, Willse JT. The search for optimal cutoff properties: fit index criteria in structural equation modeling. J Exp Educ. 2006;74(3):267–88.
DeVon HA, Block ME, Moyle-Wright P, Ernst DM, Hayden SJ, Lazzara DJ, et al. A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh. 2007;39(2):155–64.
Drost EA. Validity and reliability in social science research. Educ Res Perspect. 2011;38(1):105.
Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006;119(2):166. e167–16.
Lacasse Y, Godbout C, Series F. Health-related quality of life in obstructive sleep apnoea. Eur Respir J. 2002;19(3):499–503.
SEVENHUYSEN G, TRUMBLE-Waddell J, JUNIPER E, GUYATT C, STREINER D, KING D. Clinical impact versus factor analysis for quality of life questionnaire construction. Commentary. J Clini Epidemiol. 1997;50(3):231–8.
Lawshe CH. A quantitative approach to content validity 1. Pers Psychol. 1975;28(4):563–75.
Dibehkhosravi A, SHIRALI GA, ROSTAM NKS, HOSSEINZADEH T, AHMADI AK, Tanha F. Validity and reliability assessment of safety culture questionnaire based on IAEA model in an oil and gas exploration company in Ahvaz; 2016.
Ayre C, Scally AJ. Critical values for Lawshe’s content validity ratio: revisiting the original methods of calculation. Meas Eval Couns Dev. 2014;47(1):79–86.
Waltz CF, Bausell BR. Nursing research: design statistics and computer analysis. Davis FA; 1981.
Polit DF, Beck CT. Essentials of nursing research: appraising evidence for nursing practice. Lippincott Williams & Wilkins. 2009.
Kline RB. Principles and practice of structural equation modeling. Guilford publications. 2015.
Tinsley HE, Brown SD. Handbook of applied multivariate statistics and mathematical modeling: Academic Press; 2000.
Chou C-P, Bentler PM. Model modification in covariance structure modeling: a comparison among likelihood ratio, Lagrange multiplier, and Wald tests. Multivar Behav Res. 1990;25(1):115–36.
Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011;2:53.
Bujang MA, Baharum N. A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: a review. Arch Orofac Sci. 2017;12(1).
Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297–334.
Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. USA: Oxford University Press; 2015.
Munro BH. Statistical methods for health care research. 2005;1: lippincott williams & wilkins;.
Poundja J, Fikretoglu D, Guay S, Brunet A. Validation of the French version of the brief pain inventory in Canadian veterans suffering from traumatic stress. J Pain Symptom Manag. 2007;33(6):720–6.
Johnson RA, Wichern DW. Applied multivariate statistical analysis, vol. 5. NJ: Prentice hall Upper Saddle River; 2002.
Gliem JA, Gliem RR. Calculating, interpreting, and reporting Cronbach’s alpha reliability coefficient for Likert-type scales. In: 2003: Midwest Research-to-Practice Conference in Adult, Continuing, and Community; 2003.
Mohammad Beigi Abolfazl MSN, Gol MA. Validity and reliability of different measurement tools and methods in applied Health Research. J RAFSANJAN UNIV MED SCI HEALTH SERVICES. 2014.
Groves RM, Fowler FJ Jr, Couper MP, Lepkowski JM, Singer E, Tourangeau R. Survey methodology: John Wiley & Sons; 2011.
Nolinske T. Minimizing error when developing questionnaires. To improve the academy. 1998;17(1):291–310.
Babbie E. The practice of social research 8th Ed Wadsworth publishing company. Belmont; 1998.
Pedregon CA, Farley RL, Davis A, Wood JM, Clark RD. Social desirability, personality questionnaires, and the “better than average” effect. Personal Individ Differ. 2012;52(2):213–7.
Geisen E, Romano Bergstrom J: Chapter 2 - Respondent–Survey Interaction. In: Usability Testing for Survey Research. edn. Edited by Geisen E, Romano Bergstrom J. Boston: Morgan Kaufmann; 2017: 21–49.
The authors would like to thank everyone who helped us throughout data collection. We also appreciate the efforts and assistance of the experts for coordinating this study. We also a ppreciate the Student Research Committee of Tabriz University of Medical Sciences for supporting this project. The ethical code of this project is (IR.TBZBED.REC.1398.596).
There is no funding for this study.
Ethics approval and consent to participate
The study received ethical approval from the Ethics Committee of Tabriz University of Medical.
All methods were carried out in accordance with relevant guidelines and regulations/Declaration of Helsinki.
Written and informed consent was obtained from all participants before the questionnaires were completed. They were also assured that all their information would be kept confidential.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The article has been updated to correct a duplicate author name.
About this article
Cite this article
Ahmadpour-geshlagi, R., Akbarinia, G.R., Gillani, N. et al. Development and psychometric assessment an instrument for investigating Women’s attitude toward home safety. BMC Public Health 22, 948 (2022). https://doi.org/10.1186/s12889-022-13363-x
- Home safety