- Research article
- Open Open Peer Review
Assessing health literacy in the eastern and middle-eastern cultures
BMC Public Healthvolume 16, Article number: 831 (2016)
Health literacy is a term employed to assess the ability of people to meet the increasing demands related to health in a rapidly evolving society. Low health literacy can affect the social determinants of health, health outcomes and the use of healthcare services. The purpose of the study was to develop a survey construct to assess health literacy within the context of regional culture. Different socioeconomic status among the Eastern and Middle Eastern countries may restrict, health information access and utilization for those with low literacy.
By employing expert panel, Delphi technique, focus group methodologies, and pre-testing using participants (N = 900) from the UAE and India, a survey construct to the Eastern-Middle Eastern cultures was developed. Reliability was assessed using Cronbach’s α and validity using Factor analysis. Kiaser-Meyer-Olkin (KMO) sampling adequacy and Bartlett’s tests were used to assess the strength of the relationship among the variables.
Inclusion of non-health related items were found to be critical in the authentic assessment of health literacy in the Eastern and Middle Eastern population given the influence of social desirability. Thirty-two percentage of the original 19-item construct was eliminated by the focus group for reasons of relevance and impact for the local culture. Field pretesting participants from two countries, indicated overall construct reliability (Cronbach’s α =0.85), validity and consistency (KMO value of 0.92 and Bartlett’s test of sphericity was significant).
The Eastern-Middle Eastern Adult Health Literacy (EMAHL13), screening instrument is brief, simple, a useful indicator of whether or not a patient can read. It assessespatients’ ability to comprehend by distinguishing between health and non-health related items. The EMAHL13 will be a useful too for the reliable assessment of health literacy in countries, where culture plays a significant impact. This will be the first steptowards providing equitable access to healthcare for countries that have large populations with low socioeconomic status.
The rapid proliferation of healthcare information and unprecedented technological advances of the past few decades have greatly increased the complexity of healthcare delivery, requiring patients to play a more active role in the management of their health . Many patients, particularly the elderly and the economically disadvantaged, face challenges in today’s healthcare environment because of this increasing sophistication of diagnostic and therapeutic procedures. Health literacy is a term employed to assess the ability of people to meet the increasing demands related to health in a rapidly evolving society . Health literacy encompasses the cognitive skills that enable people to comprehend and use health information in order to preserve and promote good health [3, 4]. In recent years, health literacy has gained significant attention because of its close relationship with the social determinants of health, health outcomes and use of healthcare services [3, 4]. Low health literacy has been associated with poor health outcomes resulting from poor adherence to intake of medication, limited understanding of the health system, the inability to comprehend health-related instructions for self-management, especially in case of chronic diseases [1–5]. As an example the prevalence of daiabetes was high among the uneducated versus those with college degree in the US .
Globally, several instruments have been used to screen adult health literacy, though many differ in their purpose and design . Despite the wide choice of available tools, mostof the standardized survey instruments were designed, developed and tested by and for English-speaking populations and may have limited utility in multi-ethnic, multicultural countries . It is now recognized that many of the available health literacy tools do not capture all aspects of health literacy, and most fail to consider the impact of local setting or culture . Without deference to cultural context, the assessment of health literacy inglobal populations, such as the Middle East, may be quite challenging . With the priority of family over personal autonomy and the patriarchal and hierarchical social structure common in Eastern and Middle Eastern societies, health literacy screening may be also be influenced by social desirability, where survey participants provide socially acceptable responses .
In the 40 years since its independence, the United Arab Emirates (UAE), a Muslim nation with a mosaic of many ethnicities, languages and cultures, has created an infrastructure of healthcare services comparable with international standards . The population of the UAE provides a distinct platform to understand health challenges and preferences related to the multi-ethnic populations of many Eastern and Middle Eastern cultures . The UAE is home to over 80 nationalities. Its population is comprised primarily of Asians (46 %) and Middle Eastern Arabs (39 %), with UAE nationals representing less than 20 % of the total eight million residents . Similar to many of its Gulf neighbors, thevast majority of the expatriate population in the UAE is made up of unskilled or semiskilled workers with limited formal education . To date, there are no published studies of health literacy in the UAE. The purpose of the study was to develop a survey construct to assess low literacy within the context of regional culture, and in doing so, overcome the barriers of cultural differences and social desirabilty. Identifying health literacy levels will be a significant step towards providing equitable access to healthcare and health system utilization for both the affluent and the socio-economically challenged countries of the East and the Middle East.
The Eastern-Middle Eastern-Adult-Health Literacy 13 point Questionnaire (EMAHL13) was designed to effectively measure health literacy levels of patients in Eastern and Middle Eastern cultures. A three-stage methodology was used in developing this questionnaire. In the first stage, a literature review was performed and Expert panel discussions were conducted. In the second stage, the questionnaire was revised after focus group review. In the final stage, a pilot study (pretest) of the questionnaire was completed using participants (N = 900) from two countries, India and the UAE. The study was conducted at 2 Joint Commission International accredited academic medical centers in the emirate of Abu Dhabi, UAE. No personal identifiers were collected from the survey respondents to link them to their responses. Instead, participants were assigned a random number to record their response, coded by an independent coder and centrally archived at Tawam Hospital. The research protocol received ethics approved by the local Institutional Review Boards in both countries (AAMDHREC 13/55 & REC 01.10.2013RS279).
Stage 1- expert panel
An expert panel comprised of a purposive sample of 11 individuals, representing the fields of medical education (n = 2), public health (n = 3), and clinical research (n = 1) as well as local community members (n = 5), was convened to examine relevant domains in the assessment of health literacy in Eastern and Middle Eastern settings, with the explicit intent of minimizing the influence of social desirability by the survey participants in this cultural context. The experts were fluent in English and at least one other local language. Delphi technique, a group consensus gathering methodology, was used to reach agreement among the panel members . After a comprehensive review of the literature pertaining to health literacy short screening tools, the content areas for inclusion in the questionnaire were primarily drawn from the Health Literacy Screening Brief Questions  to generate a conceptual framework relevant for Eastern and Middle Eastern cultures (Fig. 1).
Stage 2- focus group
A focus group (N = 10), comprised of a convenience sample of students (n = 2), patients (n = 3), healthcare providers (n = 1) and members of the local community (n = 4), was conducted to provide feedback on the content and readability ease of the survey questions proposed by the expert panel . Participants included both men and women between the ages of 18–50 years, who were able to understand, read and write English and at least 1 other local language. Participants especially from the community who were unable to consent were excluded. The Content Validity Index (CVI), a rating that the content is valid and consistent with the desired outcomes, was applied . Accordingly, each member of the focus group was independently advised to score each item of the survey generated by the expert panel between 0–100 points based on relevance and importance to the local culture and setting, with higher scores representing greater relevance and importance of the survey item. Items obtaining a mean score of 80 % ormore were accepted as survey questions .
Since the populations of the Middle East and Asia are predominantly non-native English speaking, a readability test was then applied to all resulting survey questions. The Flesch-Kincaid scale was chosen because of its convenience for computerized use, excellent reproducibility and high correlation with other established readability scales . The Flesch-Kincaid reading ease determines comprehension difficulty of written text on a scale of 0–100, with higher scores indicating that the material is easier to read. The Flesch-Kincaid grade level formula translates the score to a grade level, indicating the number of years of education generally required to understand a given text . Question difficulty was included in the item development to ensure that the final items could distinguish between low, moderate and high levels of health literacy .
Stage 3-pilot multicenter field Pre-testing
The revised version, containing the survey questions resulting from the focus group feedback, was used for the field pre-test. The pre-test was conducted using a purposeful sampling method, with the goal of including an equal distribution of participants with respect to age, gender and formal education. Patients from outpatient clinics from 2 major hospitals in the emirate of Abu Dhabi and 2 city hospitals in Mumbai, India were recruited for the study. Given the fact the study was conducted as the government-owned public hospitals in the UAE and India, a cross-section of urban and rural population participated in the study. Pilot field pre-testing involved face-to-face interviews between patient participants fromAbu Dhabi and Mumbai and the multilingual physician researchers. All respondents provided verbal consent prior to participation. A 5-point likert scale was used to assess participant responses [14, 18]. The response options included “1 = never, 2 = rarely, 3 = sometimes, 4 = most of the time and 5 = always” and the mean score for all item responses ranged from a minimumof 13 to a maximum of 65 for each participant. The scores distinguished between three levels of health literacy: 1–26 for “inadequate,”27-39 for “marginal” and 40–65 for “adequate” . The researchers also used an electronic tablet device to display pictures of hospital signs, appointment slips, medical insurance forms, informed consent forms, English and local language newspaper reports, and local currencies for the purpose of identification and to assess comprehension.
The final questionnaire EMAHL13 was translated from the original English version by certified health translators into the most prevalent languages in the UAE, namely Arabic, Hindi, Urdu, Tagalog and Malayalam. The surveys were then back-translated to English, in order to ensure that the structure, content and intent of the survey-items did not alter during translation. Although physician-researchers conducted the face-to-face interviews with the participants, the survey-items were translated into local languages to optimize participant comprehension.
Data was analysed using SPSS Statistical Software Version 20 (SPSS Inc. Chicago, USA) . The domains were identified using factor analysis . The widely used Principal Component Analysis (PCA) was used as the extraction method to undertake factor analysis; and Varimax rotation was used to rotate the factors to better fit the data [20, 21]. Convergent validity to assess if the survey items converged to measure a construct was also conducted using the Correlation coefficient matrix method . The percentage of total variance by each factor was calculated and pattern matrix was used to identify the domains. Kiaser-Meyer-Olkin (KMO) sampling adequacy and Bartlett’s tests (to assess the strength of the relationship among the variables) were also applied to the EMAHL13 [20, 21] . The reliability of the inventory and its subscales were tabulated using Cronbach’s alpha .
Expert panel (Stage 1)
Characteristics of age, gender, nationalities, education and professional status of the members of the expert panel were equally distributed. Approximately half (6/11) of the expert panel members were women. Forty-five percent (5/11) of the panel was composed of community members, 27 % were public health professionals, and 9 % were healthcare providers. The average age of the participants was 37 ± 3.9 years, with 45 % having education levels at the high school level or below. The percentage of Asians and Arabs was almost equally distributed at 40 % each (data not shown).
The expert panel accepted 3 of the 5 functional domains from Chew et. al. Health Literacy Screening Brief Questions , specifically navigating the health care system, filling-out medical forms, and reading and understanding patient information materials. A fourth domain, differentiating and demonstrating medications and publication, consisted of non-health related items, such as the ability to read newspapers. Fifteen items were adapted from the 3 domains of the Health Literacy Screening Brief Questions, an additional 4 questions were derived from non-health related and medication domains, culminating in a 19-item culturally relevant health literacy survey (Table 1). Items from both the reading and understanding of patient materials domain (31.5 %) and medication instruction /non-health related domain (31.5 %) constituted the majority of the total items (Table 1). This was followed by 21 % of items from the filling-out medical forms domain. Only 16 % of the items were selected from the navigating through the health system domain (Table 1).
Sixty-percent of focus group participants were women, with an average age of 32.6 ± 3.8 (mean ± standard deviation). The average age of the male focus group participants was 37.8 ± 7.3. Sixty percent of the participants had a baccalaureate degree and were employed (data not shown). The focus group session provided feedback on the structure, content and clarity of the survey questionnaire. The questions were formulated as “you can” taking cues from the common local communication pattern in Eastern and Middle Eastern societies. The focus group participants reviewed the 19 semi-structured, open-ended items proposed by the expert panel and chose to include or exclude survey items based on their relevance and importance to the local population. Table 1 indicates the content validity index score for relevance and importance of the local setting. Survey items that obtained average scores less than 80 % were thereby removed from the questionnaire. Removed items included completing health insurance forms (66.5 %) and patient registration forms (64.1 %), reading pharmacy prescriptions (61.7 %) and medical supply store location (67.7 %), understanding consumer product information (70.7 %), and understanding diagnosis instructions (66.7 %). Structural revisions to avoid repetitive or duplication of the survey questions were also addressed by the focus group. The Flesch-Kincaid readability ease (FRES) testindicated a score of 61 and Flesch-Kincaid Grade Level (FGLS) of 7. It has been demonstrated that a reading score of 60 indicates standard readability ease .
Multicenter field Pre-testing
The fieldtest participants were primarily women in both India (315/450, 70 %) and the UAE (272/450, 60 %). Compared to 66 % in the UAE, 80 % of the participants in India were employed. Quality assessment of the survey included survey length, completion time, understanding demographics, layout and scoring ease. There were no significant differences between the quality assessments of the survey instrument by the participants from either country (Fig. 2). The items related to the patient registration form, consumer product advertisement, medical store, pharmacy prescription, health claim form and diagnosis instructions were removed from the questionnaire in order to avoid duplication, as well as for their limited ability to directly assess health literacy (Table 2). The final health literacy construct (EMAHL13) is shown in Table 2. The average time required to complete the EMAHL13 survey was 11 min for participants from India and 13 min by UAE participants.
Validity and Reliability of the construct: The consistency of the health literacy scale (EMAHL13) was measured using the principal component analysis, obtaining a Kaiser-Meyer-Olkin value of 0.92, reaching statistical significance. Bartlett’s test of sphericity was significant (0.000). The principal component analysis revealed the presence of a component with an eigen value of 11.1, explaining 85.2 % of total variance, correlation coeeficient indicating relationship between the items are shown in Table 3. Cronbach’s α reliability assessment of each of the four domains ranged between 0.77 and 0.99 (Table 3) . The overall Cronbach’s α reliability score for all 13 items for the final construct was high at 0.85.
The scope and the number of surveys to measure health literacy have grown exponentially over the past decade . However, survey designs in global cross-cultural environments have had limited success in the collection of high quality data , especially when comparison data are needed. Additionally, the current validated instruments to assess health literacy are either too long or too difficult to be routinely integrated into clinical care. Non-English speaking communities prefer to have survey questions that are brief, simply stated with easy layouts, and administered by local language speaking staff to enhance participant trust and confidence . The EMAHL13 development has helped to overcome many of the above limitations.
Proper communication between patients and healthcare providers enables a shared understanding of patient values and treatment preferences that will lead to a care plan that is aligned with these values and preferences. Completing medical forms, reading patient information materials, navigating through the health care system and differentiating medications are the major activities through which patients engage with their health system and providers, for effective health services utilization . The domains of the EMAHL13 was conceived with the objective of maximizing health services utilization and health promotion (Fig. 1).
The UAE provides an optimal venue to study opportunities and challenges related to multi-ethnic populations given the large number of non-nationals from the East and Middle East. The primary advantage of the EMAHL13 is that it is brief, takes only a few minutes to administer, a distinct advantage for assessing patient health literacy. The structure of the final questionnaire, which involves “you can” before every item, aided in limiting the influence of social desirability .
Obstacles to routine screening for health literacy include several factors, including patient attempts to conceal illiteracy, reading impairments, and difficulty in understanding the survey questionnaire [17, 24]. The inclusion of non-health related items, such as counting local currency and reading the local newspapers, helped to assess participants’ comprehension ability, possible reading impairments, and more importantly, helped to dissociate between education levels and health understanding, a significant step that will aid in health promotion.. Studies have indicated that a vast majority of patients in the United States read at grade 7 levels . The readability ease (FRES) test indicated readability ease of 60 at grade level 7, signifying that the EMAHL13 would likely be easier for the local population to read. The 5-point “never to always” likert scale was used to provide distinct response choices for the participants in an effort to limit social desirability without affecting the survey reliability or criterion validity [7, 25]. The final construct met the reliability and validity criterion when compared with the Health Literacy Screening Brief Questions survey instrument. In both the UAE and India, the participants denied difficulty with the demographic questions, length and time to complete the survey, readability and comprehension, or layout and response choices.
Limitations of the study include the sampling methodologies, specifically convenience and purposive sampling, as the sample population may not be representative of all members of Eastern and Middle Eastern populations. However, these methods enabled an equal distribution of participants in regards to age, gender, ethnicities and education levels in the development of the survey construct. The EMAHL13, a researcher/interviewer-administered survey, also helped to overcome reliance on self-reported responses, which may be challenging in Eastern and Middle Eastern cultures. The blinding of the researcher/physician to the study hypothesis helped to overcome issues related to operator bias in administering the EMAHL13. The EMAHL13 is designed to be brief, simple, and serve not only as a useful indicator of whether or not a patient can read, but also provide information on the patient’s comprehension by distinguishing between health and non-health related items. Similar responses by the participants when the construct was tested in India and UAE indicate the flexibility, ease of understanding and feasibility of the instrument in the Eastern and Middle Eastern nations.
As Eastern and Middle Eastern countries have vastly different socioeconomic situations, health information access and health system utilization may be particularly challenging for those with low health literacy. Priority of family over personal autonomy and the patriarchal and hierarchical social structurein the East further compounds the problem of health resources access and health utilization. It is anticipated that the EMAHL13 will prove to be a useful tool to measure limited health literacy in the Eastern and Middle Eastern populations. Assessing health literacy in the local population will be a significant step towards providing equitable access to healthcare and health services utilization for countries that have large populations with low socioeconomic status . Health literacy screening will assist the Gulf Cooperation Countries, inclusive of the UAE, to efficiently manage resources for high health returns.
Mytton OT, Velazquez A, Banken R, Mathew JL, Ikonen TS, Taylor K, Painter F, Jean-Baptiste R, Poon A, Ruelas E. Introducing new technology safely. Qual Saf Health Care. 2010;19 Suppl 2:i9–14.
Baker DW. The meaning and the measure of health literacy. J Gen Intern Med. 2006;8:878–83.
Nutbeam D. The evolving concept of health literacy. Soc Sci Med. 2008;67:2072–8.
Berkman ND, Davis TC, McCormack L. Health literacy: what is it? J Health Commun. 2010;15 Suppl 2:9–19.
Zimmerman EB, Woolf SH, and Haley, A. Understanding the relationship between education and health: A review of evidence and an examination of cimmunity perspective. Agency for Healthcare Research and Quality. http://www.ahrq.gov/professionals/education/curriculum-tools/population-health/zimmerman.html. Accessed 11 Jan 2016.
Sørensen K, Van den Broucke S, Pelikan JM, Fullam J, Doyle G, Slonska Z, Kondilis B, Stoffels V, Osborne RH, Brand H. Measuring health literacy in populations: illuminating the design and development process of the European Health Literacy Survey Questionnaire (HLS-EU-Q). BMC Public Health. 2013;13:948–58.
Globe DR, Schoua-Glusberg A, Paz S, Yu E, Preston-Martin S, Azen S, Varma R. Using focus groups to develop a culturally sensitive methodology for epidemiological surveys in a Latino population: findings from the Los Angeles Latino Eye Study (LALES). Ethn Dis. 2002;12(2):259–66.
Andrulis DP, Brach C. Integrating literacy, culture, and language to improve health care quality for diverse populations. Am J Health Behav. 2007;31 Suppl 1:S122–33.
Horton R. Health in the Arab world: a renewed opportunity. Lancet. 2014;383(9914):283–4.
Nair SC, Ibrahim H. Informed consent form challenges for genetic research in a developing Arab country with high risk for genetic disease. J Genet Couns. 2015;24(2):294–9.
Nair SC, Ibrahim H, Celentano DD. Clinical trials in the Middle East and North Africa (MENA) Region: grandstanding or grandeur? Contemp Clin Trials. 2013;36(2):704–10.
http://www.bq-magazine.com/economy/socioeconomics/2015/04/uae-population-by-nationality. Accessed 4 Jan 2016.
Diviani N, Schulz PJ. What should laypersons know about cancer? Towards an operational definition of cancer literacy. Patient Educ Couns. 2011;85(3):487–92.
Chew LD, Bradley KA, Boyko EJ. Brief questions to identify patients with inadequate health literacy. Fam Med. 2004;36(8):588–94.
Marshall MN. Sampling for qualitative research. Fam Pract. 1996;13(6):522–5.
Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35(6):382–5.
Terblanche M, Burgess L. Examining the readability of patient-informed consents. J Clin Trial. 2012;2:157–62.
Yuen EY, Knight T, Dodson S, Ricciardelli L, Burney S, Livingston PM. Development of the Health Literacy of Caregivers Scale - Cancer (HLCS-C): item generation and content validity testing. BMC Fam Pract. 2014;15:202–9.
Nakayama K, Osaka W, Togari T, Ishikawa H, Yonekura Y, Sekido A, Matsumoto M. Comprehensive health literacy in Japan is lower than in Europe: a validated Japanese-language assessment of health literacy. BMC Public Health. 2015;15:505–11.
Liu RX, Kuang J, Gong Q, Hou XL. Principal component regression analysis with SPSS. Comput Methods Programs Biomed. 2003;71(2):141–7.
Parsian N, Dunning T. Developing and validating a questionnaire to measure spirituality: a psychometric process. Glob J Health Sci. 2009;1(1):1–11.
Smith TW. Developing and evaluating cross-national survey instruments. In: Presser S, Rothgeb JM, Couper MP, Lessler JT, Martin E, Martin J, Singe E, editors. Methods for testing and evaluating survey questionnaires. Hoboken: Wiley; 2004. p. ch21.
Nair SC, Ibrahim H. Assessing subject privacy and data confidentiality in an emerging region for clinical trials: United Arab Emirates. Account Res. 2015;22(4):205–21.
Easton P, Entwistle VA, Williams B. How the stigma of low literacy can impair patient-professional spoken interactions and affect health: insights from a qualitative investigation. BMC Health Serv Res. 2013;13:319–27.
Preston CC, Colman AM. Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences. Acta Psychol. 2000;104(1):1–15.
Mantwill S, Monestel-Umaña S, Schulz PJ. The Relationship between HealthLiteracy and Health Disparities: A Systematic Review. PLoSOne. 2015;10(12):e0145455.
The authors are thankful to Anju Swamy, Mumbai, India for the technical assistance with the study in India.
This study was not supported by funds or grants. No funding sources to declare.
Availability of data and materials
Source survey data from participants and materials collected as a part of this study has been coded by Protection of Information Program (PIP) at Tawam hospital and centrally archived per requirement of the central research ethics committee. Data cannot be shared for this reason. Decoded data can be made available upon request to the Funds, Organization for Medical Research Committee (FOMR) at Tawam hospital with justifiable reasons.
SCN was involved in the conception, design, data collection, drafting the manuscript and statistical support. KPS carried out data collection, data organization, statistical analysis, manuscript preparation and coordination. JS was involved in data organization, statistical analysis, manuscript preparation and coordination. HI contributed to the conception, design, data collection, critique of the manuscript and data archive (central repository). All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Participants personnel identifiers were not collected.
Ethics approval and consent to participate
The research protocol received ethics approved by the Al Ain Medical District Human Research Ethics Committee, accredited by Federal Wide Assurance (FWA) number 00007109 and he Health Authority Abu Dhabi (AAMDHREC 13/55 & REC 01.10.2013RS279). All participants consented verbally to participate in the study per ethics requirement.