- Study protocol
- Open Access
Protocol for a national, mixed-methods knowledge, attitudes and practices survey on non-communicable diseases
© Demaio et al; licensee BioMed Central Ltd. 2011
- Received: 27 September 2011
- Accepted: 30 December 2011
- Published: 30 December 2011
Mongolia is undergoing rapid epidemiological transition with increasing urbanisation and economic development. The lifestyle and health of Mongolians are changing as a result, shown by the 2005 and 2009 STEPS surveys (World Health Organization's STEPwise Approach to Chronic Disease Risk Factor Surveillance) that described a growing burden of Non-Communicable Diseases and injuries (NCDs).
This study aimed to assess, describe and explore the knowledge, attitudes and practices of the Mongolian adult population around NCDs in order to better understand the drivers and therefore develop more appropriate solutions to this growing disease burden. In addition, it aimed to provide data for the evaluation of current public health programs and to assist in building effective, evidence-based health policy.
This national survey consisted of both quantitative and qualitative methods. A quantitative household-based questionnaire was conducted using a nationally representative sample of 3854 rural and urban households. Participants were selected using a multi-stage cluster sampling technique in 42 regions across Mongolia, including rural and urban sites. Permanent residents of sampled households were eligible for recruitment, if aged between 15-64 years. This quantitative arm was then complemented and triangulated with a qualitative component: twelve focus group discussions focusing on diet, exercise and alcohol consumption. Discussions took place in six sites across the country, facilitated by local, trained health workers. These six sites were chosen to reflect major Mongolian cultural and social groups.
KAP surveys are well represented in the literature, but studies that aim to explore the knowledge, attitudes and practices of a population around NCDs remain scarce. This is despite the growing number of national epidemiological surveys, such as STEPS, which aim to quantify the burden of these diseases but do not explore the level of population-based awareness, understanding, risk-perception and possible motivation for change. Therefore this paper will contribute to building a knowledge base of NCD KAP survey methodology for future use in epidemiology and research worldwide.
- Non-Communicable Diseases
- KAP survey
The global increase of Non-Communicable Diseases (NCDs) in low- and middle-income countries, represents a major challenge to health services as well as social and economic development . In order to set quantifiable goals and priorities for reducing NCDs, countries must collect local data on disease and risk burden as well as the knowledge and attitudes of the population. This information is crucial in order to assist with developing targeted NCD programs and policies, and in evaluating current public health interventions .
Mongolia is a lower-middle income country with a GDP of approximately $3600US and a population of about 2.6 million . Today, more than half the total population lives in urban settings as a result of increased internal migration following transition to a free market economy in the 1990s . The exact health effects and outcomes of this transition process continue to be poorly understood, as are the levels of awareness and perceptions around the health effects of this social change.
This epidemiological and health transition involving social, economic, political, cultural and health change is happening at such a fast pace that neither the Mongolian government, nor regional governments have the capability to monitor, analyse and report this process and its health effects in a timely manner to implement evidence-based prevention .
Thus, a Knowledge, Attitudes and Practices Survey (KAPS) on NCDs complements existing STEPS data and allows public health planners and policy-makers to link and triangulate knowledge, attitudes and practices with disease and risk factor outcomes.
In 2010 the National Mongolian Knowledge, Attitudes and Practices Survey on NCDs was conducted amongst the adult Mongolian population. It aimed to identify and explore influences on NCD risk and burden. Despite KAP surveys having been used in public health for over 40 years, there continue to be very limited examples in the literature of their use in NCD epidemiology and policy. The 2010 KAP survey was a collaboration of the Mongolian National Institute of Public Health, the Copenhagen School of Global Health, EPOS Health Management and the National Institute for Health and Welfare, Finland.
The data from this survey is yet to be analysed, but is expected to serve as a valuable public health and policy tool, triangulating the major findings of the recent national STEPS surveys and acting as an evaluation tool for the Millennium Challenge Account (Mongolia) Health Project . In addition, it aims to provide data to improve national NCD prevention strategies as well as existing programs aimed at early detection and screening of hypertension, diabetes, breast and cervical cancer.
To assess and describe the knowledge, attitudes and practices of the Mongolian adult population on Non-Communicable Diseases and injuries in order to develop evidence-based NCD prevention policies and public health interventions. In addition, to triangulate and explain the recently observed increase in NCDs in Mongolia, as was made evident by the 2005 and 2009 STEPS surveys .
Setting and population
This mixed-methods survey consisted of two parts.
The first, a household-based, door-to-door questionnaire was conducted in 42 regions of Mongolia, including 21 rural sites and 21 sites in the capital, Ulaanbaatar. The questionnaire was implemented across five age-stratifications, as disaggregated analysis is planned (15-24 yrs, 25-34 yrs, 35-44 yrs, 45-54 yrs and 55-64 yrs). Only permanent residents of the households sampled were eligible for recruitment, aged between 15 and 64 years.
Urban affluent populations (national capital);
Urban poor populations (national capital);
Northern rural suburban;
Northern rural remote;
Southern rural suburban;
Southern rural remote populations.
This qualitative arm did not aim to be nationally representative, but purposefully sampled populations with varying cultures and demography from the Russian-Mongolian border, the Chinese-Mongolian border and the urban environment of the Mongolian capital, Ulaanbaatar.
Questionnaire and focus group discussions
Diet and nutrition;
Physical activity and exercise;
Weight and overweight;
General attitudes towards other NCD risk factors.
Cardiovascular disease (incl. stroke);
Breast and cervical cancers;
Road traffic injuries;
Finally, these thematic sections were followed by questions on the participant's demography, living conditions, level of education and affluence.
Given the sampled population was different from those sampled in the STEPS surveys, the questionnaire also included a limited number of important questions probing practices relating to chronic diseases, smoking status, alcohol consumption, nutrition and disease-detection. This will enable further in-depth analysis of the knowledge and attitudes and how these related to specific behaviours or practices.
Topics of Focus Group Discussions Question Guides
Topics of discussions
Directions of discussions
1. Knowledge of the role of fruit and vegetable consumption as a part of a healthy diet and nutrition;
2. Factors influencing fruit and vegetable consumption (social, economic, geographic, access);
3. Knowledge of negative and positive influences of fruit and vegetable consumption among the population and availability of information related to it;
4. Direct and indirect dietary sources of salt and knowledge the health impacts of salt consumption.
1. Understanding of what is physical activity;
2. Positive and negative health impacts of being physically active and inactive;
3. Awareness of types of physical activity.
1. Thoughts and knowledge of appropriate alcohol consumption;
2. Factors influencing excessive alcohol consumption;
3. Knowledge of the negative impacts and health risks of alcohol consumption.
45 local trained health workers from the National Public Health Institute administered the two-part survey. These field workers were trained in questionnaire implementation and focus group discussion facilitation by the expert working group (EWG) of national and international researchers.
Sampling methods and sample size
For the questionnaire, sample size was calculated for a nationally-representative sample and to reflect the need for disaggregated data analysis by age, gender and urbanicity. The calculation of the representative sample of the population was estimated considering a 95% confidence level. The baseline indicator was assumed at 50% and the acceptable margin of error of 6%. A complex sample design effect of 1.3 and equal representation of gender and age in each groups (5 groups in 10 years interval) was adopted, based on methodologies used for STEPS. Therefore, a sample size of 3,468 participants was determined. Based on previous survey experience an assumed non-response rate of 10% was adopted, resulting in an overall n = 3,854.
Participants for the quantitative research component were then recruited using a multi-stage cluster sampling technique across 42 locations. Sampling included four stages
Primary Sampling Unit
Based on proportional population to size (PPS) sampling, each of the 21 clusters was selected from 137 Khoroos (suburbs) in urban and 324 Soums (regions) in rural areas respectively;
Secondary Sampling Unit
For each Khoroo and Soum, 2 family centres (groups of ± 1000 households) and Baghs (sub-regions) were selected respectively using PPS;
Tertiary Sampling Unit
Based on the list of households from the selected secondary sampling units, 82-84 households were selected using simple random sampling to make a final sample;
One person aged 15-64 years in the selected household was selected at random. These were selected at random using a predefined, paper-based algorithm.
Focus group discussions of six to eight participants each, took place in six sites across the country. These sites were chosen in order to sample major known Mongolian cultures and social groups believed to likely influence the knowledge, attitudes and practices being studied. Purposive and snowball sampling were undertaken in the field to select focus group discussion participants. Trained health workers completed this sampling process in the field.
In addition to a group facilitator, each focus group had a trained scribe/observer. Discussions were also recorded and verbatim transcriptions made in Mongolian. These transcriptions were then complemented with notes, comments and clarifications from the scribe/observer.
Research rigour and quality control
Translation and Back Translation: The questionnaire was initially developed in English by the EWG of local and international researchers. Once completed, professional Mongolian translators with experience in medicine and public health translated the questionnaire into Mongolian (single national language). Mongolian speaking members of the EWG then checked the Mongolian version of the questionnaire. It was then back translated into English and again checked by the EWG.
Peer Review: At four stages during the questionnaire development, a peer-review adapted online Delphi process was undertaken drawing on expertise from all international research partners.
Pretesting: a pretesting process was undertaken using a Cognitive Interviewing technique with both clinicians and lay people . This process provided crucial and detailed insight into the fluency and interpretation of all questions.
Piloting: occurring in a controlled setting during the training of the 45 field workers, each was asked to administer the questionnaire six times to one another. Members of the EWG were on hand to take comments and record problems or observations. Mock focus group discussions were also run within the field worker training exercises. This allowed for pretesting of the FGD question guides and familiarisation of the methods.
For quantitative data, the prevalence and measures of central tendency of NCD risk factors, knowledge, attitudes and behaviours will be estimated. Population and sample weighting will be applied. Expected outcome measures (prevalence and mean variance) and differences between groups (age, gender and urban/rural groups) will be calculated with 95% confidence intervals. Sampling error, which could potentially affect the accuracy of the results of the survey, will be estimated from the standard error of variables. Multivariate regression analysis will be used to explore the relationship between knowledge, risk attitudes and disease or demographic parameters.
Consistent with a mixed-methods research approach, qualitative data will be used to triangulate quantitative data collected through the questionnaire. Analysis of qualitative data will be done using Directed Qualitative Content Analysis, conducted on the transcriptions taken from the FGD. In addition, comments, observations and concerns from the observer/scribe will be used to triangulate the transcriptions, affording greater opportunity for accuracy and interpretation. This process will be completed in Mongolian by researchers of the EWG and then translated into English.
Sept 11-Sept 12
Questionnaire and Question Guide Development
Field Worker Training
Data Entering and Transcription
The 2010 KAP survey, including data analysis and reporting is to be completed between August 2010 and September 2012 (Table 3).
This unique national survey involved a team of researchers from more than 5 countries, and the development of its methods and the questionnaire presented many challenges.
One hurdle was designing a new KAP questionnaire with few previous examples upon which to base our work. Despite more than 40 years since KAP surveys were first devised, little has been published with regards to NCDs and KAP surveys. A paucity of KAPS designed or implemented in low and middle-income countries further compounded this challenge. Our strategy for solving this was two-fold. Firstly, we widened our search scope and included current clinical guidelines, established clinical assessment tools such as the WHO AUDIT and KAP surveys in related or analogous fields - for example for HIV or TB . This proved fruitful and afforded a greater basis upon which to devise our methods and questionnaire. We also utilised proven components from the STEPS methodology, including sampling frames and solutions to field-worker logistics. The second important mechanism in solving this issue was to have a multi-disciplinary working group, which included epidemiologists, policy-analysts, psychologists and medical doctors. This diversity allowed us to bring skills and experience from a range of backgrounds to more efficiently create a rigorous NCD KAPS.
Our global and multidisciplinary team of partners, working to design and implement this survey was indeed a strength but also presented challenges for communication regarding questionnaire and methodology formulation. Utilising an adapted email-based Delphi approach, information was able to be collected from all parties to a central facilitator in a timely fashion. This feedback was then summarized and disseminated in a second round to all involved. Once agreed upon, decisions could be implemented efficiently. The facilitator, or gatekeeper for information, was usually Mongolian and this ensured the process was inclusive and transparent. We found this adapted Delphi approach very useful and effective, minimising the need for international travel and catalysing the planning processes.
This survey was not only large by sample size, but was implemented on a daunting geographic scale. Mongolia is the second-largest landlocked country in the world, so ensuring a nationally representative sample presented enormous logistic challenges. Timing was also limited as winter temperatures can drop to -40°C and a series of delays resulted in a rapidly closing implementation window. This was again, where having strong local research leaders became crucial. For the data collection, we were able to enrol and train 45 health workers from the National Public Health Institute. This number allowed us to send more than 20 data collection teams to the field at once. Similarly, logistic challenges were only overcome with local knowledge and experience. In this light, the leadership and support of local partners was essential and allowed for all data to be collected nationally within just 2 weeks.
One of the strengths of our methodology and approach, reported by many of the fieldworker team-leaders, was the high level of preparedness experienced by them and their teams upon reaching the field. This not only saved time, but also ensured greater scientific rigour for our survey. Thorough pretesting and piloting before departing for the field meant fieldworkers felt familiar with the sampling and research methods, as well as the questionnaire and discussion guides. We were also able to ensure that the questionnaire, designed to be read like a script, was fluent and consistent for both the fieldworker and the interviewee. This pretesting and piloting process was completed under the supervision of members of the EWG. Importantly, this allowed the questionnaire and methods to be improved as issues arose and before implementation began.
Finally, KAP surveys are well represented in the literature but studies that aim to explore the knowledge, attitudes and practices of a population around Non-Communicable Diseases and injuries remain scarce. This is despite the growing number of national surveys, such as the WHO STEPS, being implemented worldwide which aim to quantify the burden of these diseases but do not explore population-level awareness, understanding, risk-perception or motivation for change. Therefore, in order to understand NCDs from a population perspective and build evidence-based public policy and interventions aimed at addressing NCDs, KAP surveys such as this will prove increasingly important (Additional File 1).
This study is funded by the Millennium Challenge Account - Mongolia Health Project.
- World Economic Forum: Global Risks Report. A Global Risk Network Report. 2010, Geneva: World Economic Forum, 24-26.Google Scholar
- World Health Organization: STEPS Survey Report. 2009, World Health Organization. Ulaanbaatar, MongoliaGoogle Scholar
- World Health Organization: World Health Statistics. 2008, World Health OrganizationGoogle Scholar
- World Health Organization: WHO Global Infobase. 2009, World Health OrganizationGoogle Scholar
- Manaseki S: Mongolia: A Health System In Transition. Br Med J. 1993, 307 (6919): 1609-1611. 10.1136/bmj.307.6919.1609.View ArticleGoogle Scholar
- World Health Organization: STEPwise Approach to Surveillance (STEPS) Manual. 2008, Geneva: World Health Organization, 1Google Scholar
- Department of Health: Annual Health Report. 2010, Directorate of Health. Ulaanbaatar: Ministry of HealthGoogle Scholar
- National Heart Foundation of Australia: Guide to management of hypertension 2008, Updated 2010. 2010, National Blood Pressure and Vascular Disease Advisory Committee. CanberraGoogle Scholar
- World Health Organization: Global Strategy on Diet, Physical Activity and Health. Geneva. 2004Google Scholar
- Babor TF, Higgins-Biddle JC, Saunders JB, Monteiro MG: The Alcohol Use Disorders Identification Test. 2001, Geneva: World Health Organization, 2Google Scholar
- World Health Organization, Stop TB: A Guide To Developing Knowledge, Attitude And Practice Surveys. Geneva. 2008Google Scholar
- Mohan D, Raj D, Shanthirani C, Datta M, Unwin N, Kapur A, Mohan V: Awareness and knowledge of diabetes in Chennai--the Chennai Urban Rural Epidemiology Study [CURES-9]. The J Assoc Physicians of India. 2005, 53: 283-287.Google Scholar
- Devins GM, Binik YM, Mandin H, Letourneau PK, Hollomby DJ, Barre PE, Prichard S: The Kidney Disease Questionnaire: a test for measuring patient knowledge about end-stage renal disease. J Clin Epidemiol. 1990, 43 (3): 297-307. 10.1016/0895-4356(90)90010-M.View ArticlePubMedGoogle Scholar
- North SL, Neale RJ: Knowledge, attitudes and eating habits of teenagers with respect to salt in their diet. British Food J. 1995, 97 (5): 3-11. 10.1108/00070709510091010.View ArticleGoogle Scholar
- Zanolin ME, Visentin M, Trentin L, Saiani L, Brugnolli A, Grassi M: A questionnaire to evaluate the knowledge and attitudes of health care providers on pain. J Pain Symp Manage. 2007, 33 (6): 727-736. 10.1016/j.jpainsymman.2006.09.032.View ArticleGoogle Scholar
- Xiang N, Shi Y, Wu J, Zhang S, Ye M, Peng Z, Zhou L, Zhou H, Liao Q, Huai Y, et al: Knowledge, attitudes and practices (KAP) relating to avian influenza in urban and rural areas of China. BMC Infectious Dis. 2010, 10 (34):Google Scholar
- Schopper D, Doussantousse S, Orav J: Sexual Behaviours Relevant to HIV Transmition in a Rural African Population. Social Sci Med. 1993, 37 (3): 401-412. 10.1016/0277-9536(93)90270-E.View ArticleGoogle Scholar
- DeMaio TJ, Rothgeb JM: Cognitive interviewing techniques: In the lab and in the field. Answering questions: Methodology for determining cognitive and communicative processes in survey research. Edited by: Schwarz N, Sudman S. 1996, San Francisco: Jossey-Bass, 177-195.Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/11/961/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.