Skip to main content
  • Research article
  • Open access
  • Published:

Socioeconomic and demographic predictors of resident knowledge, attitude, and practice regarding arthropod-borne viruses in Panama

Abstract

Background

We sought to identify if socioeconomic and demographic factors play a role in resident knowledge, attitude, and practice regarding Dengue, Chikungunya, and Zika in order to inform effective management procedures for disease prevention in Panama, a middle-income tropical country in Central America. All three are arthropod-borne viruses transmitted by Aedes mosquito vectors present in the focal region of Panama City, the largest city in Central America and an urban region of extreme socioeconomic polarization.

Methods

Between November 2017 and February 2018, we administered standardized, anonymous knowledge, attitude, and practice surveys to 263 residents split between two neighborhoods of high socioeconomic status (SES) and two neighborhoods of low SES. We then summed the knowledge, attitude, and practice scores respectively, and used linear and logistic regressions to quantify relationships with socioeconomic and demographic factors.

Results

Low-SES neighborhoods with high proportions of low income residents, residents over 70 years old had lower mean knowledge scores compared to other groups. Furthermore, residents in neighborhoods of low SES reported more mosquito biting relative to residents in neighborhoods of high SES, yet comparably lower level of concerns for disease transmission. Additionally, knowledge was lower for the more novel emergent threats of Chikungunya and Zika, compared to the endemic Dengue.

Conclusion

Findings suggest that low-SES neighborhoods with high proportions of low income, low education, and elderly residents should be targeted for outreach programs designed to prevent DENV, CHIKV, or ZIKV in Panama City. These outcomes support our initial hypotheses as lower relative knowledge and fewer practices related to the prevention of Dengue, Chikungunya, and Zika were found in low-SES neighborhoods. There is also a widespread lack of adequate knowledge regarding these diseases as well as low levels of concern in areas of highly reported mosquito biting. We provide suggestions for taking neighborhood socioeconomic status and specific aspects resident health literacy and attitude into account for creating more effective outreach campaigns as both endemic and novel arthropod-borne disease rates continue to increase throughout Latin America.

Peer Review reports

Background

Arthropod-borne viruses (e.g., Arboviruses) are responsible for over 1 million deaths a year globally, in addition to causing hundreds of billions of dollars in societal costs [1]. Dengue virus (DENV), Chikungunya virus (CHIKV), and Zika virus (ZIKV) are three particularly significant arbovirus threats. They are primarily transmitted to humans, the principal host, by Aedes aegypti and Aedes albopictus mosquitoes, whose ranges and capacity to spread disease have greatly expanded in recent decades as a result of globalization [2], urbanization [3], and climate change [4]. The risk of disease outbreak due to these arboviruses is not only reliant on the presence of infected mosquitoes, but also requires a susceptible host population to sustain transmission. For comprehensive risk assessments of DENV, CHIKV and ZIKV, Aedes vector surveillance can be supplemented with information on socioeconomic and demographic characteristics of human communities, as these are likely key predictors of viral transmission dynamics [5, 6]. Observing the distribution of medical knowledge, fear of transmission, and disease prevention practices across communities of varying socioeconomic and demographic characteristics can inform management procedures to areas where public education and outreach may be more effective means of disease prevention than vector control.

Knowledge, Attitude, and Practice (KAP) surveys have been used for decades to gauge community risk for numerous medical issues ranging from HIV/AIDS [7] to tobacco use [8]. For arbovirus transmission risk assessments, KAP surveys can be used to estimate knowledge of vector behavior and disease characteristics, attitudes or fears towards the vectors and viruses, and applications of any methods they use to prevent themselves from encountering mosquito vectors. Survey responses can be linked with data on the respondent’s personal attributes (e.g. age, sex, education level, financial situation, medical history) to identify common trends or differences among groups in an attempt to define risk predictors [9]. KAP surveys have been commonly applied in malaria zones in Asia and Sub-Saharan Africa, identifying education and income as a direct socioeconomic predictors of knowledge of malaria transmission as well as quantifying the relationships between past exposure to the disease and future preparedness [10,11,12,13]. Demographic characteristics such as age have also been found to be linked with KAP, specifically revealing that knowledge is lowest among older respondents [14]. KAP studies in endemic Dengue Fever regions have shown that a community can be knowledgeable of risk, yet not take any precautions to avoid Dengue transmission [15, 16]. Further studies have found the reverse, where communities can have very little knowledge of Dengue transmission, yet employ high levels of preventatives measures [17]. This seeming contradiction indicates the importance of conducting assessments of community KAP at each individual region of interest, rather than extrapolating results from other studies. One key gap in the literature is the understanding of variations in resident KAP as it pertains to multiple spatially coexisting diseases. As both vectors and pathogens continue to arise in novel locations, it is important to understand how residents view emerging diseases compared to endemic ones. To date, yet few KAP studies on the emergent threats of ZIKV and CHIKV have taken place in the Americas, where dengue is considered endemic [18, 19].

In this study, we attempt to estimate how resident knowledge, attitudes, and practices concerning three arboviruses vary between socioeconomically differing communities. Understanding a community’s capacity to withstand disease in the context of socioeconomics is an important aspect of social determinants of health [20]. Economic stability [21, 22], education [23], social context [24], and the built environment [25] all contribute to the relative health risk of an individual. They impact one’s access to healthcare [26], social support [27], public safety [28], and even exposure to pathogens [29, 30]. Therefore, examining the increasing risk of arbovirus transmission under the lens of social determinants of health can provide meaningful feedback for public health authorities in regions where residents may be at a greater risk due to specific socioeconomic conditions. Here we address this subject in Panama City, Panama, a region where both arbovirus transmission and socioeconomic polarization are particularly high.

While DENV has been endemic in Panama since 1970, CHIKV was first reported in 2014, followed by ZIKV in 2015. All three arboviruses are now present in Panama City, the largest city in Central America and a hub of international trade and tourism, with 2.5 million people arriving to the city from abroad in 2017. Additionally, Latin America has the highest income inequality of any region on Earth [31, 32], with Panama having the second most unequally distributed wealth in the region, with a Gini coefficient of 0.50. Panama City specifically has a considerable division between high and low income communities, ranking in the top 20 of cities on Earth with the most unequally distributed wealth. About 48% of the country lives below the poverty line while the wealthiest 20% own 50% of the nation’s overall wealth [32, 33]. This has led to vastly different neighborhood environments and community demographics, including highly wealthy and educated high-rise communities situated in close proximity to communities of extreme poverty. With a constant influx of potential hosts, stark socioeconomic contrasts, a climate supporting year-round mosquito development, and risk of three separate arboviruses, Panama City represents an ideal location to apply KAP surveys as a mean of assessing outbreak preparedness in the region. We frame our study within the context of social determinants of arbovirus transmission risk by administering KAP surveys to contrasting neighborhoods within the same urban region. Based on the results of previous investigations, we expect lower relative knowledge and fewer practices related to the prevention of DENV, CHIKV, and ZIKV among residents of communities of lower SES. We also expect relative knowledge about emergent CHIKV and ZIKV to be lower than that of endemic DENV.

Methods

Study areas and sampling design

In order to isolate social determinants of health as drivers of KAP, we identified four neighborhoods in Panama City by creating a socioeconomic index of all counties (e.g., Corregimientos) out of two key metrics that have been used previously to describe local socioeconomic conditions for health disparity research [34, 35]: 1) average household income and 2) percentage of residents with bachelor degrees or higher. We obtained the values of these variables for each “Corregimiento” from the National Institute of Statistics and Census (http://www.contraloria.gob.pa/inec/, 2010). We then normalized and averaged them across all Corregimientos in order to attain a percentile ranking of SES for the Metropolitan Panama City. We then selected four focal neighborhoods, two in the 95th percentile and two in the 5th percentile based on similarity in population density and normalized difference vegetation index. The unselected neighborhoods in each stratum (n = 15–20) consisted of study populations that were too small or too far from the city center to be appropriate for the study. The two high SES neighborhoods, Costa Del Este and Punta Pacifica, primarily consist of high-rise apartment buildings, office buildings, and gated housing communities interspersed by parks and vacant lots. The two low SES neighborhoods, Altos De Las Torres and Boca La Caja, primarily consist of conjoined single-story family homes and businesses (Table 1). Built-up land or impervious surface is the primary land type across all four neighborhoods. Costa Del Este, Punta Pacifica, and Boca La Caja are located along the coast, while Altos De Las Torres is located 3.8 km inland. The average monthly family income in the high SES neighborhoods is over $1400, while the average monthly family income in the low SES neighborhoods is less than $350. Similarly, in the high SES neighborhoods, 34% of residents have a bachelor degree or higher, while 3.5% of residents in the low SES neighborhoods have a bachelor degree or higher.

Table 1 Characteristics of each focal neighborhood

A 100 m grid was created in each selected neighborhood, with each vertex serving as a focal point for surveys. The first person to answer the door at the four closest properties were approached for surveys and if rejected, the adjacent property was approached. In multi-family structures, such a high-rise apartment, we recruited by approaching the first four people that exited the building entrance upon our arrival, with permission from building managers. This allowed for a more complete spatial coverage of each neighborhood as well as a more representative cross section of the community than would have been obtained if certain demographic proportions had been targeted. However, while we did not target specific proportions of groups, this may be interpreted as an example of quota sampling, which is itself a form of non-probability sampling. Non-probability sampling is a commonly used tool in public health [36,37,38,39], and while advantages have been identified [40], it is an often criticized tool based on its inability to allow for extrapolation or generalization of results [41, 42]. While these shortcomings are acknowledged, this study was intended to provide direct assistance to local public health authorities, who benefited from results based on true population proportions. Further studies on this topic using competing methods, such as probability sampling, are invited. Based on the layout of the grid and number of vertices, we attempted to complete 60 surveys (15 grid points) in Boca la Caja, 72 (18 grid points) in Altos de las Torres, 72 (18 grid points) in Costa del Este, and 64 (16 grid points) in Punta Pacifica.

Instrument

The questionnaire was developed based on reviewing previous KAP studies, incorporating a combination of subject matter and question formats that have been successfully applied in Africa, Asia, Europe, and Latin America regarding DENV, ZIKV, and malaria risk [10, 12, 15, 17, 43,44,45]. Additionally, it is designed to be a pilot for a wider scale survey on infectious disease risk across Panama to be conducted in the future. The questionnaire first involved gathering information on the resident’s demographic, educational, occupational and economic situation. Then, multiple-choice prompts measured the resident’s knowledge of DENV, CHIKV, and ZIKV. This involved asking if they were familiar with these diseases as well as whether or not they are preventable with a vaccine, curable with treatment, what their primary symptoms are, and how they are transmitted. Next, multiple choice questions assessed the resident’s knowledge of mosquito ecology, including the time of day they are most active. We then used Likert scales to gauge the resident’s worry of contracting each disease and whether they believe each disease should be a concern for the community. The next portion of the questionnaire asked the resident whether they implement any vector control strategy or mechanisms on their property, which specific mechanisms they use, and how often they are applied, and whether they think they are effective or not at limiting disease. This is not assessing their knowledge of the literature, but instead gauges their perception as to the effectiveness of vector control. The final questions asked where they have received most of their information on preventative tips, what they would do if they thought they had contracted one of the aforementioned diseases, and how many times they think they are bitten by a mosquito each day.

Informed written consent was obtained from each participant before the survey administered by a trained interviewer. The surveys were filled out in-person using pencil and paper between 9:00 am - 4:00 pm. While this may have incurred bias against individuals with full-time employment, there were safety risks that prohibited interviewers from surveying outside those hours.

Data management and analyses

Survey answers were entered into Microsoft Excel once in full with an additional 50% entered alongside the original as validation. For the knowledge questions, correct answers include knowing there is no vaccine or therapeutic cure for any of the three diseases. At the time of the survey, a DENV vaccine was briefly provided with considerable publicity in parts of Brazil, but this was never offered in Panama; we expected our respondents to answer with regard to what was available to them. Correct answers for primary modes transmission are only mosquito for all three diseases. ZIKV does have other modes of potential transmission, yet vector-borne transmission is responsible for 95% of the basic reproductive number [46]. Correct answers for the primary symptoms of DENV were headache, fever, rash, muscle pain, or joint pain. Correct answers for the primary symptoms of CHIKV were headache, fever, and joint pain. Correct answers for the primary symptoms of ZIKV were fever, rash, joint pain, and conjunctivitis. Incorrect answers were provided for each question as well (see Additional file 1: Survey). Correct answers for the primary time of day for mosquito activity is anytime except night. The answers to the symptom questions were weighted so as not to disproportionately affect the results. Specifically, while correct answers to the other questions in the knowledge section were given a point value of one, each correct symptom was given a 0.25 point value so that all four correct symptoms summed to one, for each disease. The attitude questions were entered as they were answered using the Likert scales, scaled 1–7 (low to high). Respondents were asked to rank how worried they were about contracting each of the diseases, how much of a major problem they thought that contracting the diseases might be for their health, and how likely they were to seek medical attention if they believed they had contracted one of these diseases. The practice questions were entered similarly to the knowledge questions. Eight options were provided: frequently change the water in flower pots/vases, sleep under bed net at night, remove containers that accumulate clean water, eliminate tanks and puddles that accumulate water, drink from tightly closed water containers, keep windows and doors closed in the house, request fumigation, and other (a space for options not listed). A weighted value was recorded for each option they reported doing, similar to the knowledge section, where reporting participation in all preventative measures equaled a value of one. For the question of how often they apply each method, options were daily, weekly, every 2 weeks, monthly, and yearly. For the question of where they learned about preventative measures, they were given the option of TV, radio, newspaper, at work, in school, neighborhood campaign, family/friend, medical professional, or other. For the question of what they would do if they thought they had contracted one of the diseases, options were provided as: Centro de Salud (primary health center), private hospital, public hospital, or other. Finally, the number of times they report being bitten by a mosquito each day was recorded.

For data analyses, the limitations of quota sampling must be acknowledged. Because samples are not randomized, there are certainly concerns over equal variance. Studies that employ non-probability sampling widely apply the same significance testing procedures as those that use probability sampling, yet there are important considerations to be aware of [47]. Thus, we conduct our significance testing with the understanding that assumptions of equal variance cannot necessarily be met, due to the inherent design of the sampling, and we recommend readers interpret the results with the same precautions. Still, quota sampling has undeniable advantages [40, 48], specifically in its low cost and direct value to local public health authorities who prefer studies with representative samples of the communities they monitor.

We first used chi-square tests [49] to compare demographic and socioeconomic attributes between the two SES neighborhood categories (e.g. high, low). Then, the knowledge responses were summed to attain an overall knowledge score (0–18), which was used as the main dependent variable in the knowledge analyses, while the socioeconomic variables and demographic characteristics (Table 1; individual-scale), and the SES of the neighborhood (SES-scale) were used as predictors. We also assessed collinearity using variable inflation factors, and we report the models that contain solely significant and non-confounding relationships. Effects between overall knowledge score and socioeconomic and demographic predictors were assessed using generalized linear models (GLM; [50]) regressions. GLMs do not assume normality nor homogeneity of variance, and so would be appropriate for use in non-probability survey sample datasets. The attitude variables were assessed by summing and the Likert scale responses. Using the same socioeconomic variables, demographic characteristics, and neighborhoods as predictors, generalized linear models were then generated for the overall score and individual question scores. For the practice variables, generalized linear models with either logistics or Poisson linkages were used, depending on the format of the particular variable. Missing data was rare and thus was not imputed. All analyses were conducted in Stata IC version 15 [51].

Results

Socio-demographic characteristics of sample population

A total of 263 surveys were applied to residents of four focal neighborhoods of Panama City, between November 2017 and February 2018. Table 2 indicates the socioeconomic and demographic characteristics of the respondents, divided by neighborhood, respectively. Because the neighborhoods were chosen specifically for their socioeconomic differences and surveys were indiscriminately conducted based on location in the neighborhood rather than respondent attributes, there is significant variation between groups for most of demographic characteristics. While there was no significant difference in sex ratio overall, the high SES group had significantly more male respondents than the low SES group (P < 0.01). The ages of the respondents varied by SES, with the low SES group having higher proportions of older respondents compared to the high SES group (P < 0.01). Ethnicity varied in that there were higher proportions of white and indigenous respondents in the high SES group than the low SES group (P < 0.01). Respondents in the high SES group had completed more schooling than the respondents in the low SES neighborhoods (P < 0.01), yet both personal and family monthly income did not vary by SES group. This may be a result of inaccuracies in self-reported income [52].

Table 2 Socio-demographic characteristics of the focal neighborhoods

Knowledge

Knowledge scores were significantly related to the respondent’s age, monthly family income, and marital status (Table 3). Specifically, controlling for other factors, respondents over 70 years of age had knowledge scores lower than respondents in the other age brackets by a factor of 2.14 (Fig. 1; P < 0.02). Respondents with a monthly family income of over $2500 had a knowledge score higher than the other income brackets by a factor of 3.53 (P < 0.01). Additionally, respondents with a marital status of free union had knowledge scores lower than other marital statuses by a factor of 1.22 (P < 0.02). Overall SES group was not associated with log knowledge score, nor was neighborhood, individual monthly income, education level, ethnicity or employment status.

Table 3 Significant results of GLM model to predict the knowledge score across all respondents. Other variables were insignificant estimators
Fig. 1
figure 1

Variation in respondents answers to knowledge questions on DENV, CHIKV, and ZIKV

There were more skewed results found within the answers for specific questions (Fig. 1). Overall, 98% of the respondents were familiar with DENV, 89% were familiar with CHIKV, and 86% were familiar with ZIKV (Chi-square: P < 0.01). Additionally, 56% of respondents believed there is a vaccine for DENV, 55% believed there is a vaccine for CHIKV, and 52% believed there is a vaccine for ZIKV, though the difference is not statistically significant. Further, 83% believed DENV is curable, 73% believed CHIKV is curable, and 68% believed ZIKV is curable (Chi-square: P < 0.01). The majority of respondents correctly identified the primary source of transmission for DENV, CHIKV, and ZIKV with 81, 74, and 71% respectively selecting mosquitoes (Chi-square: P < 0.01). For symptoms of the diseases, the average number of correct answers for DENV was 1.9, versus 0.9 for CHIKV and 0.7 for ZIKV. Only 8% of respondents did not select a correct symptom for DENV, compared to 47% for CHIKV and 55% for ZIKV (Chi-square: P < 0.01). Lastly, 45% of respondents correctly identified DENV as being transmitted by a diurnal mosquito, compared to 39% for CHIKV and 37% for ZIKV (Chi-square: P < 0.01).

Attitude

Overall, 42% of respondents had attitude scores of 63, meaning they had answered 7 to all questions and were fully worried about contracting any of the diseases, felt that any of the diseases would be a major problem for their health, and were fully likely to seek medical attention if they believed they had contracted any of them. The average value across all respondents was 52. The responses for each specific disease within the first question, how concerned they were about contracting each disease, were highly correlated (> 0.90), indicating minimal variation in responses between diseases for each question. For the question of how much of a major problem contracting each disease would be for their health, responses for each disease were also highly correlated (> 0.83). Correlation among responses for the final question, regarding whether the respondent were likely to seek medical attention, was more varied, with a 0.59 correlation between the DENV responses and both the CHIKV and ZIKV responses despite the CHIKV and ZIKV responses remaining highly correlated (> 0.96). Still there was no significant difference in the mean score between any of the diseases. When asked the number of times they believed they are bitten by a mosquito per day, 54% reported zero, while 33% reported 1–5 times, with the remaining 13% reporting being bit more than five times daily.

Group SES, monthly family income, and number of times reported being bitten by mosquitoes daily were significant predictors of the attitude score (Table 4). Controlling for all other factors, respondents in the high SES neighborhoods exhibited a significant increase in attitude score (P < 0.00) compared to those in the low SES neighborhoods (Fig. 2). Similarly, a monthly family income under $800 led to a significant decrease in the log sum attitude score (P < 0.00). Lastly, an increase in the number of times being reported bitten by a mosquito per day led to a significant increase in attitude score (P < 0.00). The number of times reported being bitten was also significantly related to neighborhood SES (Fig. 3), as respondents in high SES neighborhoods reported 1.98 daily bites than respondents in low SES neighborhoods (P = 0.00).

Table 4 Significant results of GLM model to predict the attitude score across all respondents. Other variables were insignificant estimators
Fig. 2
figure 2

Difference in attitude score across SES groups (P < 0.00)

Fig. 3
figure 3

Difference in the number of preventative practices employed by residents in each SES group (P < 0.01)

Practice

A total of 66% of residents reported being aware of measures taken by the local authorities to combat the spread of DENV, CHIKV, and ZIKV. When asked what measures they were aware of, 59% said fumigation, followed by 21% who said either “cleaning” or “clearing trash.” The remaining 20% included respondents being aware of education campaigns, the prevention of water accumulation, and fines. When asked which personal steps they take to avoid contracting the three diseases, an average of 3.7 practices were listed across all respondents. The most commonly reported practice was the elimination of tanks or puddles with stagnant water, selected by 84% of respondents. This was followed by 80% of respondents who reported that they remove containers that may accumulate clean water. Additionally, 61% of respondents reported drinking from cisterns or tanks that are kept tightly closed. Finally, only 50% of respondents reported requesting fumigation services at least once per year and 46% of respondents reported keeping the windows and doors of their homes shut. Sleeping under a bed-net, a practice which would not prevent one from being bitten by the diurnal Aedes mosquito, was reported by 21% of respondents. Table 5 indicates the breakdown of each effective preventative practice by focal neighborhood. Overall, respondent’s learned about these measures from an average of 1.5 sources. Television was the most common source of information (56%), followed by medical professionals (26%) and neighborhood campaigns (21%). Less than 10% reported learning about prevention measures from radio, family or friends, work, or other sources respectively. A total of 79% of the respondents believed the practices to be effective and 100% reported that they would seek medical attention if they believed they had contracted one of the three diseases.

Table 5 Preventative practices taken by respondents in each focal neighborhood

There were no significant predictors of whether the respondent was aware of steps taken by the local authorities to combat the spread of the three diseases. The number of practices taken to avoid contracting the three diseases was significantly related to neighborhood SES and education (Table 6). Controlling for other factors, a respondent in a high SES neighborhood engaged in significantly more practices than a respondent in a low SES neighborhood (Fig. 3; P = 0.05). Conversely, respondents whose highest completed education was primary school engaged in significantly fewer practices than those with more education completed (P < 0.04). Number of sources of information was significantly related to SES. Controlling for other factors, respondents in a high SES neighborhood received information from 0.49 fewer sources than respondents in low SES neighborhoods (P < 0.01). Specific sources of information did not vary significantly between groups nor did the likelihood of finding prevention practices effective. Lastly, respondents whose family earned less than $500 per month were significantly more likely to seek medical attention at a primary health center than respondents who earned over $500 per month (P < 0.01). Respondents in the latter group were significantly more likely to seek medical attention at a private hospital than respondents whose family earned less than $500 per month (P < 0.01).

Table 6 Significant results of GLM model to predict the log number of preventative practices across all respondents. Other variables were insignificant estimators

Discussion

Our results reveal several key insights regarding the knowledge, attitudes, and practices of residents of four focal neighborhoods of Panama City and the socioeconomic and demographic groups that they belong to. Since knowledge scores were normally distributed and the mean was approximately halfway between selecting none of the correct answers and all of the correct answers, we identify a considerable lack of accurate knowledge regarding the causes, symptoms, and prevention of DENV, CHIKV, and ZIKV. First, over half of the respondents believed that vaccines exist for each disease. While there is a theoretical risk that respondents believed the DENV vaccine available in Brazil at the time was also available in Panama, we find this unlikely given the high percentages of respondents who also thought a CHIKV and ZIKV vaccine existed. Overall, this presents a dichotomy, as this is either an admission that they have not had the supposed vaccine even if though they believe it exists or they are confusing it with other vaccines they may have had. Regardless, this is a considerable piece of misinformation that is pervasive among our sample pool and not restricted to any particular SES or demographic group. This is also an inverse of the more common problem, where the public is unaware of a vaccine that indeed does exist for a particular disease [53,54,55]. Further qualitative studies with this specific sample are needed to explore beliefs about nonexistent vaccines. Overall, we suggest that future studies carefully word their questions regarding this particular topic so as to avoid confusion on behalf of the respondent and reduce issues in interpretation.

Similarly, at least two-thirds of respondents misleadingly believe that the three diseases are curable, though it is highly possible that respondents confused the idea of “cured” with “treated.” The proportions of respondents who were familiar with each disease, combined with those who correctly identified the lack of vaccine and cure, follows the chronological pattern of the diseases arrive in Panama. DENV, which is endemic [56], commanded the highest awareness and lowest rates of incorrect answers. This was followed by CHIKV [57], which arrived in 2014, and ZIKV which arrived in 2015 [58]. It is expected that respondents would be more knowledgeable about threats that had existed locally for the longest time, though our results indicate that education efforts should not ignore such longstanding threats even amongst the rise of more novel ones. It also raises the key question of when, if ever, does resident KAP regarding a novel threat reach the levels of an endemic threat. Additionally, in light of our results, public education campaigns may be most needed in communities with higher relative proportions of residents over 70 years of age, residents who in free unions, as well as residents whose family earns less than $2500 a month. It is unclear why these specific residents had lower relative knowledge scores, yet both age and income can be key aspects of social determinants of health within a community [59]. Thus, further investigations into these potentially at-risk groups may be warranted.

Our attitude results indicate high levels of concern across our entire sample pool, regardless of specific disease. Respondents were also highly likely to seek out medical attention if they believed they had contracted the disease. Interestingly, the majority of respondents reported being bitten by a mosquito zero times per day on average. While this question is entirely based on the respondent’s perception and is not verified, it does provide an insight into the experience of local residents regarding biting mosquitoes as an aspect of their environment as have other studies on perceptions of vectors and vector-borne disease [60,61,62]. It is certainly possible that some residents have learned to ignore frequent biting that has simply become a normal component of their lives or that others may be overestimating based on differences in their personal feelings towards biting as a nuisance [63]. Since the response was directly related to neighborhood SES, with residents in the lower SES neighborhoods reporting significantly higher amounts of biting than those in high SES neighborhoods, follow-up studies may seek to investigate this division in perception and whether it is related to actual biting rates. Further, with higher attitude scores related to both high SES neighborhoods and high monthly family income, we illustrate a key difference in the degree of concern between differing groups, as reported biting is higher in low SES neighborhoods but concern is higher in high SES neighborhoods. Addressing heightened concern in high SES neighborhoods should be a focus of local outreach efforts, in addition to education campaigns in low SES neighborhoods that ensure public concern is appropriate.

Practices involving the reduction of standing water were widely reported by all respondents. The elimination of breeding habitat is a key method of reducing local vector abundance [64], and so the high rates of reported utilization of these practices is certainly a positive result for Panama City. However, the relatively low rate of respondents who regularly keep their doors and windows closed is potentially concerning, as mosquitoes often take refuge indoors to escape the heat of the mid-day [65,66,67]. Follow-up studies would be required to determine whether air conditioning is equally or unequally available across socioeconomic and demographic groups, and if limited access to air-conditioning prompts residents to maintain open doors and windows. An important potential complication to these results could be the type of structure that the respondent resides in. Responsibilities for vector control in some housing structures or communities may fall on building management rather than residents. This is more likely to be the case in the high SES neighborhoods where high rises and gated communities may manage on-site vector control for residents.

With the largest proportion of residents receiving their information from television rather than through other sources, we suggest that outreach and educational messages utilize available broadcast networks in the region. This is in line with other studies, which have also found television to be a key source of information on vector control practice [43, 68, 69]. Since the number of practices taken to avoid contracting the three diseases varied significantly by neighborhood SES, we suggest that greater steps be taken to inform residents in low SES communities of the effectiveness of vector control measures. It is not immediately clear why, when controlling for other factors, individuals with bachelor’s degrees or higher engaged in fewer practices, as other studies have generally found that education is directly related to the participation in such practices [70, 71]. The inverse relationship between respondent’s knowledge score and the number of sources of information indicates that there may be increased risk of misinformation when one diversifies their sources of knowledge on mosquitoes and the viruses they transmit.

Conclusion

While SES is indeed a cursory label of a community, both attitude and practice scores were predictable at the SES level, while knowledge was only predictable at the individual level.

Our study indicates that low-SES communities with high proportions of low income residents, low education, and elderly residents should be the target of arbovirus prevention programs. In general, these results support our initial hypotheses that lower relative knowledge and fewer practices related to the prevention of DENV, CHIKV, and ZIKV would be found in communities of lower socioeconomic status (SES). We also expected and found relative knowledge about emergent CHIKV and ZIKV to be lower than that of endemic DENV. However, we did not foresee concern to be higher in areas where biting was reported less often, as was found in the high SES neighborhoods. This highlights variation in the experiences of residents in socioeconomically contrasting neighborhoods, and such information must be taken into account when education campaigns are designed. Each community may require programs specifically tailored to meet their needs, based on the particular socioeconomic and demographic proportions of the residents. While the objective of the study was to observe SES-scale or neighborhood-scale effects, we found that there was enough individual-scale diversity across all four neighborhoods for more specific socioeconomic and demographic attributes to be used as determinants of knowledge, attitude, and practice. Thus, we caution future studies seeking to identify generalizations across entire neighborhoods to be cognizant of the level of variation among residents even in seemingly homogenous communities. Overall, with knowledge of CHIKV and ZIKV lower than that of DENV across all of our respondents, we suggest increasing messaging regarding the two more novel threats. Despite CHIKV and ZIKV being present in Panama City for four and 3 years respectively, resident knowledge is still not at the level of DENV. Such information can be helpful in both designing KAP studies as well as educational interventions across Latin America, where CHIKV and ZIKV are emerging threats and differences between socioeconomic groups can be particularly stark. Beneficial follow-up studies and qualitative research would examine a greater variety of neighborhoods, such as some in a more intermediate SES range, as well as investigations into the efficacy of educational campaigns.

Abbreviations

CHIKV:

Chikungunya Virus

DENV:

Dengue Virus

HIV/AIDS:

Human immunodeficiency virus / Acquired immunodeficiency syndrome

INDICASAT:

Instituto de Investigaciones Científicas y Servicios de Alta Tecnología

KAP:

Knowledge, Attitude, and Practice

SENACYT:

Secretariat for Science, Technology and Innovation of Panama

SES:

Socioeconomic status

SNI:

Panamanian National System of Investigation

STRI:

Smithsonian Tropical Research Institute

ZIKV:

Zika Virus

References

  1. LaBeaud AD, Bashir F, King CH. Measuring the burden of arboviral diseases: the spectrum of morbidity and mortality from four prevalent infections. Popul Health Metr. 2011;9:1.

    Article  Google Scholar 

  2. Charrel RN, de Lamballerie X, Raoult D. Chikungunya outbreaks — the globalization of Vectorborne diseases. N Engl J Med. 2007;356:769–71.

    Article  CAS  Google Scholar 

  3. Tauil PL. Urbanization and dengue ecology. Cad saude publica / Minist da Saude, Fund Oswaldo Cruz, Esc Nac Saude Publica. 2001;17 Suppl:99–102.

    CAS  Google Scholar 

  4. Liu-Helmersson J, Stenlund H, Wilder-Smith A, Rocklöv J. Vectorial capacity of Aedes aegypti: effects of temperature and implications for global dengue epidemic potential. PLoS One. 2014;9:e89783.

    Article  Google Scholar 

  5. Hagenlocher M, Delmelle E, Casas I, Kienberger S. Assessing socioeconomic vulnerability to dengue fever in Cali, Colombia: statistical vs expert-based modeling. Int J Health Geogr. 2013;12:36. https://doi.org/10.1186/1476-072X-12-36.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Mondini A, Chiaravalloti-Neto F. Spatial correlation of incidence of dengue with socioeconomic, demographic and environmental variables in a Brazilian city. Sci Total Environ. 2008;393:241–8.

    Article  CAS  Google Scholar 

  7. Tanaka Y, Kunii O, Hatano T, Wakai S. Knowledge, attitude, and practice (KAP) of HIV prevention and HIV infection risks among Congolese refugees in Tanzania. Heal Place. 2008;14:434–52.

    Article  Google Scholar 

  8. Delucchi K, Tajima B, Smoking Knowledge GJ. Attitudes and practices (S-KAP) survey for staff. J Drug Issues. 2009;39:347–64.

    Article  Google Scholar 

  9. Li D, Gao Q, Liu J, Feng Y, Ning W, Dong Y, et al. Knowledge, attitude, and practices (KAP) and risk factors analysis related to cystic echinococcosis among residents in Tibetan communities, Xiahe County, Gansu Province, China. Acta Trop. 2015;147:17–22.

    Article  Google Scholar 

  10. Hlongwana KW, Mabaso MLH, Kunene S, Govender D, Maharaj R. Community knowledge, attitudes and practices (KAP) on malaria in Swaziland: a country earmarked for malaria elimination. Malar J. 2009;8:29.

    Article  Google Scholar 

  11. Launiala A. How much can a KAP survey tell us about people’s knowledge, attitudes and practices? Some observations from medical anthropology research on malaria in pregnancy in Malawi. Anthropol Matters J. 2009;11:1–13 http://www.anthropologymatters.com/index.php/anth_matters/article/view/31/53.

    Google Scholar 

  12. Bashar K, Al-Amin HM, Reza MS, Islam M, Asaduzzaman ATU, et al. Socio-demographic factors influencing knowledge, attitude and practice (KAP) regarding malaria in Bangladesh. BMC Public Health. 2012;12:1084. https://doi.org/10.1186/1471-2458-12-1084.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Dawaki S, Al-Mekhlafi HM, Ithoi I, Ibrahim J, Atroosh WM, Abdulsalam AM, et al. Is Nigeria winning the battle against malaria? Prevalence, risk factors and KAP assessment among Hausa communities in Kano state. Malar J. 2016;15:351.

    Article  Google Scholar 

  14. Dowling Z, Armbruster P, Ladeau SL, Decotiis M, Mottley J, Leisnham PT. Linking mosquito infestation to resident socioeconomic status, knowledge, and source reduction practices in suburban Washington, DC. EcoHealth. 2013;10:36–47.

    Article  Google Scholar 

  15. Shuaib F, Todd D, Campbell-Stennett D, Ehiri J, Jolly PE. Knowledge, attitudes and practices regarding dengue infection in Westmoreland, Jamaica. West Indian Med J. 2010;59:139–46.

    CAS  PubMed  PubMed Central  Google Scholar 

  16. Higuera-Mendieta DR, Cortés-Corrales S, Quintero J, González-Uribe C. KAP surveys and dengue control in Colombia: disentangling the effect of sociodemographic factors using multiple correspondence analysis. PLoS Negl Trop Dis. 2016;10:e0005016.

    Article  Google Scholar 

  17. Dhimal M, Aryal KK, Dhimal ML, Gautam I, Singh SP, Bhusal CL, et al. Knowledge, attitude and practice regarding dengue fever among the healthy population of highland and lowland communities in Central Nepal. PLoS One. 2014;9:e102028.

    Article  Google Scholar 

  18. Casapulla SL, Aidoo-Frimpong G, Basta TB, Grijalva MJ. Zika virus knowledge and attitudes in Ecuador. AIMS Public Heal. 2018;5:49–63. https://doi.org/10.3934/publichealth.2018.1.49.

    Article  Google Scholar 

  19. Jaramillo Ramírez GI, Álvarez LSB. Knowledge, attitudes and practices regarding dengue, chikungunya, and Zika and their vector in Villavicencio, Colombia. Open Public Health J. 2017;10:80–9. https://doi.org/10.2174/1874944501710010080.

    Article  Google Scholar 

  20. Marmot M, Wilkinson R. Social determinants of health; 2005.

    Book  Google Scholar 

  21. Case A, Lubotsky D, Paxson C. Economic status and health in childhood: the origins of the gradient. Am Econ Rev. 2002;92:1308–34.

    Article  Google Scholar 

  22. Winkleby MA, Jatulis DE, Frank E, Fortmann SP. Socioeconomic status and health: how education, income, and occupation contribute to risk factors for cardiovascular disease. Am J Public Health. 1992;82:816–20.

    Article  CAS  Google Scholar 

  23. Ross CE, Wu C. The links between education and health. Am Sociol Rev. 1995;60(5):719–45.

    Article  Google Scholar 

  24. Okechukwu C, Davison K, Emmons K. Changing health behaviors in a social context. Soc Epidemiol. 2014:365.

  25. Berrigan D, McKinnon RA. Built environment and health. Prev Med. 2008;47:239–40.

    Article  Google Scholar 

  26. Peters DH, Garg A, Bloom G, Walker DG, Brieger WR, Hafizur Rahman M. Poverty and access to health care in developing countries. Ann N Y Acad Sci. 2008;1136:161–71.

    Article  Google Scholar 

  27. Hawe P, Shiell A. Social capital and health promotion: a review. Soc Sci Med. 2000;51:871–85.

    Article  CAS  Google Scholar 

  28. Gyimah-Brempong K. Production of public safety: are socioeconomic characteristics of local communities important factors? J Appl Econ. 1989;4:57–71.

    Article  Google Scholar 

  29. Adler NE, Ostrove JM. Socioeconomic status and health: what we know and what we don’t. Ann New York Acad Sci. 1999;896:3–15.

    Article  CAS  Google Scholar 

  30. Dowd JB, Zajacova A, Aiello A. Early origins of health disparities: burden of infection, health, and socioeconomic status in U.S. children. Soc Sci Med. 2009;68:699–707.

    Article  Google Scholar 

  31. Barcena A. Latin America is the world’s most unequal region. Here’s how to fix it 2016. https://www.weforum.org/agenda/2016/01/inequality-is-getting-worse-in-latin-america-here-s-how-to-fix-it/.

    Google Scholar 

  32. The World Bank. GINI index (World Bank estimate): World Bank; 2015. p. 1–16. http://data.worldbank.org/indicator/SI.POV.GINI

  33. Goñi E, Humberto López J, Servén L. Fiscal redistribution and income inequality in Latin America. World Dev. 2011;39:1558–69.

    Article  Google Scholar 

  34. Lalloue B, Monnez JM, Padilla C, Kihal W, Le Meur N, Zmirou-Navier D, et al. A statistical procedure to create a neighborhood socioeconomic index for health inequalities analysis. Int J Equity Heal. 2013;12:21. https://doi.org/10.1186/1475-9276-12-21.

    Article  Google Scholar 

  35. Krishnan V. Constructing an area-based socioeconomic status index: a principal components analysis approach. Every day every W Creat Learn Exp every child. 2010:2–26. https://doi.org/10.1093/heapol/czl029.

    Article  Google Scholar 

  36. Alaimo K, Packnett E, Miles RA, Kruger DJ. Fruit and vegetable intake among Urban Community gardeners. J Nutr Educ Behav. 2008;40:94–101.

    Article  Google Scholar 

  37. Owen L, McNeill A, Callum C. Trends in smoking during pregnancy in England, 1992-7: quota sampling surveys. BMJ. 1998;317:728.

    Article  CAS  Google Scholar 

  38. Bhui K, Warfa N, Jones E. Is violent radicalisation associated with poverty, migration, poor self-reported health and common mental disorders? PLoS One. 2014;9:e90718.

    Article  Google Scholar 

  39. Springe L, Pulmanis T, Velika B, Pudule I, Grinberga D, Villeruša A. Self-reported suicide attempts and exposure to different types of violence and neglect during childhood: findings from a young adult population survey in Latvia. Scand J Public Health. 2015;44:411–7.

    Article  Google Scholar 

  40. Rada VD, Martín VM. Random route and quota Sampling: do they offer any advantage over probably sampling Methods? Open J Stat. 2014;4:391–401.

    Article  Google Scholar 

  41. Robinson OC. Sampling in interview-based qualitative research: a theoretical and practical guide. Qual Res Psychol. 2014;11:25–41.

    Article  Google Scholar 

  42. Doherty M. Probability versus non-probability sampling in sample surveys. New Zeal Stat Rev. 1994;4:21–8.

    Google Scholar 

  43. Ayyamani UD, Ying GC, San OG. A knowledge attitude and practice (KAP) study on dengue/dengue haemorrhagic fever and the Aedes mosquitoes. Med J Malaysia. 1986;41:108–15.

    Google Scholar 

  44. Paulander J, Olsson H, Lemma H, Getachew A, San Sebastian M. Knowledge, attitudes and practice about malaria in rural Tigray, Ethiopia. Glob Health Action. 2009;2:1839.

    Article  Google Scholar 

  45. Huang Y, Xu S, Wang L, Zhao Y, Liu H, Yao D, et al. Knowledge, attitudes, and practices regarding Zika: paper- and internet-based survey in Zhejiang, China. JMIR public Heal Surveill. 2017;3:e81. https://doi.org/10.2196/publichealth.7663.

    Article  Google Scholar 

  46. Maxian O, Neufeld A, Talis EJ, Childs LM, Blackwood JC. Zika virus dynamics: when does sexual transmission matter? Epidemics. 2017;21:48–55. https://doi.org/10.1016/J.EPIDEM.2017.06.003.

    Article  PubMed  Google Scholar 

  47. Johnstone D. Comments on Oakes on the foundations of statistical inference in the social and behavioral sciences: the market for statistical significance. Psychol Rep. 1988;63:319–31.

    Article  Google Scholar 

  48. Yang K, Banamah A. Quota sampling as an alternative to probability sampling? An experimental study. Sociol Res Online. 2014;19:1.

    Article  Google Scholar 

  49. Agresti A. An introduction to categorical data analysis; 2007.

    Book  Google Scholar 

  50. Galton F. Regression towards mediocrity in heriditary stature. J Anthropol Inst Gt Britain Irel. 1886;15:246–63.

    Article  Google Scholar 

  51. StataCorp. Stata Statistical Software: Release 14. 2015. 2015.

  52. Moore JC, Stinson LL, Welniak EJJ. Income measurement error in surveys: a review. J Off Stat. 2000;16:331–62.

    Google Scholar 

  53. Mouallif M, Bowyer HL, Festali S, Albert A, Filali-Zegzouti Y, Guenin S, et al. Cervical cancer and HPV: awareness and vaccine acceptability among parents in Morocco. Vaccine. 2014;32:409–16.

    Article  Google Scholar 

  54. Blasi PR, King D, Henrikson NB. HPV vaccine public awareness campaigns: an environmental scan. Health Promot Pract. 2015;16:897–905.

    Article  Google Scholar 

  55. P jun L, O’Halloran A, Kennedy ED, Williams WW, Kim D, Fiebelkorn AP, et al. Awareness among adults of vaccine-preventable diseases and recommended vaccinations, United States, 2015. Vaccine. 2017;35:3104–15.

    Article  Google Scholar 

  56. Ligon BL. Dengue fever and dengue hemorrhagic fever: a review of the history, transmission, treatment, and prevention. Semin Pediatr Infect Dis. 2005;16(1):60–5.

    Article  Google Scholar 

  57. Powers AM, Logue CH. Changing patterns of chikunya virus: re-emergence of a zoonotic arbovirus. J Gen Virol. 2007;88:2363–77.

    Article  CAS  Google Scholar 

  58. Fauci AS, Morens DM. Zika virus in the Americas - yet another arbovirus threat. N Engl J Med. 2016;363:1–3. https://doi.org/10.1056/NEJMp1600297.

    Article  Google Scholar 

  59. Promotion O of DP& H. About healthy people | healthy people 2020. Healthy people. 2014.

    Google Scholar 

  60. Herrington JE. Pre-West Nile virus outbreak: perceptions and practices to prevent mosquito bites and viral encephalitis in the United States. Vector-Borne Zoonotic Dis. 2003;3:157–73. https://doi.org/10.1089/153036603322662156.

    Article  PubMed  Google Scholar 

  61. Patel AB, Rathod H, Shah P, Patel V, Jignesh Garsondiya RS. Perceptions regarding mosquito borne diseases in an urban area of rajkot city. Natl J Med Res. 2011;1:45–7.

    Google Scholar 

  62. Ghosh A, Mukherjee S, Dutta T, Roy S, Mondal FB. Community perceptions regarding mosquito borne diseases in some selected Localitities of Bankura, a Peri-urban area of West Bengal, India. J Mosq Res Authors J Mosq Res J Mosq Res. 2013;333:54–7. https://doi.org/10.5376/jmr.2013.03.0007.

    Article  Google Scholar 

  63. Cloninger CR, Zohar AH. Personality and the perception of health and happiness. J Affect Disord. 2011;128:24–32.

    Article  Google Scholar 

  64. Floore TG. Mosquito larval control practices: past and present. J Am Mosq Control Assoc. 2006;22:527–33.

    Article  CAS  Google Scholar 

  65. Burkett-Cadena ND, Eubanks MD, Unnasch TR. Preference of female mosquitoes for natural and artificial resting sites. J Am Mosq Control Assoc. 2008;24:228–35. https://doi.org/10.2987/5662.1.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Chadee DD, Ritchie SA. Oviposition behaviour and parity rates of aedes aegypti collected in sticky traps in Trinidad, West Indies. Acta Trop. 2010;116:212–6.

    Article  Google Scholar 

  67. Dzul-Manzanilla F, Ibarra-López J, Bibiano Marín W, Martini-Jaimes A, Leyva JT, Correa-Morales F, et al. Indoor resting behavior of Aedes aegypti (Diptera: Culicidae) in Acapulco. Mexico J Med Entomol. 2017;54:501–4.

    PubMed  Google Scholar 

  68. Hairi F, Ong CHS, Suhaimi A, Tsung TW, Bin Anis Ahmad MA, Sundaraj C, et al. A knowledge, attitude and practices (KAP) study on dengue among selected rural communities in the Kuala Kangsar District. Asia-Pacific J Public Heal. 2003;15:37–43.

    Article  Google Scholar 

  69. Taksande A, Lakhkar B. Knowledge, attitude and practice (KAP) of dengue fever in the rural area of Central India. Shiraz E Med J. 2013;13:146–57.

    Google Scholar 

  70. Tram TT, Anh NT, Hung NT, Lan NT, Cam LT, Chuong NP, et al. The impact of health education on mother’s knowledge, attitude and practice (KAP) of dengue haemorrhagic fever. Dengue Bull. 2003;27:174–80.

    Google Scholar 

  71. Mayxay M, Cui W, Thammavong S, Khensakhou K, Vongxay V, Inthasoum L, et al. Dengue in peri-urban Pak-Ngum district, Vientiane capital of Laos: a community survey on knowledge, attitudes and practices. BMC Public Health. 2013;13:434.

    Article  Google Scholar 

Download references

Acknowledgements

We acknowledge Project Mosaic at the University of North Carolina at Charlotte for their assistance in data analysis. We also acknowledge Dr. Owen McMillan at the Smithsonian Tropical Research Institute, who was oversaw the project and its administrative responsibilities.

Funding

The Smithsonian Tropical Research Institute (STRI) and Instituto de Investigaciones Científicas y Servicios de Alta Tecnología (INDICASAT) supported this work financially. AW was supported by STRI’s short-term fellowship program and the Secretariat for Science, Technology and Innovation of Panama (SENACYT), through the National System of Investigation (SNI), supported research activities by AM and JRL. The funding bodies had no role in the design of the study, data collection, analysis, interpretation, or writing.

Availability of data and materials

All data generated or analyzed during the current study are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

Authors

Contributions

AW was responsible for the concept of the study and for designing the methodology, including the selection of neighborhoods and survey composition. AW analyzed the data, and wrote the first draft of the manuscript. AM and IH were responsible for overseeing the methodology and survey composition, in addition to manuscript revision. AM and IH were also responsible for all of the data collection. JRL oversaw the study design and was responsible for advising on project objectives as well as contributing to manuscript revisions. All authors have read and approved this manuscript.

Corresponding author

Correspondence to A. Whiteman.

Ethics declarations

Ethics approval and consent to participate

On April 2, 2017, This study was judged to meet the exempt category of “Survey, interview, public observation” under 45 CFR 46.101(b) as determined by the Institutional Review Board at The University of North Carolina at Charlotte (UNCC: 17–0065), who partnered with the local Panamanian institution, INDICASAT, for the ethical review. Written informed consent was obtained from participants, which was required regardless of exemption.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Survey Instrument. (DOCX 74 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Whiteman, A., Mejia, A., Hernandez, I. et al. Socioeconomic and demographic predictors of resident knowledge, attitude, and practice regarding arthropod-borne viruses in Panama. BMC Public Health 18, 1261 (2018). https://doi.org/10.1186/s12889-018-6172-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-018-6172-4

Keywords