- Research article
- Open Access
Development and validation of five behavioral indices of flood adaptation
BMC Public Health volume 19, Article number: 245 (2019)
In the current context of climate change, climate forecasts for the province of Quebec (Canada) are a lengthening of the thunderstorm season and an increase in episodes of intense precipitations. These changes in the distribution of precipitations could heighten the intensity or frequency of floods, a natural hazard that concerns 80% of Quebec’s riverside municipalities. For the health and safety of the at-risk population, it is very important to make sure they have acquired necessary adaptive behaviors against flooding hazard. However, there has been no assessment of these flood adaptation behaviors to date. Thus, the aim of this study was to develop and validate five indices of adaptation to flooding.
A sample of 1951 adults completed a questionnaire by phone. The questionnaire, specifically developed for this study, measured whether they did or did not adopt the behaviors that are proposed by public health officials to protect themselves against flooding.
The results of the item, confirmatory factor, and multiple correspondence analyses contributed to the development of five indices corresponding to the adaptation behaviors to adopt according to the chronology of events: (a) pre-alert preventive behaviors, (b) behaviors to carry out after the alert is issued, (c) behaviors to adopt during a flood not requiring evacuation, (d) behaviors to adopt during a flood requiring evacuation, and (e) post-flood behaviors. The results of this study also showed that people who perceive a risk of flooding in their home in the next 5 years tend to adopt more preventive behaviors and adaptation behaviors than those who perceive little or no risk at all. They also reveal that people who feel more adverse effects on their physical or mental health tend to adopt more adaptive behaviors than those who feel little or no adverse effects on their health.
Across a series of psychometric analyses, the results showed that these flood adaptation indices could properly measure a vast range of adaptive behaviors according to the chronology of events. Therefore, researchers, public health agencies, and professionals can use them to monitor the evolution of individuals’ adaptive behaviors during floods.
There are many health problems related to flood situations. On the one hand, there can be physical problems, such as wounds, trauma, drowning, mold-induced respiratory problems, gastrointestinal diseases, leptospirosis, skin infections caused by contaminated waters, carbon monoxide poisoning, and electrocutions [1,2,3,4,5,6,7,8,9]. On the other hand, research has shown that there are also mental health problems, such as post-traumatic stress disorder (PTSD), anxiety, and depression, associated with flooding [2, 10,11,12]. For example, in 2011, in Brisbane, Australia, flood victims reported, among other things, respiratory problems, poor quality of sleep, psychological distress, and PTSD symptoms . After a heavy rainfall in Southern Alberta (province in Western Canada), which affected approximately 100,000 people, a significant increase in injuries and in the average weekly administration of tetanus post-exposure prophylaxis was detected. In Saguenay (Quebec), floods that occurred in 1996 resulted in the death of 10 people and required the evacuation of 15,825 others . In 2011, spring floods in the province of Quebec affected 40 municipalities. Among them, 11 declared a state of emergency, 2524 primary residences were flooded, 3927 persons were affected, 1651 were evacuated, and 7000 psychosocial interventions took place .
In this context, adaptation to climate change, particularly to flooding, is fundamental. Behavioral adaptation of individuals living in flood-prone areas is defined as behavioral adjustments intended to lessen the adverse health effects and the potential property damages. The need to establish structures that foster better adaptation by the population is increasingly acknowledged at the global scale . Indeed, effective preparations reduce households’ vulnerability, decrease the impacts, shorten the post-disaster recovery period, and improve community resilience .
Municipal officials and public health authorities try to raise the population’s awareness of these issues by disseminating information on various protection measures for at-risk citizens. Those measures may concern the level of disaster preparedness, modifying the homes to make them more water-resistant, as well as the adoption of safe behaviors during and after a flood. For public health monitoring and promotion, it would thus be important to summarize these many diverse behaviors for coping with flooding. The creation of a composite index is thus warranted here . The number of composite indices worldwide increases every year . Their popularity stems from the fact that they illustrate issues that are complex and sometimes difficult to grasp (e.g., environment, poverty) while using a smaller set of indicators without losing the underlying basic information.
The aim of this study was thus to develop and validate five flood adaptation indices for people living in or bordering a flood zone. These indices correspond to the adaptation behaviors to adopt according to the chronology of events: (a) pre-alert preventive behaviors, (b) behaviors to carry out after the alert is issued, (c) behaviors to adopt during a flood not requiring evacuation, (d) behaviors to adopt during a flood requiring evacuation, and (e) post-flood behaviors. To our knowledge, no such indices of flood adaptation behaviors have been developed to date. Yet, Rufat, Tate, and Maroof  have previously raised the need to differentiate the phases of a flood disaster when creating indicators. These five indices are necessary because, in addition to targeting different adaptation behaviors, they are intended for slightly different groups of individuals, not all, for instance, having experienced alerts, home evacuations, or flooding.
At each of these adaptation phases, the behaviors identified as the best indicators will be grouped together in a contextualized composite index that will make it possible to monitor the evolution of individual adaptation to floods over time in Quebec, Canada. We will first describe the common methodology used to develop and validate the five adaptation indices. Next, to better illustrate our data analysis strategy, we will present all the results of the first index (i.e., pre-alert preventive behaviors). We will also present the results of the other four indices, but as concisely as possible for the readers’ benefit. Detailed results for the last indices will be available in the Supplemental Materials Section.
Sample and sampling procedure
To develop and test the validity of the flood adaptation indices, we used a stratified sample. This helped to preserve the geographical distribution of the flood-risk zones throughout the province of Quebec (Canada), which covers 1,667,441 km2 (643,802 mile2) and has a population of 8.3 million. Hence, the number of participants recruited in each of the 17 administrative regions in the province was proportional to the number of households in these regions. The target population consisted of all 136,505 households whose main residence was in or near a designated flood-prone area, as per the Centre d’expertise hydrique du Québec [Quebec Water Expertise Center].
A total of 1951 individuals (women, 44.54%; men, 55.46%) were surveyed by a polling firm: 1450 lived in an at-risk area (flood recurrence: every 20 to 100 years), and 501 lived less than 150 m from a designated flood-prone area. The sample size was estimated according to Cochran’s formula : a 95% confidence level, a maximal variance for a five-point scale (i.e., 4), and a precision level of 0.12.
The interviews used a questionnaire developed for the study and lasted an average of 21 min 18 s, and the response rate was 21.82%. When no contact was made on the first attempt, the interviewers made a maximum of nine callbacks (for a total of 10 attempts) at various times before rejecting the telephone number. A list of addresses retrieved from “Adresses Québec” (a database of all the addresses in the province of Quebec) was sent to the polling firm. Its staff matched these addresses to phone numbers. To answer the survey, respondents had to be responsible for the household, either financially or in matters of familial care. They answered for the entire household, but individual demographic data were collected. All respondents were aged 18 years or older (M = 57.29, SD = 14.27; 18–29 [n = 35], 30–39 [n = 202], 40–49 [n = 281], 50–59 [n = 484], 60–69 [n = 506], 70–79 [n = 361], more than 80 [n = 121]) and could converse in French or in English. Men made up 44.54% of the sample, while women made up 55.46%. The first language of most of the participants (98.26%) was French. For 32.44% of the participants, the highest education level obtained was a university degree; 30.09% reported an annual net income of CAD$40,000 or less, 29.21% an income of CAD$40,001–CAD$80,000, and 26.71% an income of CAD$80,001 or more.
Five flood adaptation indices
Initially, 55 adaptive behaviors were considered as potential components of the flood adaptation indices: 24 behaviors that are recommended for before the alert (e.g., raise the doorsills) or for which knowledge is required if the need arises (e.g., know how to cut off the electricity), 10 behaviors to adopt at the time of the alert (e.g., cut off the electricity if requested by the authorities), four behaviors to perform during a flood not requiring an evacuation (e.g., boil the water or use bottled water), seven behaviors to adopt during a flood requiring an evacuation (e.g., use the route indicated by the authorities to evacuate the neighborhood), and 10 behaviors to adopt after the flood (e.g., sterilize all kitchen items contaminated by the flood water). The behaviors in question are listed in Tables 1 to 5 below. The presence of filter questions allowed respondents to answer only the questions that concerned them (for instance, not all had experienced an alert or a flood). All these items were selected from a review of the literature on health [e.g. 22–25] and recommendations from public health agencies [26,27,28,29].
Index of pre-alert preventive adaptation
For this index, the target population was the entire group of respondents (n = 1951). The participants were asked to indicate, using a dichotomous Yes-No response format, whether they did or did not carry out each of the 24 behaviors proposed (see Table 1). Answers of respondents who did not have access to the water shut-off valve or the electrical panel (behaviors 6 and 7) were considered in the non-preventive category because it was impossible for these respondents to adopt these behaviors. For behavior 24, answers indicating that the respondent did not have access to a basement were grouped together under the non-preventive category because it went without saying that no valuable items could be stored in the basement.
Index of adaptation at the time of the alert
The target population for this preventive index was the one having experienced a flood alert, that is, 627 of the 1951 respondents. For this index (at the time of the alert), participants were asked to indicate whether they did or did not perform each of the 10 behaviors proposed (see Table 2). They had to use a Yes-No response format to indicate if they did or did not adopt the adaptive behaviors. One item (behavior 3) asked respondents if they had blocked the basement drain. Answers indicating that respondents had a backwater valve were grouped under the adaptative modality. Finally, answers indicating that the people had no yard furniture, patio, or vehicle (behavior 1) were classified under the adaptive modality because these items could be considered as not having been exposed to the water.
Index of adaptation during a flood not requiring an evacuation
The sample used to test the metric qualities of this index consisted in 669 respondents who had been flooded but not evacuated. For two of the four behaviors to adopt during a flood (“boil the water or use bottled water” and “install a pump to evacuate the water from the home”; see Table 3), respondents had to choose between the following answers: (1) yes, I adopted this behavior and (2) no, I did not adopt this behavior. For the two other behaviors (wear rubber gloves to handle items in contact with the flood water; wear rubber boots to walk in the flood water), respondents indicated how frequently they adopted each adaptive behavior using a four-point ordinal scale ranging from (1) “I never did this” to (4) “I always did this.” The answers were then grouped into two categories: behaviors that people adopt (I usually did this; I always did this) and behaviors that people do not adopt (I sometimes did this; I never did this). We merged these response options to give the same weighting to each of the behaviors. Furthermore, additional analyses showed that considering these merges did not change our results.
Index of adaptation during a flood requiring an evacuation
This index was tested with respondents who had previously had to evacuate their home due to a flood, that is, 126 of the 1951 respondents. For all behaviors to adopt during an evacuation (see Table 4), respondents had to choose between the following answers: (1) yes, I adopted this behavior and (2) no, I did not adopt this behavior. Regarding “registering with a temporary shelter if available,” participants could also indicate that no temporary shelter was available. If so, their answers were considered in the non-adaptive category because registering with a temporary shelter was not possible for them. For the behavior “using the route indicated by the authorities to evacuate the neighborhood,” the answers indicating that the person was not aware of this information were grouped under the non-adaptive modality. Finally, for the item asking respondents if they had brought their emergency kit when evacuating their home (behavior 1), the answers indicating that they did not have an emergency kit were assigned to the non-adaptive modality.
Post-flood adaptation index
For the development of the post-flood index, 10 adaptive behaviors were considered (see Table 5). Only respondents who had their home flooded in the past were targeted for this index.. Among all the respondents, 432 had experienced this situation. They thus formed the sample used to validate our post-flood index.
For six of the 10 behaviors to adopt after the flood (behaviors 1, 3, 4, 7, 8, 9; see Table 5), the respondents had to choose between the following answers: (1) yes, I did adopt this behavior and (2) no, I did not adopt this behavior.
For two questions, the answers were coded on a scale with three choices of answers: (a) “Did you attend citizens’ meetings concerning the flood” (behavior 10), for which the answer options were (0) attended no citizens’ meetings, (1) attended one citizens’ meeting, (2) attended two or more citizens’ meetings; and (b) “Did you replace the refrigerator insulation or change the appliance if it was wet” (behavior 2), for which the answer options were (0) No, I did not replace the insulation or change the appliance, but it did get wet, (1) It did not get wet, so I didn’t have to change the insulation or the appliance, (2) Yes, I changed the insulation or the appliance because it got wet. The answers were then grouped into two categories: behaviors that people adopt (response options 1 and 2) and behaviors that people do not adopt (response option 0).
Finally, for the two last behaviors, the answers were coded on a scale with four choices of answers: (a) “discard items in contact with the flood water” (behavior 5), for which the answer options were (0) I discarded no items, (1) a few, (2) most of them, (3) all the items; and (b) “wear rubber gloves to handle items in contact with the flood water” (behavior 6), for which the answer options were (0) never, (1) sometimes, (2) most of the time, (3) always. The answers were then grouped into two categories: behaviors that people adopt (response options 2 and 3) and behaviors that people do not adopt (response options 0 and 1).
Variables theoretically related to flood adaptation indices
Two variables were also measured and correlated with the indices to test their validity. In this study, these variables corresponded to the adverse health impacts felt during or after a flood and the perceived risk of being flooded in the next 5 years.
Self-reported adverse health impacts
The answers to two questions were combined to create this variable: “Was your physical health adversely affected by the flood?” and “Was your mental health adversely affected by the flood?” Those who reported feeling “a moderate number of” or “many” adverse effects for at least one of these two questions were defined as the group feeling the most at risk. Those who reported feeling “no” or “a few” adverse effects to the two questions were defined as the group feeling the least at risk.
Self-reported perceived risk
The second variable used was the perceived risk of being flooded in the coming years: “In your opinion, what is the risk of your current home being flooded in the next five years?” This question was rated on a five-point ordinal scale: “very high,” “high,” “moderate,” “low,” “very low,” or “nil.” People who reported that the risk was “very high,” “high,” or “moderate” formed the group feeling the most at risk of their current home being flooded in the next 5 years. Those who reported that the risk was “low,” “very low,” or “nil” formed the group feeling the least at risk.
Before performing statistical analyses, we reweighted the data to compensate for imbalances between the proportions of respondents in each administrative region in the sample and those of the target population . Because there were some missing values for age and education level, we imputed the missing data for these variables employing predictive mean matching . Then, for each of the five indices, we conducted four series of statistical analyses.
First, to assess the psychometric qualities of the adaptation indices, we performed an item analysis, using Samejima’s graded response model . The objective of this analysis was to assess the performance of the items according to a certain number of psychometric parameters (e.g., the power to differentiate between individuals who adapt well to flooding and those who adapt less well) and to determine which items to retain in a measurement instrument, such as an index. In other words, the discriminant parameter could be conceived as a description of the association between the item and the measured construct. This is because the higher the discrimination index for an adaptation measuring item, the more that item is able to discriminate between individuals who adapt well to flooding and those who adapt less well. We used Baker’s  guidelines to interpret discrimination power: (a) very poor: 0.34 or less, (b) poor: 0.35–0.64, (c) moderate: 0.65–1.34, (d) good: 1.35–1.69, (e) very good: 1.70 or higher.
Second, we conducted a confirmatory factor analysis to assess the unidimensionality of the flood adaptation index. We tested a model that included all the behaviors within a single construct representing flood adaptation. We then assessed the compatibility of the empirical data with the hypothetical measurement model. To do so, we used various fit indices, including the comparative fit index (CFI), the Tucker–Lewis index (TLI), the ratio of the chi square to its degrees of freedom (χ2/df), and the root mean square error of approximation (RMSEA). Researchers generally agree that the model fit is acceptable or excellent if the CFI and the TLI exceed 0.90 or 0.95 with the χ2/df below 5 or 2 and the RMSEA below 0.08 or 0.06, respectively [34, 35].
Third, we conducted a multiple correspondence analysis, a data reduction procedure  that is frequently performed in the construction of composite indices [18, 37]. The percentage of inertia computed by applying Greenacre’s  method was used to countervalidate the result of the confirmatory factor analysis regarding the unidimensionality of the flood adaptation index. The multiple correspondence analysis results were also interpreted in terms of the contribution of the active variables (here, the measured behaviors) to the factorial dimensions obtained through the multiple correspondence analysis.
Finally, once the psychometric properties of an adaptation index were confirmed, we conducted a validity analysis. The essential function of a validity analysis is to determine the relationship between test results (here, the scores on each flood adaptation index) and a variable theoretically related to the construct studied [18, 39]. In this study, two criterion variables were used: self-reported adverse health impacts and self-reported perceived vulnerability. The choice of these variables depended on the target population. When the index to be created concerned only the population having experienced a flood, the variable used corresponded to the adverse health impacts felt during a flood. In the case where the index developed targeted the people whose home had been flooded, those living in a flood-prone zone but whose home had never been flooded, and those living on the border of a flood-prone zone, the variable used was the perceived risk of being flooded in the coming years.
To prove concept validity, we used two statistical methods. First, each index was correlated (tetrachoric correlation) with its respective related variables (perceived adverse health impacts or perceived vulnerability). Second, the prevalence of each associated variable was compared in terms of adaptation levels using the odds ratio.
As previously mentioned, we will describe in detail the reliability and validity results of the first index (i.e., pre-alert preventive behaviors), followed by a more succinct presentation of the results concerning the four other indices to lighten the text. Detailed results for the last four indices will be available in the Supplemental Materials Section.
Index of pre-alert preventive adaptation
The results of the item analysis using the Excel add-in EIRT  revealed that this index had good reliability. In fact, the majority of the 24 adaptive behaviors appeared to properly measure the adoption of pre-alert preventive adaptation behaviors, that is, to discriminate between individuals who adapt well to flooding and those who adapt less well according to Baker’s  guidelines. Only one behavior, “store valuable items somewhere besides the basement,” seemed problematic, with a discrimination index approaching zero (0.003; see Table 6). This item was therefore removed from the index. The reason for this low discrimination power was not that almost all respondents reported adopting this behavior (i.e., a low response variability): 30.42% of respondents did not do so compared with 69.58% who did. The reason was rather that the participants believed it was possible to protect valuable items by storing them in a high spot in the basement.
The results in Table 6 also show that the most adopted behaviors were: “know how to cut off the electricity” (92.49%) and “know how to shut off the water” (84.07%). Conversely, “relocate the home elsewhere on the property” was the least adopted behavior (1.76%) and “make other modifications to the building” was the second least adopted (4.14%).
Index of adaptation at the time of the alert
The results of the item analysis (data not shown; see Additional file 1) indicated that all adaptive behaviors at the time of the alert could discriminate between people who adapt and those who do not adapt. The most discriminating behaviors were “put sandbags on the property” (1.67; good discriminating power), “block outdoor air inlets” (1.64; good discriminating power), and “help your neighbors implement their protective measures” (1.56; good discriminating power). The least discriminating indicators were “block the basement drain” (0.52), “check regularly if the risk of flooding has increased or decreased” (0.62), and “other measures to prevent water from entering the home” (0.66).
The results also showed that “take measures other than those mentioned to prevent water from entering the home” was not a behavior frequently reported by the respondents (2.94%). Among the other least reported behaviors were “block the outside air inlets like the one for the clothes dryer” (5.67%) and “waterproof the doors and windows with plastic tape” (9.37%). The most frequently adopted behavior (56.38%) was “check regularly if the risk of flooding has increased or decreased,” followed by “move the lawn or patio furniture or the vehicle to higher ground” (49.42%), and “store items or furniture higher or on a higher floor” (47.76%).
Index of adaptation at the time of the flood not requiring an evacuation
An item analysis was performed on the four behaviors to adopt during a flood not requiring evacuation. The results (data not shown; see Additional file 2) suggested that these four behaviors aptly measured the concept of adaptation in the context of a flood not requiring evacuation. The item analysis revealed that the most discriminating behavior was “wear rubber gloves to handle items in contact with the flood water” (2.299; excellent discriminating power). The second most discriminating behavior was “wear rubber boots to walk in the flood water” (1.270, moderate discriminating power).
The most frequently performed behavior was “wear rubber boots to walk in the flood water” (67.93%) and the least performed was “wear rubber gloves to handle items in contact with the flood water” (24.70%).
Index of adaptation during a flood requiring evacuation
The item analysis of the seven behaviors to carry out during an evacuation was performed with a non-parametric model (kernel density estimator ) because the sample of respondents having had to evacuate their home was too small to use a parametric model (n = 124). Two of the seven adaptive behaviors were not retained in the item analysis because they applied only to a very small proportion of the respondents: “place your pets in a safe location” and “register with a temporary shelter, if such a center is available to you.” This decision is justified because several people did not have pets (54 respondents on 124) or did not have access to temporary shelters (40 on 124).
The non-parametric item analysis models did not produce any item discrimination index but did provide item characteristic curves (data not shown; see Additional file 3). The curves obtained indicated that all five behaviors that were left had acceptable discrimination power; in other words, their item characteristic curve had a relatively steep positive slope. Thus, the following five behaviors were retained for the creation of the index: (1) bring your emergency kit; (2) lock the doors when leaving; (3) tell your loved ones where you can be easily reached; (4) use the route indicated by the authorities to evacuate the neighborhood, and (5) wait for the authorities’ permission before returning home.
The results also revealed that the following two behaviors were adopted by the majority of the respondents who had been evacuated: “lock the doors when leaving” (90.78%) and “tell your loved ones where you can be easily reached after the evacuation” (89.59%). The least performed behaviors were “register with a temporary shelter if available” (23.66%), and “bring your emergency kit, including your medication” (32.88%).
Post-flood adaptation index
The results of the item analysis (data not shown; see Additional file 4) revealed that the 10 behaviors seemed to measure the post-flood adaptation construct. The most discriminating were: “have the condition of the electrical installation and heating appliances checked” (2.134, excellent discriminating power), “disinfect the contaminated rooms” (2.079, excellent discrimination power), and “ discard items in contact with the flood water” (1.934, excellent discrimination power). Conversely, the least discriminating behaviors were: “check if mold has developed” (0.314), “update your emergency kit” (0.384), and “replace the refrigerator insulation if it is wet or replace the appliance” (0.996).
The results also showed that the most reported behaviors were “disinfect the contaminated rooms” (77.11%; see Fig. 5) and “make a list of the damages caused to the home and to your belongings” (53.74%). The least frequently adopted behaviors were “check if mold has developed” (15.49%) and “attend at least one citizens’ meeting concerning the flood” (26.00%).
Confirmatory factor analysis
We then tested the factorial validity of each index by determining whether the different categories of flood adaptation behaviors corresponded to each construct: (a) pre-alert flood adaptation, (b) adaptation during the alert, (c) adaptation during a flood not requiring evacuation, (d) adaptation during a flood requiring evacuation, and (e) post-flood adaptation.
Index of pre-alert preventive adaptation
The results showed a poor fit of the data with the theoretical model (CFI = 0.794, TLI = 0.773, RMSEA = 0.059) that included the 23 preventive behaviors to adopt before an alert. We therefore used the modification parameter estimates and indices provided in Mplus to identify potentially problematic indicators (i.e., loadings < 0.30; substantial correlate residual). The results showed that there were eight behaviors causing problems because they were too highly correlated with another behavior (data not shown; see Additional file 5). Consequently, these behaviors were deleted or paired with a correlated behavior. For instance, “make a plan for evacuating your home in case of emergency” was not retained in the index because its correlation with “make a plan for evacuating your neighborhood” was too high (r = 0.554), suggesting that these behaviors were redundant. The results showed that the revised model had an adequate level of fit to the data: CFI = 0.924, TLI = 0.911, χ2/df = 3.50, and RMSEA = 0.036. To further improve the index validity, we tested the revised model by combining these pairs of correlated behaviors. For example, we created a single variable that combined “know how to shut off the water” and “know how to cut off the electricity” to obtain a more general behavior called “know how to shut off the water or the electricity.” The results indicated that only this water-electricity combination improved the quality of the index. The final model therefore comprised 15 behaviors (behaviors 3, 5, 8, 9, 10, 13 to 17, 19, 21, 22, 23, and the combination of behaviors 6 and 7) and showed adequate fit to the data: CFI = 0.933, TLI = 0.921, RMSEA = 0.034 (see Fig. 1).
Index of adaptation at the time of the alert
We also verified the factorial validity of the adaptation index comprising the 10 behaviors to carry out at the time of the alert. The results indicated that the values of two of the fit indices (CFI and TLI) were slightly below the desired minimal value (CFI = 0.893, TLI = 0.862 < 0.90). For its part, the RMSEA value indicated a good fit of the data with the model (RMSEA = 0.048).
The results showed that “help your neighbors implement their protective measures like putting sandbags” was too highly correlated with “put sandbags on the property” (r = 0.64). We decided to combine these two behaviors rather than eliminating one of them because the model fit was better: CFI = 0.932, TLI = 0.909, χ2/df = 1.71, RMSEA = 0.035 vs. CFI = 0.913, TLI = 0.884, χ2/df = 1.96, and RMSEA = 0.040). The final adaptation index thus contains nine items (see Fig. 2).
Index of adaptation during a flood requiring evacuation
A confirmatory factor analysis was then performed on the five behaviors to adopt during a flood requiring evacuation. The results indicated that the data fit well to the model (CFI = 1.000, TLI = 1.396, χ2/df = 0.39, and RMSEA = 0.000); see Fig. 3). However, the saturation coefficients associated with each of the behaviors were non-significant (p > 0.05). One potential explanation for this result is the small sample size used for the creation of this index because only 124 respondents had had to evacuate due to a flood.
Index of adaptation during a flood not requiring evacuation
Further to the item analysis, we conducted a confirmatory factor analysis to verify whether the adaptation behaviors to adopt at the time of a flood not requiring evacuation concerned one same construct. The results obtained showed that the model fit well with the data (CFI = 0.976, TLI = 0.928, χ2/df = 2.59, and RMSEA = 0.052; see Fig. 4) and that the saturation coefficients were all significant (p < 0.05).
Post-flood adaptation index
The results of the confirmatory factor analysis of the 10 post-flood behaviors showed that the data fit very well with the model: CFI = 0.991, TLI = 0.988, χ2/df = 1.27, and RMSEA = 0.026 (see Fig. 5). Furthermore, the saturation coefficients were all significant.
Multiple correspondence analysis
A multiple correspondence analysis was then performed on each index. For the preventive adaptation index, the results revealed that the total inertia explained by the first dimension was 98.68%, and the confirmatory factor analysis results showed that the index was unidimensional. Indeed, the projected coordinates of the active variables (i.e., the 15 behaviors) showed that all the response categories indicating that people adopt the behaviors (e.g., I usually or always adopt the behavior) were situated on the left side of the plot and all the responses indicating that people do not adopt the behaviors (e.g., I never adopt the behavior; I rarely adopt the behavior) were situated on the right side of the plot (see Fig. 6).
Multiple correspondence analyses were also performed on the four other indices. The results indicated that these indices were unidimensional, the first dimension obtained explaining a high percentage of the total inertia in each case: 77.43% (at the time of the alert), 69.50% (during a flood requiring evacuation), 94.30% (during a flood not requiring evacuation), and 91.86% (post-flood) of the total inertia. In Fig. 6, the affirmative answers (yes) indicate that the respondents who adopt the adaptive behavior are at the right of the axis, whereas the negative answers (no) are at the left of the axis. By examining the table presenting the contribution of the modalities (data not presented), one can determine which behavior is the most closely related to the index.
Finally, for each of these four indices, the projected coordinates of the behaviors measured showed that all the response categories indicating that people adopt the behaviors were situated on the left side of the plot and that the responses indicating that people do not adopt the behaviors were situated on the right side of the plot (data not shown; see online resource 5).
Indices validity test
The purpose of this statistical analysis was to examine the relationship between the five behavioral indices of flood adaptation and theoretically related variables [18, 41]. As previously indicated, in this study, this indicator varied according to the subsample of the population under study. When the index to be created concerned only the population having experienced a flood (behaviors to adopt during a flood not requiring evacuation, behaviors to adopt during a flood requiring evacuation, and post-flood behaviors), the variable corresponded to the adverse health impacts felt during a flood. In the cases where the index targeted the entirety of the sample (preventive behaviors to adopt before the alert and behaviors to carry out after the alert is issued), the variable used was the perceived risk of being flooded in the next five years.
For each index, adaptation scores were generated using the coordinates of the behaviors obtained through the multiple correspondence analysis. These scores ranged from − 5 to + 5 and displayed a quasi-normal distribution (for more details on how these scores were generated, see Greenacres ) and were dichotomized as follows: individuals who adapted well to flooding (score < 0) and those who adapted less well (score > 0).
We tested the validity of each of the flood adaptation indices using a tetrachoric correlation with the measurement of self-reported health impacts or the perceived risk of being flooded in the coming years. Using a nominal-type polytomous logistic analysis , we also calculated the prevalence of health impacts (at-risk group, lower risk group) or risk perception (low perceived risk, high perceived risk) according to the adaptation level as measured by the dichotomized indices. The results (see Tables 7 and 8) showed that four out of the five indices had good validity.
Indeed, the indices corresponding to pre-alert preventive behaviors, behaviors to carry out after the alert is issued, behaviors to adopt during a flood not requiring evacuation, behaviors to adopt during a flood requiring evacuation, and post-flood behaviors were significantly and positively correlated with their respective related variable. However, no significant correlation was found between the index measuring adaptation during a flood not requiring evacuation and the perceived risk of being flooded in the coming years.
The results of the odds ratio analyses were consistent with the correlation results. According to the indices, the prevalence of perceived risk of being flooded over the next five years was higher in the group that adapted than in the one that did not adapt, except in the case of the index measuring adaptation during a flood not requiring evacuation. For instance, the results suggested that 37.27% of the respondents adapted well to post-flooding (score < 0) versus 17.61% who adapted less well (score > 0): odds ratio = 1.37, p = 0.0011.
Reported health problems or diseases
The results showed that 115 of the 797 (14.45%) people having experienced at least one flood in their current home reported that their physical health had been moderately or greatly affected by the flood. Among them, 50 (43.51%) had consulted a health professional (e.g., doctor, physiotherapist, chiropractor) because of these physical health problems. The most frequently reported problems are presented in Table 9.
The results showed also that 136 of the 797 (17.08%) people having experienced at least one flood in their current home reported that their mental health had been moderately or greatly affected negatively by the flood. Among them, 35 (25.42%) had consulted a health professional (e.g., doctor, psychologist) because of these mental health problems. The most frequently reported problems are presented in Table 10.
Relationship between the five behavioral indices of flood adaptation
Our results revealed that the five behavioral indices were moderately and significantly correlated (see Table 11). The magnitude of the correlations varied between 0.23 and 0.47. Table 11 shows that index 3 (behaviors to adopt during a flood requiring evacuation) is the index least correlated with the other indices.
Impact of socio-demographic variables
Regarding socio-economic data, no statistically significant differences were found between genders for the five adaptation indices. The results also showed that only age had an impact during a flood not requiring an evacuation (index 3), where people aged 70 to 79 had lower rates of adaptation (37.83%) than those aged 40 to 49 (65.99%). Individuals without a school diploma showed lower rates of adaptation (32.94%) during an alert (index 2) compared to respondents who had graduate degrees (57.32%). The same pattern was observed during a flood not requiring an evacuation (index 3): individuals without a school diploma showed lower rates of adaptation (40%) compared to respondents who had graduate degrees (57.42%). Finally, household income had a significant impact on preventive adaptation (index 1): people who made less than CAD$20,000 per year had lower adaptation rates (22.31%) than those earning between CAD$40,000 and CAD$60,000 (38.65%) and those earning more than CAD$80,000 (40%). Household income also had a significant impact on post-flood adaptation (index 5): people who made less than CAD$20,000 per year had lower adaptation rates (25.63%) than those earning more than CAD$80,000 (61.11%).
Given that floods are common in the province of Quebec (Canada) and that their impacts on overall health are well known, municipal and public health authorities have established protective measures to foster the adaptation of at-risk citizens. However, to our knowledge, there has been no surveillance of these flood adaptation behaviors to date. Therefore, it is impossible to determine whether the measures promoted by the authorities are actually being adopted by the population and whether they are effective for reducing the perceived health impacts. In a context of climate change where the risk of flooding is growing, it seemed important to bridge this gap.
This investigation is a substantive-methodological synergy with a focus on the construct validity (factor structure, reliability, correlation with a related variable) of five flood adaptation indices for people living in or bordering a flood zone. Across a series of psychometric analyses, the results showed that these flood adaptation indices were able to properly measure a vast range of adaptive behaviors, that is, behaviors to adopt according to the chronology of events: before the alert, at the time of the alert, during a flood requiring evacuation, during a flood not requiring evacuation, and after the flood. At a more practical level, a key contribution of this research relates to the development not only of valid indices, but also of parsimonious ones based on simple actions. These actions are recommended by public health agencies to protect individuals against flooding and should consequently reduce the severity of adverse effects on mental and physical health [22,23,24,25,26,27,28,29]. The results of this study show that a significant proportion of respondents with flood experience reported medium to high negative impacts of flooding on their physical and mental health. As nearly half of them required treatment from a health professional, improving adaptation rates could help improve flood victims’ health outcomes and reduce some of the strain put on the healthcare system. The need for increased flood education and better adaptation at the community level in Canada’s population has already been noted by Burton, Rabito et al. . These authors also emphasized the importance of better assessments of current environmental disaster resilience strategies. Because the completion of these five flood adaptation questionnaires is not time-consuming, they could be used in community and national surveys to monitor individuals’ adaptation to flooding. They could also help better target the characteristics of the people who do not adapt as well and thus define the required interventions more clearly. In this regard, because our data shows that those in the lowest income bracket adopt fewer preventive and post-flood behaviors, some interventions may be required to remove the economic barriers preventing this group from attaining desirable adaptation rates. For example, subsidies could be offered for adapting one’s basement for potential floods. Over time, this kind of monitoring could enable public health agencies to better identify protective behaviors to incorporate in health promotion campaigns.
Another contribution of this study relates to the unidimensionality of the indices. The total inertia explained by the first dimension in the multiple correspondence analysis and the good fit indices obtained in the confirmatory factor analysis both support the unidimensionality of the indices. More precisely, these results support the idea that a single latent trait was able to account for most of the variance shared among the behaviors included in the indices. Consequently, items belonging together in each index appear to capture differences in the same underlying construct, namely flood adaptation. From a practical perspective, this unidimensionality is extremely important because the behaviors underlying a given index should reflect individual differences regarding this specific construct, even if it is related to another one (e.g., resilience). Otherwise, the interpretation of the index score as being representative for the construct mentioned in the hypothesis could be wrong . Some researchers may argue that flood adaptation could be multidimensional. In fact, this is a critical issue to resolve theoretically because it has a major influence on the interpretation of the index scores. Consequently, we performed factor analyses to test multidimensional models (data not shown). We found that the multidimensional models were not as suitable (i.e., poorer statistical fit indices) as the unidimensional model.
The fact that four out of the five indices have good validity is also noteworthy. The validity of the indices was supported by their correlations with the perceived risk of being flooded in the next five years or self-reported adverse health impacts of flooding according to the adaptation indices. The results of this study showed that people who perceive a risk of flooding in their home in the next five years adopt a few more preventive behaviors and adaptation behaviors at the time of the alert than those who perceive little or no risk at all. This is consistent with the results of various studies on the subject . The results also revealed that people who feel more adverse effects on their physical or mental health adopt more adaptive behaviors during a flood not requiring evacuation as well as post-flood adaptation behaviors than those who feel little or no adverse effects on their health. This finding is similar to the results obtained in other studies on adaptation to extreme climatic events [45, 46]. Conversely, the results showed that the index of adaptation at the time of evacuation does not present a good validity. However, this result must be interpreted with caution because of the small sample size. Indeed, only 124 of the 1951 respondents had experienced such an evacuation, which is not surprising given that evacuated people rarely represent the majority of those affected by a flood . Regardless of this reservation, the values of the fit indices of the confirmatory factor analysis show that the model fits the data well. This leads us to believe that this index is nevertheless usable. Further studies are needed to validate this hypothesis.
Finally, the five behavioral indices of flood adaptation were found to be significantly related. This suggests that individuals who adapt well to flooding before the alert adapt well also at the time of the alert, during a flood not requiring an evacuation, during a flood requiring an evacuation, and after the flood. The results indicate, however, that this finding is less likely to be true for the behaviors to adopt during a flood requiring an evacuation. This finding highlights the fact that the authorities must create conditions facilitating performance of the behaviors to adopt after a flood and must remove any potential barriers to their adoption (e.g., forming environmental health teams whose members have learned to quickly mobilize to guide flood victims who are required to evacuate the neighborhood).
Despite its strengths, this study has some limitations. The first is its reliance on self-reports of flood adaptation and the possibility of participants having overestimated the extent to which they performed these socially desirable behaviors. Second, given the low response rate obtained, the sample cannot be considered representative of all individuals living in an at-risk area. For example, we cannot reject the hypothesis that the sample obtained was composed mainly of individuals who were more concerned about flooding. However, those who agreed to participate in the study responded to the great majority of the questions. Third, to ensure that these validated indices can be used in other regions or countries concerned with flooding conditions, the measurement invariance in those areas must first be demonstrated in independent samples. Measurement invariance tests would be used to evaluate the extent to which measurement properties of the adaptation indices generalize across various countries and cultures and over various periods. A lack of measurement invariance of the indices could lead to rather serious consequences. They could include inaccurate assessments of the evolution of adaptive behaviors during flooding over the years and of the real impact of a behavior change strategy (e.g., communication campaign) on people’s motivation to adopt flood adaptation behaviors. Additionally, there is always a risk that some behaviors composing each index become a habit. This could reduce the variance of these behavioral indicators and consequently their power to differentiate people who adapt from those who do not adapt as well. Thus, the validity of each index should be tested in the future to examine the relevance of the behaviors composing these indices. Finally, the validity analysis conducted did not involve any assumption of causality or directionality. Future research should verify the link of causality between self-reported adverse health effects and perceived risk of being flooded in the future and adaptive behaviors.
In conclusion, these findings demonstrate that the five flood adaptation indices for people living in or bordering a flood zone have a sound factor structure, good reliability, and construct validity. Although additional tests of the measurement invariance of the indices across various countries are needed, this study underscores their validity. Therefore, researchers, public health agencies, and professionals can use them to monitor the evolution of individuals’ adaptive behaviors during floods.
comparative fit index
post-traumatic stress disorder
root mean square error of approximation
Patz JA, Grabow ML, Limaye VS. When it rains, it pours: future climate extremes and health. Ann Glob Health. 2014 Jul;80(4):332–44.
Alderman K, Turner LR, Tong SL. Floods and human health: a systematic review. Environ Int. 2012 Oct;47:37–47.
Confalonieri UEC, Menezes JA, de Souza CM. Climate change and adaptation of the health sector: the case of infectious diseases. Virulence. 2015;6(6):554–7.
Du W, FitzGerald GJ, Clark M, Hou XY. Health impacts of floods. Prehosp Disaster Med. 2010 May;25(3):265–72.
Gosselin P, Bélanger D, Doyon B. Les effets des changements climatiques sur la santé au Québec [Internet]. Ottawa: Santé Canada; 2006 p. 102. Available from: http://ptaff.ca/blogue/wp-content/uploads/sante_et_changement_climatique-chapitre_6.pdf.
Kinney PL, Matte T, Knowlton K, Madrigano J, Petkova E, Weinberger K, et al. New York City panel on climate change 2015 ReportChapter 5: public health impacts and resiliency. Ann N Y Acad Sci. 2015;1336(1):67–88.
Lin CJ, Wade TJ, Hilborn ED. Flooding and Clostridium difficile Infection: A Case-Crossover Analysis. International Journal of Environmental Research and Public Health. 2015 received;12(6):6948–64.
McMichael AJ. Extreme weather events and infectious disease outbreaks. Virulence. 2015:1–5.
Waite T, Murray V, Baker D. Carbon monoxide poisoning and flooding: changes in risk before, during and after flooding require appropriate public health interventions. PLoS currents. 2014 Jul;3:6.
Chen L, Liu A. The incidence of posttraumatic stress disorder after floods: a meta-analysis. Disaster Med Public Health Prep. 2015;9(03):329–33.
Fernandez A, Black J, Jones M, Wilson L, Salvador-Carulla L, Astell-Burt T, et al. Flooding and mental health: a systematic mapping review. PLoS One. 2015 Apr 10;10(4):e0119929.
Lamond JE, Joseph RD, Proverbs DG. An exploration of factors affecting the long term psychological impact and deterioration of mental health in flooded households. Environmental Research. 7, 140:325–34.
Alderman K, Turner LR, Tong S. Assessment of the health impacts of the 2011 summer floods in Brisbane. Disaster Med Public Health Prep. 2013;7(04):380–6.
Institut national de santé publique du Québec. Mon climat, ma santé. Inondation: des catastrophes coûteuses [Internet]. 2010. Available from: http://www.monclimatmasante.qc.ca/inondations.aspx
Gouvernement du Québec. Rapport d’évènement : inondations printanières - Montérégie 2011 [Internet]. 2013. Available from: http://www.securitepublique.gouv.qc.ca/fileadmin/Documents/securite_civile/inondations_monteregie_2011/rapport_evenement_inondations_monteregie.pdf
Ford JD, Berrang-Ford L. Climate change adaptation in developed nations: from theory to practice. Vol. 42. Springer; 2011.
Ejeta LT, Ardalan A, Paton D. Application of Behavioral Theories to Disaster and Emergency Health Preparedness: A Systematic Review. PLoS Currents. 2015;7:ecurrents.dis.31a8995ced321301466db400f1357829.
Bélanger D, Abdous B, Gosselin P, Valois P. An adaptation index to high summer heat associated with adverse health impacts in deprived neighborhoods. Clim Chang. 2015;132(2):279–93.
Bandura R. A survey of composite indices measuring country performance: 2008 update. UNDP/ODS working paper [Internet]. 2008 [cited 2015 Nov 18];United Nations Development Program. Available from: http://old.usc.ac.ir/IPPWebV1C035/TemplateFileFolder/10-8-2013/OriginalFolder/0a6e29c4-1fa6-4496-a362-000f0851d4fc_indices_2008_bandura.pdf.
Rufat S, Tate E, Burton CG, Maroof AS. Social vulnerability to floods: review of case studies and implications for measurement. Int J Disaster Risk Reduc. 2015 Dec;14:470–86.
Cochran WG. Sampling Technique. 2nd ed. New York: John Wiley & Sons; 1963.
Kent N, Porter J, Dessai S, Miller K, Winne S, Sibille R, et al. PREPARE–the contribution and role of local and household level adaptation in overall UK adaptation. Part of the PREPARE Programme of research on preparedness, adaptation and risk. 2013. Final Report for project ERG1211 by Ricardo-AEA for Defra, Report reference Ricardo-AEA/R/ED58163/PREPARE R2/Issue 1.0.
Koerth J, Vafeidis A, Carretero S, Sterr H, Hinkel J. A typology of household-level adaptation to coastal flooding and its spatio-temporal patterns. SpringerPlus. 2014;3(1):1–10.
Kreibich H, Seifert I, Thieken AH, Lindquist E, Wagner K, Merz B. Recent changes in flood preparedness of private households and businesses in Germany. Reg Environ Chang. 2011 Mar;11(1):59–71.
Lawrence J, Quade D, Becker J. Integrating the effects of flood experience on risk perception with responses to changing climate risk. Nat Hazards. 2014;74(3):1773–94.
Gouvernement du Québec. Inondations - Santé Montérégie [Internet]. www.santemonteregie.qc.ca. 2008 [cited 2018 Sep 5]. Available from: http://www.santemonteregie.qc.ca/agence/santepublique/directiondesantepublique/inondation.fr.html.
Ville de Saint-Jean-Sur-Richelieu. Les inondations - Que faire avant, pendant et après [Internet]. www.ville.saint-jean-sur-richelieu.qc.ca. 2018 [cited 2018 Sep 6]. Available from: http://ville.saint-jean-sur-richelieu.qc.ca/securite-civile/Documents/inondations.pdf
Gouvernement du Canada. Inondations [Internet]. www.preparez-vous.gc.ca. 2015 [cited 2018 Sep 5]. Available from: https://www.preparez-vous.gc.ca/cnt/hzd/flds-fra.aspx
Ministère de la Sécurité publique du Québec. Inondations - Préparons-nous [Internet]. Sécurité publique Québec. 2018 [cited 2018 Sep 5]. Available from: https://www.securitepublique.gouv.qc.ca/securite-civile/inondation.html
Deville J-C, Särndal C-E. Calibration estimators in survey sampling. J Am Stat Assoc. 1992;87(418):376–82.
White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med. 2011;30(4):377–99.
Samejima F. Estimation of latent ability using a response pattern of graded scores (Psychometrika monograph no. 17). Psychometric Society: Richmond, VA; 1969.
Baker FB. The basics of item response theory. College Park, MD.: ERIC clearinghouse on assessment and. Evaluation. 2001.
Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55.
Kline R. Principles and practice of structural equation modeling. 3rd ed. New York: Guildford Publications; 2011. 427 p.
Greenacre M. Correspondence analysis in practice: CRC press; 2007.
Canuel M, Abdous B, Bélanger D, Gosselin P. Development of composite indices to measure the adoption of pro-environmental Behaviours across Canadian provinces. PLoS One. 2014;9(7):e101569.
Greenacre MJ. Theory and applications of correspondence analysis: Academic Press; 1984.
Cutter SL, Boruff BJ, Shirley WL. Social vulnerability to environmental hazards. Soc Sci Q. 2003;84(2):242–61.
Valois P, Houssemand C, Germain S, Abdous B. An open source tool to verify the psychometric properties of an evaluation instrument. Procedia Soc Behav Sci. 2011;15:552–6.
Meijer RR, Baneke JJ. Analyzing psychopathology items: a case for nonparametric item response theory modeling. Psychol Methods. 2004;9(3):354.
Hosmer DW, Lemeshow S. Applied logistic regression. 1rst ed. Michigan: Wiley; 1989. 307 p.
Burton H, Rabito F, Danielson L, Takaro TK. Health effects of flooding in Canada: a 2015 review and description of gaps in research. Canadian Water Resources Journal / Revue canadienne des ressources hydriques. 2016 Apr 2;41(1–2):238–49.
Ziegler M, Hagemann D. Testing the Unidimensionality of items. Eur J Psychol Assess. 2015 Oct 1;31(4):231–7.
Wolf J, Adger WN, Lorenzoni I, Abrahamson V, Raine R. Social capital, individual responses to heat waves and climate change adaptation: an empirical study of two UK cities. Glob Environ Chang. 2010 Feb 1;20(1):44–52.
Semenza JC, Ploubidis GB, George LA. Climate change and climate variability: personal motivation for adaptation and mitigation. Environ Health. 2011;10(1):46.
Sécurité publique Canada. Base de données canadienne sur les désastres [Internet]. 2007 [cited 2016 Sep 29]. Available from: http://bdc.securitepublique.gc.ca/rslts-fra.aspx?cultureCode=fr-Ca&boundingBox=&provinces=11&eventTypes=%27FL%27&eventStartDate=&injured=&evacuated=&totalCost=&dead=&normalizedCostYear=1&dynamic=false
We wish to thank the Green Fund as part of the Quebec government’s 2013-2020 Climate Change Action Plan for funding this study, as well as the Institut national de santé publique du Québec and the 2,000 participants.
This research was supported by the Green Fund of the Québec government (QC, Canada) as part of the 2013–2020 Climate Change Action Plan (http://www.mddelcc.gouv.qc.ca/cgfv/programmes.htm). The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The study was approved by the Human Subject Research Ethics Board, Université Laval, QC, Canada (reference number 109526, file number 2015–115). In the introduction of the study, participants were explicitly asked for their informed oral consent before they could answer the survey. This method ensured their anonymity and was approved by the committee.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Online resource 1. Discrimination indices for each behavior at the time of the alert. Results of the item analysis for the index of adaptation at the time of the alert. (DOCX 15 kb)
Online resource 2. Discrimination indices for each behavior during a flood not requiring an evacuation. Results of the item analysis for the four behaviors from the index of adaptation at the time of the flood not requiring an evacuation. (DOCX 14 kb)
Online resource 5. Projection of the active variables in the multiple correspondence analysis for each index of adaptation. Item characteristic curves from the non-parametric item analysis models for each of the non-preventive index of adaptation. (DOCX 164 kb)
Online resource 3. Discrimination indices for post-flood behaviors. Results from the item analysis for the 10 behaviors from the post-flood adaptation index. (DOCX 14 kb)
Online resource 4. Behaviors removed from the index because their correlation with another behavior was too high. Table of the eight behaviors removed from the pre-alert preventive index because their correlation with another behavior was too high. (DOCX 15 kb)
About this article
Cite this article
Valois, P., Caron, M., Gousse-Lessard, AS. et al. Development and validation of five behavioral indices of flood adaptation. BMC Public Health 19, 245 (2019). https://doi.org/10.1186/s12889-019-6564-0
- Climate change