Skip to main content
Download PDF

Second-stage non-response in the Swiss health survey: determinants and bias in outcomes

BMC Public Health volume 13, Article number: 167 (2013) Cite this article

Abstract

Background

Unit non-response occurs in sample surveys when a target subject does not respond to a survey. Potential implications are decreased power, increased standard error, and non-response bias. The objective of this study was to assess the factors associated with participation in a written survey (MSHS) of subjects who had previously participated in the Swiss Health Survey (SHS) and to evaluate to what extent non-participation could impact the estimation of various MSHS health outcomes.

Methods

Multivariate logistic regression was used to assess the factors associated with MSHS participation (n=14,393) by eligible SHS participants (n=17,931). Crude participation rates and the adjusted odds ratios of participation (OR) were reported. In order to report potential bias in MSHS outcomes, the average age-standardized and sex-specific outcome values in non-participants were predicted based on several different linear regression models which had been previously fitted on MSHS participants.

Results

Adjusting for all other variables, women (OR=1.63) as compared with men, subjects with a secondary (OR=1.48) or tertiary education (OR=1.76) as compared with those with primary education, white-collar workers (high level non-manual workers OR=1.29, medium and low level non-manual workers OR=1.26 and OR=1.25 respectively) as compared with unskilled manual workers, Swiss nationals (OR=1.60) as compared to non-Swiss, and subjects with very good or good self-rated health (OR=1.35) were more likely to participate in the MSHS. People who work full-time were less likely to participate than those without paid work (OR=0.76). There were no statistically significant differences in the likelihood of participation between rural and urban areas, different geographic regions of Switzerland and household income quartiles.

Except for myocardial infarction, all age-standardized and sex-specific average outcomes (influenza vaccination, arthrosis, osteoporosis, high blood pressure, depression, mastery, and sense of coherence) were significantly different between MSHS non-participants and participants.

Conclusions

Subjects who participated in the MSHS had a higher socio-economic status, reported a better subjective health, and were more likely to be Swiss nationals. Small to moderate bias was found for most age-adjusted and sex-specific average outcomes. Consequently, these MSHS outcomes should be used and interpreted with care.

Peer Review reports

Background

Unit non-response occurs in sample surveys when a target subject does not respond to a survey. Potential implications of unit non-response are decreased power due to reduced sample size, increased standard error due to random error, and non-response bias due to systematic error because the calculation of estimates is generally based on those who responded to the survey. Consequently, the handling of unit non-response [1–7], the determinants of non-response [8–13] and its effect on results of interest [9, 14–18] have become a major topic of interest [2]. More specifically, several studies have been undertaken on the non-response to health interview surveys (HIS). Previous studies find that respondents have a higher socio-economic status and that they report a better subjective health, lower healthcare use, and healthier lifestyle behaviour than non-respondents [19–28]. However, other studies find higher healthcare use for respondents or better health status for non-respondents [29–33]. So far, few studies have investigated selection mechanisms in second-stage non-response in HIS designs [22, 34]. At the second stage, HIS participants are asked to participate in yet another survey. At this stage, the population has already been willing to give personal information on their health, their health service utilization or their health-related behavior. Hence, their characteristics, their motives and the underlying mechanisms of non-response may be different from those of subjects who refuse to participate in the initial interview. While little is known about second-stage non-response in general, there is currently no study that investigates second-stage non-response in the Swiss Health Survey (SHS). The SHS is the main cross-sectional, population-based HIS in Switzerland which intends to monitor health trends in a representative sample of permanent residents. At the end of a lengthy face to face or telephone interview, eligible SHS participants (n=17,931) were asked to complete and return an additional mail survey (MSHS). The mail-back questionnaire was returned by 80.3% of the interviewees. Since extensive data were available on all SHS participants, no matter whether they participated in the MSHS or not, the current study is able to assess second-stage non-response in the SHS. The objectives of this study are: 1) to describe the factors associated with MSHS participation and 2) to assess to what extent non-participation could impact the estimation of major health outcomes monitored by the MSHS.

Methods

Study design

The study is a methodologically-focused secondary analysis of a population-based, cross-sectional health survey carried out in 2007 in Switzerland.

Study population and data

The Swiss Health Survey carried out by the Swiss Federal Statistical Office (SFSO) is a nationwide survey on health status, health service utilization, and health-related behavior in Switzerland. The SHS was first conducted in 1992 and is repeated every five years. In 2007, a multistage probability sample was drawn of the entire Swiss population after stratification by geographic region. The initial sample (n=28,319) included subjects aged 15 years or older living in private households. The sampling frame excluded people living in institutions, i.e. hospitals, homes for the elderly, prisons, monasteries, barracks, etc. Furthermore, only subjects fluent in German, French or Italian were included. The response rate of those in the initial sample was 66.2% (n=18’760); 13.2% (n=3′730) could not be contacted after numerous contact attempts, and 20.6% (n=5’825) refused to participate in the SHS. Of the latter, 445 subjects refused to participate due to language problems (1.6% of the initial sample).

Three different types of interviews were conducted. Generally, computer-aided telephone interviews (CATI) were conducted for subjects aged 15–74 years (n=17,856). Subjects aged 75 years or older were given the choice between a CATI or a face to face interview. For those opting for face to face interviews, computer-aided personal interviews (CAPI) were conducted (n=75). Finally, CATI were conducted with proxy persons (PROXY, n=829), that is close friends or relatives of the target subject were interviewed if the target subject could not be interviewed because of old-age, illness, handicap, language problems or due to absence from home for more than 4 weeks. At the end of the forty-minute interview, CATI and CAPI participants (n=17,931) were invited to complete and return an additional written survey (MSHS). PROXY participants were not eligible to participate in the MSHS. Of those eligible to participate, 97.7% (n=17’511) consented to return the MSHS and the questionnaires were sent out to those willing to participate in the next 2–3 days following the SHS interview. The mail-back questionnaire which included questions on mental stress, mental illness, chronic diseases, vaccination status, social support, health literacy, health insurance coverage etc., was returned by 80.3% (n=14,393) of the 17,931 CATI & CAPI interviewees. Subjects who did not return the questionnaire were not re-contacted.

Imputation

In order to prevent the loss of information and to prevent potential bias due to selective refusal to provide answers, item non-response was addressed by the statistical technique of multiple imputations (MI) and multivariate normal regression was used as the imputation method to estimate missing values [35–38]. In contrast to other imputation procedures, MI is more likely to yield valid statistical inference than other methods of imputation because its simulation-based procedures treat imputed values as estimates with a random component rather than treating the imputed values as known with certainty. For SHS variables, the percentage of imputed values ranged from 0.04% to 5.64%. For MSHS variables, between 1.74% and 9.73% of the values were imputed (Table 1). To obtain estimates based on the pooled set of imputation results from each completed dataset (m=20), subsequent statistical analyses were carried out using Stata’s “mi estimate” prefix.

Table 1 Frequency of imputed values in SHS and MSHS
Full size table

Statistical analyses

Multivariate logistic regression was used to assess the factors associated with MSHS participation. Crude participation rates and the adjusted odds ratios of participation were reported. The latter were adjusted for age (including age2), gender, the interaction between age and gender, socio-economic status (including educational level, occupational status, employment, and income), nationality, religious denomination, urbanity, geographic region, self-reported health and the number of contact attempts needed until the CATI or CAPI could be realized. Age was measured in years (whole-numbers), contact attempts were also represented in continuous whole-numbers. The remaining covariates comprised two or more categories: gender (female, male), educational level (primary, secondary, and tertiary education), occupational status (high level non-manual, medium level non-manual, low level non-manual, self-employed craftsmen, skilled manual, unskilled manual), employment (full time, part time, not in workforce), income (1st, 2nd, 3rd, and 4th quartile of household income), nationality (Swiss, non-Swiss), religious denomination (Protestant, Free Protestant, Roman Catholic, Christian Catholic, Christian Orthodox, other Christian, Jewish, Muslim, other, none). Urbanity comprised two categories: rural area and urban area. Urban areas included isolated cities (≥10,000 inhabitants) and urban agglomerations (≥20,000 inhabitants); all other areas were assigned to the category rural area. Geographic region comprised the seven greater regions of Switzerland (Midlands, Northwest, Zurich, East, Central, Tessin, and Lake Geneva Region). Self-reported health comprised two categories (very good or good health versus moderate, bad or very bad health).

To assess potential bias in MSHS outcomes, 8 variables from 3 domains (chronic diseases, prevention, psycho-social resources) were selected and the average outcome values in non-participants were predicted based on several different linear regression models which had been previously fitted on MSHS participants. From the 14 chronic diseases covered by the MSHS, 5 chronic diseases were selected based on the frequency of item non-response, i.e. outcomes with fewer missing values were preferred. The 5 disease related outcomes comprised the lifetime prevalence of arthrosis, osteoporosis, high blood pressure, myocardial infarction, and depression. Only 2 outcomes related to prevention were covered by the MSHS: contraception and influenza vaccination. The 12 month prevalence of influenza vaccination was selected because of its relevance in the contemporary Swiss public health debate, i.e. Switzerland faces a new law on mandatory vaccination. Finally, mastery and sense of coherence, the two psycho-social resources covered by the MSHS were selected because of their relevance when coping with stressful life events such as diseases [39]. While the mastery instrument was based on a brief version of the Pearlin coping questionnaire [40], the SOC instrument was based on a brief version of Antonovsky’s sense of coherence questionnaire [41]. All eight prediction models included socio-economic and sociodemographic covariates (age, gender, educational level, occupational status, employment, income, nationality, religious denomination, urbanity and geographic region) as well as self-reported health (all indicators measured as described above) and the Mental Health Inventory score (MHI-5). The MHI-5 is a 5-item subscale from the SF-36 [42, 43] which is used to capture four major dimensions of mental health: anxiety, depression, loss of behavioural/emotional control, and psychological well-being.

Outcome estimates related to the lifetime prevalence of arthrosis, osteoporosis, high blood pressure, myocardial infarction, and depression also included the body mass index (BMI) as a covariate. BMI calculation was based on self-reported height and weight (BMI=kg/m2). Finally, the existence of an acute major depression according to DSM-IV criteria (measured using CIDI-SF [44]) was added as a binary covariate to the model predicting the lifetime prevalence of depression. Crude average outcomes and age-standardized, sex-specific average outcomes were compared between participants and non-participants of the MSHS. Statistical significance was established at p ≤ 0.05.

Results

Factors associated with participation

Overall, more than 80% of the subjects who completed the SHS CATI or SHS CAPI also completed and returned the MSHS (Table 2). Participation rates were relatively high in all groups and never dropped below 60%. However, substantial differences between socio-economic as well as between sociodemographic groups were found. Generally, people from lower socio-economic strata exhibited lower participation rates. Similarly, non-Swiss nationals and members of some religious denominations showed lower participation rates. Participation rates varied also with age and their patterns were different between women and men (Figure 1). When adjusting for all other variables, these initial results were confirmed. Participation rates of both, men and women, increased gradually with age, eventually reached their maximum and decreased with age thereafter. The participation rates of women started to decrease at approximately 45 years of age, the participation rates of men began to decrease at approximately 60 years of age. At younger ages, the participation rates of women were generally higher than those of men whereas participation rates of men were equal to those of women at approximately 56 years of age and started to be higher than those of women at older ages. Overall, women were more likely to participate in the MSHS than men (OR=1.63), age2 (OR=0.99), age (OR=1.06), and the interaction between age and gender (OR=0.99) were all significantly associated (p<0.001) with MSHS participation. People with a secondary (OR=1.48) or tertiary education (OR=1.76) as compared with people with primary education were more likely to participate in the MSHS as were white-collar workers (high level non-manual workers OR=1.29, medium and low level non-manual workers OR=1.26 and OR=1.25 respectively) as compared with unskilled manual workers. People who work full-time were less likely to participate than those without paid work (OR=0.76), and Swiss nationals were more likely to participate than were non-Swiss nationals (OR=1.60). Compared with people who had no religious affiliation, members of the Christian Catholic Church (OR=0.66), the Orthodox Church (OR=0.49), Muslim religious communities (OR=0.36) or the residual category other religious community (OR=0.52) were less likely to participate in the MSHS. Members of the remaining religious denominations, most notably members of the large Swiss State Churches (Protestant and Roman Catholic Church), did not differ from people without religious affiliation. People with better self-rated health (OR=1.35) were also more likely to complete and return the MSHS as compared with people who rated their health as moderate, bad or very bad.

Figure 1
figure 1

MSHS participation rates among eligible CATI& CAPI participants by gender and age. Diamonds, crude rates for men; circles, crude rates for women; solid line, fitted values for men; dotted line, fitted values for women. Fitted values are adjusted for all variables in Table 2, the interaction term gender x age, and the number of contact attempts needed to realize the CATI/CAPI. Data source: Swiss Federal Statistical Office.

Full size image
Table 2 MSHS participation rates among eligible CATI & CAPI participants and multivariate odds ratios of participating in the MSHS *
Full size table

Finally, no statistically significant differences in the likelihood of participation were observed between rural and urban areas, different geographic regions of Switzerland and household income quartiles.

Potential bias in outcomes

In order to assess potential bias in MSHS outcome variables, outcomes of non-participants were estimated based on different linear regression models which had been previously fitted on MSHS participants. Table 3 shows the model fit as well as the strongest predictors (P<0.001) for each outcome variable. Generally, the percentage of variance explained by the models was moderate and ranged from 18.6% to 26.7%.

Table 3 Predictors with P<0.001 in the models for MSHS outcomes
Full size table

Crude predicted values for the MSHS non-participants (Table 4) were higher than the upper boundary of the 95% confidence interval (95%-CI) of the MSHS participants in four of the eight outcomes (influenza vaccination, arthrosis, high blood pressure, and depression) and they were lower than the lower boundary of 95%-CI of the MSHS participants in two outcomes (mastery and SOC). The predicted lifetime prevalence of osteoporosis and myocardial infarction of non-participants was within the boundaries of the 95%-CI of MSHS participants. Age-standardized and sex-specific figures (Table 5) give a more differentiated picture. For male non-participants, the predicted 12 month prevalence of influenza vaccination, the lifetime prevalence of arthrosis, osteoporosis, and high blood pressure were found to be lower than the lower boundary of the 95%-CI of male MSHS participants. For female non-participants, the corresponding predicted outcomes were higher than the upper boundary of the 95%-CI of female MSHS participants. The predicted lifetime prevalence of depression of female and male non-participants was higher than the upper boundary of the corresponding 95%-CI of MSHS participants. Finally, average mastery and SOC scores of male and female non-participants were lower than the lower boundary of the 95%-CI of corresponding male and female participants.

Table 4 Outcomes in MSHS participants and predicted outcomes in non-participants *
Full size table
Table 5 Age-standardized and gender-specific outcomes in MSHS participants and predicted outcomes in non-participants *
Full size table

Discussion

More than 80% of eligible SHS participants were willing to complete and return the additional mail-back questionnaire.

Subjects who participated in the mail survey had a higher socio-economic status (higher education, white-collar workers), reported a better subjective health and were more likely to be Swiss nationals. Generally, these finding are in accordance with previous studies that investigated initial non-response [3, 19–28]. Unfortunately, a rigorous comparison of initial and second-stage SHS/MSHS non-response is not feasible because systematic data on non-response in the SHS are unavailable. However, it is plausible that the mechanisms of initial non-response in the SHS are not very different from those found in previous HIS studies, at least when it comes to important sociodemographic and socioeconomic factors such as gender, education, employment and nationality. Moreover, available population data in comparison with SHS/MSHS data (Table 6) show that the proportion of men, the proportion of subjects with primary education, the proportion of subjects with full-time employment, and the proportion of non-Swiss is lower in the SHS and MSHS samples. At least partially, these differences may be attributed to non-response. Together, evidence from previous HIS non-response studies and available population data suggest that there seems to be no fundamental difference between the mechanisms of initial non-response and second-stage non-response. Consequently, the systematic under-representation of the same group or groups of non-respondents is reinforced in the second stage. In the MSHS, this may be specifically the case for non-Swiss nationals with low educational levels. While crude MSHS response rates for Swiss nationals were 73.4% for subjects with primary education, 82.2% for subjects with secondary education, and 86.7% for subjects with tertiary education, the respective response rates for non-Swiss nationals were substantially lower (58.3%, 66.4%, and 78.3%). Furthermore, the differences between Swiss and non-Swiss nationals were much more pronounced in the lower educational levels. Unfortunately, no information is available on the initial SHS response rates by nationality and educational level. However, it is very likely that non-Swiss nationals had lower SHS response rates since interviews were conducted in German, French or Italian which potentially favoured non-Swiss nationals who are well-integrated, well-educated and have been living in Switzerland for a long period of time. Given that in 2009, non-Swiss nationals accounted for 1.7 million people or roughly 22% of the permanent resident population of Switzerland, the implications of lower response rates in this group should not be taken lightly.

Table 6 Proportions of selected demographic variables in the Swiss permanent resident population and in the SHS/MSHS
Full size table

Subjects without paid work and subjects who worked part-time were more likely to participate in the MSHS than those who worked full-time (all other things being equal). Although this finding is not in accordance with previous evidence [22], one plausible explanation is that subjects who work full-time have lower time budgets and are therefore less willing to spend time on completing and returning the questionnaire.

Religious affiliation was also found to be associated with MSHS non-response. Especially subjects who were members of relatively small religious denominations were less likely to return the mail-back questionnaire while the response rates of members of the large Swiss State Churches (Protestant Church, Roman Catholic Church) and subjects with no religious affiliation did not significantly differ from each other. These finding are in partial agreement with one previous study of second-stage non-response which observed that Muslims had lower response rates than members of other religious denominations [19].

MSHS response rates were not different between rural and urban areas and between different geographic regions. Previous evidence is mixed: some studies observed that response rates are higher in rural areas [13, 45, 46], others found that response rates are higher in urban areas [22, 47]. In Switzerland, the presence of similar response rates in rural and urban areas may be related to geographic proximity. Switzerland has a very dense network of post offices. Therefore, travel time to the nearest post office to mail back the questionnaire is hardly an issue, if at all.

Finally, numerous previous studies report that females are more likely to participate in surveys [16, 21, 24, 28, 45, 48]. While the current study also found higher female participation, the current study did not find a uniform pattern of higher female participation in the MSHS. Rather, participation rates of men and women were linked with age, i.e. at younger ages, the participation rates of women were higher than those of men whereas participation rates of men were higher at older ages. The fact that higher male participation rates approximately coincide with retirement age may suggest that men are more willing than women to invest their additional time resources in the completion of surveys. This hypothesis should be examined in further studies.

In a second step, the current study attempted to quantify the magnitude of the bias due to selective non-response by estimating population average values of eight major MSHS outcome variables. Although overall non-participation rates were relatively low, non-participation was clearly associated with socio-economic status, non-Swiss nationality, and health status. Hence bias is potentially induced by the under-representation of non-Swiss nationals and lower socio-economic strata. Bias could be demonstrated for all crude average outcomes, except for the lifetime prevalence of osteoporosis and myocardial infarction. Furthermore, bias could also be shown for all age-standardized and sex-specific average outcomes, except for myocardial infarction. The predicted age-standardized average mastery and SOC scores of male and female MSHS non-respondents were below the respective values for respondents while the predicted lifetime prevalence of depression was higher in non-respondents. These results support the notion that bias is potentially induced by the under-representation of lower socio-economic strata: earlier studies find that lower mastery and SOC scores are associated with lower socio-economic status [49, 50] and higher SOC and mastery scores are associated with a better mental health status [50–52]. There is also evidence that some immigrant groups in Switzerland have higher hospitalization rates due to affective disorders as compared to Swiss nationals [53]. Similarly, the Swiss Migrant Health Survey 2010 reports better health for Swiss nationals as compared to nationals from Portugal, Serbia, Kosovo, and Turkey. More specifically, Swiss nationals were less likely to suffer from depression, high blood pressure, arthrosis, osteoporosis, sick headache, and allergy than most non-Swiss nationals [54].

Bias was also observed for age-standardized and sex-specific average lifetime prevalence of high blood pressure, arthrosis, and osteoporosis. However, the predicted prevalence rates for female non-participants were above those for female MSHS participants while the predicted prevalence rates for male non-participants were below those for male participants. This may be due to a gender-specific self-selection mechanism: subjects with high socio-economic status (especially tertiary education and high and medium level non-manual workers) were much more common in male than in female non-participants.

Although bias could be demonstrated for several MSHS outcomes, the magnitude of the bias is at most moderate, i.e. the differences between age-standardized and sex-specific average prevalence rates of MSHS respondents and predicted prevalence rates of non-respondents are below 2% and the respective differences in average mastery and SOC scores cannot be considered substantial. Yet, the SHS response rate amounted to little more than 66% which suggests that SHS participants may be a selective sample of the general population of Switzerland. Moreover, the SHS sampling frame excluded subjects living in institutions and included only subjects fluent in German, French or Italian. Were these subjects part of the SHS, their non-participation may further increase bias because they may have high MSHS non-response rates and poorer health.

The current study has important limitations. Firstly, prevalence calculations for non-respondents are based on parameter estimates for respondents. This implies that the selected prevalence models for respondents also yield valid results for non-respondents. However, given the various documented differences between respondents and non-respondents, this may not necessarily be the case. That is, the use of models suited for respondents may be a potential source of bias when used to estimate the prevalence rates for non-respondents. Secondly, systematic data on initial non-response in the SHS were unavailable. Hence, the discussion on initial and MSHS second-stage non-response had to be based on previous evidence on initial HIS non-response and the available population data.

Conclusions

Subjects who participated in the MSHS had a higher socio-economic status (higher education, white-collar workers), reported a better subjective health and were more likely to be Swiss nationals. Small to moderate bias was found for most age-adjusted and sex-specific average outcomes, i.e. the prevalence of depression, arthrosis, osteoporosis, high blood pressure, and influenza vaccination as well as the Pearlin mastery and sense of coherence scores. Consequently, these MSHS outcomes should be used and interpreted with care. Further waves of the SHS/MSHS should especially improve participation of non-Swiss and subjects with low socio-economic status. Furthermore, the SHS should include variables that facilitate a more rigorous investigation of initial non-response and thus facilitate a better understanding of non-response bias.

References

  1. Wun LM, Ezzati-Rice TM, Diaz-Tena N, Greenblatt J: On modelling response propensity for dwelling unit (DU) level non-response adjustment in the medical expenditure panel survey (MEPS). Stat Med. 2007, 26: 1875-1884. 10.1002/sim.2809.

    Article  PubMed  Google Scholar 

  2. Oleson JJ, He CZ: Adjusting nonresponse bias at subdomain levels using multiple response phases. Biom J Biometrische Zeitschrift. 2008, 50: 58-70. 10.1002/bimj.200710360.

    Article  PubMed  Google Scholar 

  3. O'Brien EM, Black MC, Carley-Baxter LR, Simon TR: Sensitive topics, survey nonresponse, and considerations for interviewer training. Am J Prev Med. 2006, 31: 419-426. 10.1016/j.amepre.2006.07.010.

    Article  PubMed  Google Scholar 

  4. Ratcliffe J, Young T, Longworth L, Buxton M: An assessment of the impact of informative dropout and nonresponse in measuring health-related quality of life using the EuroQol (EQ-5D) descriptive system. Value Health: the journal of the International Society for Pharmacoeconomics and Outcomes Research. 2005, 8: 53-58. 10.1111/j.1524-4733.2005.03068.x.

    Article  Google Scholar 

  5. Jenkins P, Earle-Richardson G, Burdick P, May J: Handling nonresponse in surveys: analytic corrections compared with converting nonresponders. Am J Epidemiol. 2008, 167: 369-374.

    Article  PubMed  Google Scholar 

  6. Tivesten E, Jonsson S, Jakobsson L, Norin H: Nonresponse analysis and adjustment in a mail survey on car accidents. Accid Anal Prev. 2012, 48: 401-415.

    Article  PubMed  Google Scholar 

  7. Nyirenda M, Zaba B, Barnighausen T, Hosegood V, Newell ML: Adjusting HIV prevalence for survey non-response using mortality rates: an application of the method using surveillance data from Rural South Africa. PLoS One. 2010, 5: e12370-10.1371/journal.pone.0012370.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Marcus B, Schutz A: Who are the people reluctant to participate in research? Personality correlates of four different types of nonresponse as inferred from self- and observer ratings. J Pers. 2005, 73: 959-984. 10.1111/j.1467-6494.2005.00335.x.

    Article  PubMed  Google Scholar 

  9. Ziraba AK, Madise NJ, Matilu M, Zulu E, Kebaso J, Khamadi S, Okoth V, Ezeh AC: The effect of participant nonresponse on HIV prevalence estimates in a population-based survey in two informal settlements in Nairobi city. Population health metrics. 2010, 8: 22-10.1186/1478-7954-8-22.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Kalb LG, Cohen C, Lehmann H, Law P: Survey non-response in an internet-mediated, longitudinal autism research study. Journal of the American Medical Informatics Association: JAMIA. 2012, 19: 668-673. 10.1136/amiajnl-2012-000863.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Mannetje A, Eng A, Douwes J, Ellison-Loschmann L, McLean D, Pearce N: Determinants of non-response in an occupational exposure and health survey in New Zealand. Aust N Z J Public Health. 2011, 35: 256-263. 10.1111/j.1753-6405.2011.00703.x.

    Article  Google Scholar 

  12. Hussain A, Weisaeth L, Heir T: Nonresponse to a population-based postdisaster postal questionnaire study. J Trauma Stress. 2009, 22: 324-328. 10.1002/jts.20431.

    Article  PubMed  Google Scholar 

  13. Jay GM, Liang J, Liu X, Sugisawa H: Patterns of nonresponse in a national survey of elderly Japanese. J Gerontol. 1993, 48: S143-S152.

    CAS  PubMed  Google Scholar 

  14. Ronmark EP, Ekerljung L, Lotvall J, Toren K, Ronmark E, Lundback B: Large scale questionnaire survey on respiratory health in Sweden: effects of late- and non-response. Respir Med. 2009, 103: 1807-1815. 10.1016/j.rmed.2009.07.014.

    Article  PubMed  Google Scholar 

  15. Casarett D, Smith D, Breslin S, Richardson D: Does nonresponse bias the results of retrospective surveys of end-of-life care?. J Am Geriatr Soc. 2010, 58: 2381-2386. 10.1111/j.1532-5415.2010.03175.x.

    Article  PubMed  Google Scholar 

  16. Peytchev A, Ridenhour J, Krotki K: Differences between RDD telephone and ABS mail survey design: coverage, unit nonresponse, and measurement error. J Health Commun. 2010, 15 (Suppl 3): 117-134.

    Article  PubMed  Google Scholar 

  17. Shahar E, Folsom AR, Jackson R: The effect of nonresponse on prevalence estimates for a referent population: insights from a population-based cohort study. Atherosclerosis Risk in Communities (ARIC) Study Investigators. Ann Epidemiol. 1996, 6: 498-506. 10.1016/S1047-2797(96)00104-4.

    Article  CAS  PubMed  Google Scholar 

  18. Hill A, Roberts J, Ewings P, Gunnell D: Non-response bias in a lifestyle survey. J Public Health Med. 1997, 19: 203-207. 10.1093/oxfordjournals.pubmed.a024610.

    Article  CAS  PubMed  Google Scholar 

  19. Picavet HS: National health surveys by mail or home interview: effects on response. J Epidemiol Community Health. 2001, 55: 408-413. 10.1136/jech.55.6.408.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Turrell G, Patterson C, Oldenburg B, Gould T, Roy MA: The socio-economic patterning of survey participation and non-response error in a multilevel study of food purchasing behaviour: area- and individual-level characteristics. Public Health Nutr. 2003, 6: 181-189.

    PubMed  Google Scholar 

  21. Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H, Koskenvuo M: Non-response and related factors in a nation-wide health survey. Eur J Epidemiol. 2001, 17: 991-999. 10.1023/A:1020016922473.

    Article  CAS  PubMed  Google Scholar 

  22. Boshuizen HC, Viet AL, Picavet HS, Botterweck A, van Loon AJ: Non-response in a survey of cardiovascular risk factors in the Dutch population: determinants and resulting biases. Public Health. 2006, 120: 297-308. 10.1016/j.puhe.2005.09.008.

    Article  CAS  PubMed  Google Scholar 

  23. Dey M, Mohler-Kuo M: An analysis of non-response in a Swiss national survey. International journal of public health. 20 July 2012, 10.1007/s00038-012-0377-6. URLhttp://link.springer.com/search?query=dey&search-within=Journal&facet-journal-id=%2238%22#page-1,

    Google Scholar 

  24. Martikainen P, Laaksonen M, Piha K, Lallukka T: Does survey non-response bias the association between occupational social class and health?. Scand J Public Health. 2007, 35: 212-215. 10.1080/14034940600996563.

    Article  PubMed  Google Scholar 

  25. Helasoja V, Prattala R, Dregval L, Pudule I, Kasmel A: Late response and item nonresponse in the Finbalt Health Monitor survey. Eur J Public Health. 2002, 12: 117-123. 10.1093/eurpub/12.2.117.

    Article  PubMed  Google Scholar 

  26. Pietila AM, Rantakallio P, Laara E: Background factors predicting non-response in a health survey of northern Finnish young men. Scand J Soc Med. 1995, 23: 129-136.

    CAS  PubMed  Google Scholar 

  27. Kypri K, Samaranayaka A, Connor J, Langley JD, Maclennan B: Non-response bias in a web-based health behaviour survey of New Zealand tertiary students. Prev Med. 2011, 53: 274-277. 10.1016/j.ypmed.2011.07.017.

    Article  PubMed  Google Scholar 

  28. Littman AJ, Boyko EJ, Jacobson IG, Horton J, Gackstetter GD, Smith B, Hooper T, Wells TS, Amoroso PJ, Smith TC: Assessing nonresponse bias at follow-up in a large prospective cohort of relatively young and mobile military service members. BMC Med Res Methodol. 2010, 10: 99-10.1186/1471-2288-10-99.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Vercambre MN, Gilbert F: Respondents in an epidemiologic survey had fewer psychotropic prescriptions than nonrespondents: an insight into health-related selection bias using routine health insurance data. J Clin Epidemiol. 2012, 65: 1181-1189. 10.1016/j.jclinepi.2012.05.002.

    Article  PubMed  Google Scholar 

  30. Etter JF, Perneger TV: Analysis of non-response bias in a mailed health survey. J Clin Epidemiol. 1997, 50: 1123-1128. 10.1016/S0895-4356(97)00166-2.

    Article  CAS  PubMed  Google Scholar 

  31. Lamers LM: Medical consumption of respondents and non-respondents to a mailed health survey. Eur J Public Health. 1997, 7: 267-271. 10.1093/eurpub/7.3.267.

    Article  Google Scholar 

  32. Reijneveld SA, Stronks K: The impact of response bias on estimates of health care utilization in a metropolitan area: the use of administrative data. Int J Epidemiol. 1999, 28: 1134-1140. 10.1093/ije/28.6.1134.

    Article  CAS  PubMed  Google Scholar 

  33. Rupp I, Triemstra M, Boshuizen HC, Jacobi CE, Dinant HJ, van den Bos GA: Selection bias due to non-response in a health survey among patients with rheumatoid arthritis. Eur J Public Health. 2002, 12: 131-135. 10.1093/eurpub/12.2.131.

    Article  PubMed  Google Scholar 

  34. Forthofer RN: Investigation of nonresponse bias in NHANES II. Am J Epidemiol. 1983, 117: 507-515.

    CAS  PubMed  Google Scholar 

  35. van Buuren S, Boshuizen HC, Knook DL: Multiple imputation of missing blood pressure covariates in survival analysis. Stat Med. 1999, 18: 681-694. 10.1002/(SICI)1097-0258(19990330)18:6<681::AID-SIM71>3.0.CO;2-R.

    Article  CAS  PubMed  Google Scholar 

  36. Schafer JL, Olsen MK: Multiple imputation for multivariate missing-data problems: a data analyst’s perspective. Mulitvariate Behav Res. 1998, 33: 545-571. 10.1207/s15327906mbr3304_5.

    Article  CAS  Google Scholar 

  37. Rubin DB: Multiple imputations after 18+ years. J Am Stat Assoc. 1996, 91: 473-489. 10.1080/01621459.1996.10476908.

    Article  Google Scholar 

  38. Rubin DB: Multiple imputation for nonresponse in surveys. 1987, New York: Wiley

    Book  Google Scholar 

  39. Moser DK, Dracup K: Psychosocial recovery from a cardiac event: the influence of perceived control. Heart & lung: the journal of critical care. 1995, 24: 273-280. 10.1016/S0147-9563(05)80070-6.

    Article  CAS  Google Scholar 

  40. Pearlin LI, Schooler C: The structure of coping. J Health Soc Behav. 1978, 19: 2-21. 10.2307/2136319.

    Article  CAS  PubMed  Google Scholar 

  41. Antonovsky A, Franke A: Salutogenese: zur Entmystifizierung der Gesundheit. 1997, Dgvt: Tübingen

    Google Scholar 

  42. Bullinger M, Kirchberger I, Ware JE: Der deutsche SF-36 Health Survey. Übersetzung und psychometrische Testung eines krankheitsübergreifenden Instruments zur Erfassung der gesundheitsbezogenen Lebensqualitä. Zeitschrift für Gesundheitswissenschaften. 1995, 3: 21-36.

    Google Scholar 

  43. McHorney CA, Ware JE, Raczek AE: The MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Medical care. 1993, 31: 247-263. 10.1097/00005650-199303000-00006.

    Article  CAS  PubMed  Google Scholar 

  44. Kessler R, Andrews G, Mroczek D, Ustun B, Wittchen HU: The World Heatlh Organization Composite Interantional Diagnostic Interview Short-Form (CIDI-SF). Int J Methods Psychiatr Res. 1998, 7: 171-185. 10.1002/mpr.47.

    Article  Google Scholar 

  45. Eaker S, Bergstrom R, Bergstrom A, Adami HO, Nyren O: Response rate to mailed epidemiologic questionnaires: a population-based randomized trial of variations in design and mailing routines. Am J Epidemiol. 1998, 147: 74-82. 10.1093/oxfordjournals.aje.a009370.

    Article  CAS  PubMed  Google Scholar 

  46. Nummela O, Sulander T, Helakorpi S, Haapola I, Uutela A, Heinonen H, Valve R, Fogelholm M: Register-based data indicated nonparticipation bias in a health study among aging people. J Clin Epidemiol. 2011, 64: 1418-1425. 10.1016/j.jclinepi.2011.04.003.

    Article  PubMed  Google Scholar 

  47. Rodes A, Sans S, Balana LL, Paluzie G, Aguilera R, Balaguer-Vintro I: Recruitment methods and differences in early, late and non-respondents in the first MONICA-Catalonia population survey. Rev Epidemiol Sante Publique. 1990, 38: 447-453.

    CAS  PubMed  Google Scholar 

  48. Maclennan B, Kypri K, Langley J, Room R: Non-response bias in a community survey of drinking, alcohol-related experiences and public opinion on alcohol policy. Drug Alcohol Depend. 2012, 126 (1): 189-194. 10.1016/j.drugalcdep.2012.05.014.

    Article  PubMed  Google Scholar 

  49. Larsson G, Kallenberg KO: Sense of coherence, socioeconomic conditions and health. Interrelationships in a nation-wide Swedish sample. Eur J Public Health. 1996, 6: 175-180. 10.1093/eurpub/6.3.175.

    Article  Google Scholar 

  50. Dalgard OS, Mykletun A, Rognerud M, Johansen R, Zahl PH: Education, sense of mastery and mental health: results from a nation wide health monitoring study in Norway. BMC Psychiatry. 2007, 7: 20-10.1186/1471-244X-7-20.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Henje Blom EC, Serlachius E, Larsson JO, Theorell T, Ingvar M: Low Sense of Coherence (SOC) is a mirror of general anxiety and persistent depressive symptoms in adolescent girls - a cross-sectional study of a clinical and a non-clinical cohort. Health Qual Life Outcomes. 2010, 8: 58-10.1186/1477-7525-8-58.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Bovier PA, Chamot E, Perneger TV: Perceived stress, internal resources, and social support as determinants of mental health among young adults. Qual Life Res: an international journal of quality of life aspects of treatment, care and rehabilitation. 2004, 13: 161-170.

    Article  Google Scholar 

  53. Moreau-Gruet F, Luyet S: Migrationsbevölkerung und Gesundheit. 2012, Neuchâtel, Swiss Health Observatory: Analyse der Hospitalisierung

    Google Scholar 

  54. Gasser K: Gesundheit der Migrantinnen und Migranten in der Schweiz. Wichtigste Ergebnisse der zweiten Gesundheitsmonitorings der Migrationsbevölkerung in der Schweiz, 2010. 2012, Bern: Swiss Federal Office of Public Health

    Google Scholar 

Pre-publication history

Download references

Acknowledgements

This study was supported by the Swiss Federal Statistical Office and the Swiss Federal Office of Public Health, grant number 11.007631/704.0001/-517.

Author information

Authors and Affiliations

  1. School of Health Professions, Zurich University of Applied Sciences, Technikumstr. 71, P.O. Box, CH-8401, Winterthur, Switzerland

    Thomas Volken

Authors
  1. Thomas Volken
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Thomas Volken.

Additional information

Competing interests

The author declares that he has no competing interests.

Authors’ contributions

TV contributed all of the writing and the analysis.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Volken, T. Second-stage non-response in the Swiss health survey: determinants and bias in outcomes. BMC Public Health 13, 167 (2013). https://doi.org/10.1186/1471-2458-13-167

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2458-13-167

Keywords

  • Influenza Vaccination
  • Religious Denomination
  • Swiss Health Survey
  • Unskilled Manual Worker
  • Swiss National

BMC Public Health

ISSN: 1471-2458

Contact us