Skip to main content

Inverse probability weighting and doubly robust methods in correcting the effects of non-response in the reimbursed medication and self-reported turnout estimates in the ATH survey



To assess the nonresponse rates in a questionnaire survey with respect to administrative register data, and to correct the bias statistically.


The Finnish Regional Health and Well-being Study (ATH) in 2010 was based on a national sample and several regional samples. Missing data analysis was based on socio-demographic register data covering the whole sample. Inverse probability weighting (IPW) and doubly robust (DR) methods were estimated using the logistic regression model, which was selected using the Bayesian information criteria. The crude, weighted and true self-reported turnout in the 2008 municipal election and prevalences of entitlements to specially reimbursed medication, and the crude and weighted body mass index (BMI) means were compared.


The IPW method appeared to remove a relatively large proportion of the bias compared to the crude prevalence estimates of the turnout and the entitlements to specially reimbursed medication. Several demographic factors were shown to be associated with missing data, but few interactions were found.


Our results suggest that the IPW method can improve the accuracy of results of a population survey, and the model selection provides insight into the structure of missing data. However, health-related missing data mechanisms are beyond the scope of statistical methods, which mainly rely on socio-demographic information to correct the results.

Peer Review reports


It has been widely acknowledged that non-response in population surveys is an increasing problem [14]. The mechanisms of non-response are often related to socio-demographic factors (e.g. gender, age, education, marital status), which can be found in administrative records. In these cases, where the dropout probability depends on observed factors such as those obtained from administrative records, the mechanism can be considered missing-at-random (MAR), and any resulting bias can be corrected. For example, the non-response rate has been high in the groups of young single men with low education [5]. It is unclear if the participants in this group (or other groups) can fully represent the non-respondents. The mechanisms are often related to health, as has been demonstrated in studies on mortality [6] and hospital admission rates [7]. Lifestyle factors also have an impact on dropout rates, as demonstrated in longitudinal population studies where, for example, smokers have been shown to be more prone to drop out from the follow-up [8]. In these cases, however, the mechanism depends (at least partly) on unobserved factors and is called not-missing-at-random (NMAR). The results based on the observed data may be biased [911]. This type of bias is virtually impossible to correct without some external information on the NMAR mechanism, although research has been conducted comparing respondents of a baseline survey with non-respondents who were later interviewed by telephone [12]. Earlier studies have analyzed non-participation mechanisms [1315], but there seem to be few recent papers that seek to adjust for the effects of non-response using register data on health outcomes for the full sample.

In Finland, we have an excellent opportunity to link the survey data with administrative registers individually, which allows us to obtain the full-sample estimates and to use these as the true results. A comparison of methods for handling the effects of missing data is on a solid ground if the outcome variable can be observed both for the participants and nonparticipants as in our case. The most important registers used in the present study are maintained by the Population Register Centre (VRK), Statistics Finland (TK) and the Social Insurance Institution (Kela). The study sample was drawn by VRK, which also provided the basic demographic information as well as tabulations on the population sizes. TK provided information on occupation and level of education. Kela provided information on reimbursement of medicine costs contained in the Prescription Register. These registers cover the entire Finnish population, and they are considered to have good accuracy, reliability and validity [1618].

In this paper, we demonstrate the effects of non-response and statistical methods based on inverse probability weighting (IPW) and doubly robust (DR) methods to correct the effects of non-response. The weights were estimated using socio-demographic register-based variables. The weighted prevalence estimates of the reimbursement of medicine costs and turnout for the municipal election were compared with the corresponding and actual reimbursement and turnout prevalences in the sample based on the register data.



The Regional Health and Well-being Study (ATH) (n = 31,000) was conducted in three areas in Finland in 2010: Turku, the Oulu region and the Kainuu region. An additional nationally representative sample was also collected.

In Finland, local authorities have a statutory obligation to monitor the health and well-being of population groups. National registries provide municipal-level information on the population’s demographic characteristics and diseases treated by the public health care system. However, there is no municipal-level information on self-assessed health and well-being or the need for health and social services. The ATH survey aims to provide local information on the latter phenomena.

ATH 2010 was a questionnaire survey aimed at the population aged 20 years or over. The respondents could either return the questionnaire by mail or reply to the questions online. Three versions of the questionnaire were prepared (for the age groups 20–54, 55–74 and 75+) in four languages – Finnish, Swedish, Russian and English. Information on the respondent’s principal language was obtained from VRK, and this information was used in selecting the language of the questionnaire that was mailed to the respondent. The ATH survey was approved by the Ethics Committee of National Institute for Health and Welfare (THL). Participation was voluntary, and subjects were informed of register linkages. Participants were thus considered to have given their informed consent to the linking of health and well-being registers.

Sampling design

The stratified random sampling design was applied in order to provide enough statistical power to estimate the differences between the small areas accurately. The 15 strata (and corresponding sample sizes) were defined by geographical areas as described here. The City of Turku was divided into nine areas (sample size 1,000 per area) and the province of Kainuu into three areas (3,000 per area). Two sub-regions of the province of Northern Ostrobothnia (3,000 in the southern Oulu region and 5,000 in the Oulu region) were also included. In addition, one nationally representative random sample (5,000) was drawn from the entire population of Finland. Furthermore, each geographical stratum was subdivided by gender and the age groups 20 to 74 and 75 to 99. The sampling fractions ranged between 0.1% (younger age groups in the whole of Finland) and 48.6% (older women in the Upper Kainuu region). The population sizes were rather small in most of the strata, and thus the sampling was without replacement (WOR).

Variables used in the analyses

Age, gender, marital status dichotomized as married or unmarried, and first language were derived from VRK register data. The level of education was derived from TK register data and categorized as primary or unknown, secondary and tertiary level education.

The entitlements to reimbursement of medicine costs during 2010 were coded as binary variables and obtained from the Prescription Register of Kela, which has been shown to have good accuracy and coverage in the context of Finnish registries [1921].

The turnout percentage for the 2008 municipal election in various areas of Finland was obtained from the official website. All citizens of Finland, the EU and the Nordic countries aged 18 years or above and resident in Finland were eligible to vote in their home municipality. At the time of the ATH study, these subjects were 20 years old or more, which matches the age range of the ATH study. The self-reported turnout in the ATH study was based on the question “Did you vote in the previous municipal election?”

The body mass index (BMI) was calculated by dividing the self-reported weight (kg) by the squared self-reported height (m).

Statistical methods

There were three sources of missing data. Firstly, only part of the finite population was selected in the sample (missing by design). The sampling fraction was relatively high (up to 48.6%) in some strata, and thus finite population correction (FPC) was incorporated in the analyses. Secondly, not all individuals in the sample participated (unit-nonresponse). Thirdly, some participants did not respond to individual questions (item-nonresponse).

The effects of missing data were accounted for using inverse probability weighting (IPW) [10, 22]. The unit non-response probabilities were estimated using a logistic regression model. The register-based variables age, gender, marital status, language, education, occupation and geographical area were used as independent variables and the response indicator as the outcome variable. The model selection was conducted using the Bayesian information criterion [23], which is suitable for comparing several (different) models applied to the same data set and accounts for possibly large sample sizes and avoids overly complicated models [24]. The family of compared models contained the main effect models and the models with main effects and one or two first-order interactions. Also, propensity score methods [25] with weights calibrated by the generalized boosted model [26] (GBM) were applied to assess the potential benefits of having a more saturated weighting model. So-called doubly robust methods [27] are often based on an analysis model and a weighting model, in which a (linear) model is used for the outcome variable and a (logistic) regression model for the participation indicator, respectively. It has been demonstrated that, in order to obtain unbiased results, it is sufficient if one of the aforementioned models is correct. This methodology has also been applied when adjusting for missing data by Wirth et al. [28], and we have directly applied their method and program code written in SAS (which we converted into R) in this work. We have used all first-order interactions of the covariates except language, which was entered into the model as a main effect, for both the outcome and weighting models. As there were only 501 non-respondents for the BMI questions (1.6% of the sample or 3% of the participants) and 430 for the self-reported turnout questions, we decided not to elaborate the IPW in order to account for the item-nonresponse. The different sampling fractions were accounted for by calibrating the weights so that the sum of the expansion weights was proportional to the population size in each stratum.

We report the 95% confidence intervals (CI) of the statistics.

The R software [29] and the survey package [30] were used in the analyses. The GBM was implemented in the twang package [31].


The sampling percentages varied considerably across geographical strata (Table 1). In continental Finland, only 0.1% in the age group 20 to 74 and 0.2% in the age group 75 to 99 were sampled. In the regional strata, the sampling percentages were much higher, the highest being in Upper Kainuu (20% and 48.6%, respectively) and the Maaria-Paattinen region of the city of Turku (21% and 43.5%, respectively).

Table 1 Population and sample sizes in the strata defined by area, gender and age group

The unadjusted distributions of participation rates showed considerable variation with respect to both gender and several socio-demographic variables obtained from administrative registers (Table 2). The lowest participation rates were in the group comprising the youngest men. The participation rates increased with age, and in the oldest age groups the rates for men were at the same level as for women, among whom the rates varied much less. The participation rates in the stratum of continental Finland were 51.6% for women and 39.7% for men.

Table 2 Sample sizes and participation rates in subgroups of the sample

The interactions of gender and age and of gender and marital status in addition to the main effects of age (categorical), gender, area, marital status, language and education were important predictors of non-response according to the model selection procedure based on the family of different main effect and first-order interaction logistic regression models and the BIC statistic (Table 3). Occupation appeared to have no significance when education was included in the model (data not shown). The root mean squared errors (RMSE) of the predicted probability of response with respect to the observed response were 0.476 and 0.472 for the IPW and GBM, respectively.

Table 3 The best models selected using the Bayesian information criteria (BIC)

The adjusted participation rate was lowest in the group of the youngest men (OR = 0.62) compared to the age group 45 to 54 (Table 4). The participation rates increased with age. In the age group 75 to 84, the OR was 3.02. In the age group 45 to 54, women had a higher participation rate (OR = 1.90), but in the oldest age groups this difference decreased (interaction OR = 0.60 for men and 0.64 for women in the age group 75 or older). In comparison to Continental Finland, in the province of Kainuu the participation rates were higher, while they were at the same level in the province of Ostrobothnia and the city of Turku. In the city of Turku, the lowest participation rates were in the wealthiest area (Hirvensalo-Kakskerta, OR = 0.75) and the least wealthy area (Pansio-Jyrkkälä, OR = 0.87). Married men had a higher participation rate than unmarried men (OR = 1.53). Subjects speaking Finnish as their principal language had a slightly higher participation rate than the rest of the sample (OR = 1.19). In the groups with higher education, the participation rates were higher than in the groups with basic or unknown (OR = 0.37) or vocational (OR = 0.59) education.

Table 4 The odds ratio estimates of the response model with 95% confidence intervals

The true turnout percentages of the 2008 municipal election were much lower than the estimates based on the self-reported turnout (Table 5). In continental Finland, the true percentage was 61.3%, and after adding the self-reporting bias the percentage, which was based on [32] and comparable to our estimates, was 70.7% whereas the crude, uncorrected estimate was 78.2% (CI 76.5-80.0). The weighting improved the estimate, but in comparison to the true turnout this corrected estimate was still slightly higher, 72.9%; however, the confidence interval (CI 70.6-75.1) contains the bias-added turnout estimate. The corresponding differences were significant in the Turku and Kainuu areas but not in Ostrobothnia.

Table 5 The turnout percentages of the 2008 municipal election in different areas of Finland

There were some differences between the crude and weighted estimates of BMI in different areas in the subpopulation of people aged 20 to 59 with basic or unknown education (Table 6). In Turku, the weighted estimates were 0.66 BMI points lower than the crude averages. The crude prevalence of obesity (BMI value at least 30) was 26%, but the weighted prevalence was 19% in Turku. In other areas, the differences appeared to be much smaller.

Table 6 Subset of individuals aged 20 to 59 years with basic or unknown education in different areas of Finland

The FPC had some influence on results where the sampling fraction was large. In Kainuu, the standard error of BMI mean was 0.263 without FPC and 0.235 with FPC in the age group 75 to 99. In the Upper Kainuu region, the corresponding figures were 0.219 and 0.157. In other areas or age groups, FPC had virtually no influence on the results.

The IP weights appeared to remove most of the bias caused by nonresponse in the various subpopulations (Table 7). The true prevalence of entitlement to specially reimbursed medication for any chronic disease was 29.6% for men and 32.2% for women, whereas the sampling weighted (SW) estimates were 38.3% and 34.1%, respectively. The largest differences were related to men. Antipsychotic medication prevalences were underestimated by 1 percentage point in the Oulu region, whereas in the other regions the differences were much smaller; the prevalence estimates of other neurological medication were close to the true values in all areas. The performance of the doubly robust (DR) method for any chronic disease was close to that of the IPW method. The RMSE of the sampling weighted, IPW and DR were 4.36, 1.19 and 1.75, respectively. Thus, the SW estimates were much more biased than the IPW and DR estimates. However, in the disease-specific prevalences the three methods performed almost the same, and the RMSE ranged between 0.32 (other neurological disease estimates based on IPW) and 0.88 (diabetes estimates based on SW).

Table 7 Prevalence of entitlement to specially reimbursed medication for any disease and for selected chronic diseases


We applied the IPW method to handle both the differential sampling probabilities and missing data. Age and gender were the most important factors associated with non-response. Other register-based variables – marital status, education, area and language – were also important. The model selection procedure based on the BIC was well suited to selecting an optimal and parsimonious logistic regression model to predict the non-response. The class of candidate models did not, however, cover all possible interactions or nonlinearities. Better models could thus yet be found. However, such models might be more difficult to interpret and the effects of the predictors more difficult to understand. The BIC also avoids the problems of stepwise regression procedures and the Akaike’s information criterion; see e.g. [24]. The GBM did not markedly improve the predicted probability of response when compared with the logistic regression model selected using the BIC.

The weighting appeared to improve the accuracy of the estimates, as we demonstrated with the turnout percentages. Granberg and Holmberg [32] compared the true and self-reported turnout at the individual level. They found that 99% of the voters said that they voted but only 74% of the non-voters said that they did not vote; thus, the sensitivity was very good but specificity was not good. Assuming that this result was also true for the 2008 Finnish election, the true self-reported turnout percentage without missing data would have been 70.7%, which was within the CI of our weighted estimate. In the other study areas, the findings were similar except in Kainuu, where the turnout percentage was much lower than in continental Finland as a whole. It is plausible for non-response to be associated with low turnout in elections, in which case the turnout percentages were overestimated. This assumption is supported by Martikainen et al. [33], who found that in young age groups low education was associated with low turnout percentages, and in our study this group had the lowest participation rates. The percentage of over-reporting in our study (16.9%) based on the crude self-reported turnout was slightly lower than in the local elections in Sweden (22%) between 1988 and 1998 [34], and thus we consider that our correction [32] was based on a sensible choice. We considered the percentage of non-citizens who were eligible to vote in municipal elections but who were not included in the ATH sampling frame to be so low that it created only little bias.

The IPW and DR methods appeared to correct most of the bias in the prevalence estimates of entitlement to specially reimbursed medication for any chronic disease. However, the disease-specific estimates were almost as good when using the sampling weights indicating that the non-response was particularly selective in other diseases than diabetes, psychosis and other neurological diseases.

The inverse probability-weighted BMI estimates differed from the crude estimates in the subpopulation of people aged 20 to 59 with basic or unknown education in Turku, but the differences were smaller in other education groups and areas (data not shown). This result indicates that those people who had larger values of the weight variable had smaller BMI values. According to the results of the missing data analysis, the young, unmarried and non-Finnish-speaking men in the lowest education class had the lowest response rate and therefore also the largest weight variable values. FPC had influence on the variance estimates only in older age groups and those geographical areas where the sampling fraction was high.

There are also other methods for handling the effects of missing data. Multiple imputation [35] is the most suitable method in cases where item response rates vary considerably and the proportion of complete cases is much lower than the item response rates. This was not the case in the ATH study, and thus the weighting-based methods perform well. An alternative approach to IPW is poststratification [13], which is based on a saturated response model. In this method, the response rates are estimated separately in poststrata defined by some register-based variables, and the inverses of these response rates are then used as weights in analyses. The number of poststrata increases exponentially with the increase in the number of variables or their categories, and thus the number of sampling units per cell decreases fast. The method based on poststratification weights is thus the most suitable for a small number of poststrata. We also assessed different interactions in the weighting model using the BIC, but few interactions were found; thus poststratification would provide little improvement over the IPW method that we have applied.

It has been shown that a weighting model should contain good predictors of the outcome rather than the missingness, e.g. [3638]. Seaman and White [37] noted that in case of many different outcome variables, inclusion of variables, which predict the outcomes well, is not possible. Our aim in the ATH study has been to provide researchers general-purpose tools (based on the IPW as weights are easy to use also for non-statisticians) to handle missing data. As the ATH study contains hundreds of variables aimed to cover a large variety of lifestyle and risk factors as well as health and other outcomes, we cannot provide optimized weights for all research questions, thus we concentrated on variables with predictive power on the missingness. Furthermore, it can be noted that methods, which have been developed to estimate the effect of a treatment in observational studies, might not be directly applicable, because in those models there is usually an arrow from treatment to outcome in the causal graph. In case of handling the effects of nonresponse, however, there is seldom an arrow from missingness to outcome. An exception could be an intervention study in which e.g. the participants are subject to the intervention but the nonparticipants are not. In population surveys such as in our case, there is practically no intervention effect. In conclusion, we considered that it is safer to apply the variable selection methods for handling missing data suggested in e.g. [37].

Further analyses should be done using register values with information concerning the health status of the respondents and non-respondents, hospital discharge, drug reimbursement, etc. This would be important for measuring the drop-out bias and selection due to possible health-related issues. Although register-based data cover the full population, there are also shortcomings in the information content. For example, important lifestyle factors such as smoking, alcohol use, nutrition and physical exercise and also cohabitation cannot be obtained from registers. The variables of the questionnaires do not necessarily match the information contents of the registers. Furthermore, there is also a considerable time lag in the availability of data from certain registers such as the drug reimbursement register.

In the present study, we demonstrated how to implement IPW using model selection and socio-demographic register data to analyze non-response mechanisms and how this method improved the accuracy of both entitlement to specially reimbursed medication and self-reported turnout prevalences considerably, even though the non-response rate was as high as in the ATH survey. Furthermore, our analyses provided insight into the structure of missing data. Several demographic factors were shown to be associated with missing data, but few interactions among them were found.


Missing data analyses showed associations between non-response and several demographic factors, but few interactions improved the predictive power over the main effects model.

Accuracy of the self-reported turnout and reimbursed medication estimates improved considerably using the methods based on weighting suggesting that the weighting methods can improve the estimates of both social activity and especially health outcomes.

Register data linked with survey data can provide more accurate results than survey data alone, and the administrative registers in Finland have been shown to have good potential in improving the quality of survey analyses.


  1. 1.

    Steeh C, Kirgis N, Cannon B, DeWitt J: Are they really as bad as they seem? Nonresponse rates at the end of the twentieth century. J Official Stat Stockholm. 2001, 17 (2): 227-248.

    Google Scholar 

  2. 2.

    Tolonen H, Helakorpi S, Talala K, Helasoja V, Martelin T, Prättälä R: 25-year trends and socio-demographic differences in response rates: Finnish adult health behaviour survey. Eur J Epidemiol. 2006, 21 (6): 409-415.

    Article  PubMed  Google Scholar 

  3. 3.

    De Heer W: International response trends: results of an international survey. J Official Stat Stockholm. 1999, 15: 129-142.

    Google Scholar 

  4. 4.

    Galea S, Tracy M: Participation rates in epidemiologic studies. Ann Epidemiol. 2007, 17 (9): 643-653.

    Article  PubMed  Google Scholar 

  5. 5.

    Pietilä AM, Rantakallio P, Läärä E: Background factors predicting non-response in a health survey of northern Finnish young men. Scand J Soc Med. 1995, 23 (2): 129-136.

    PubMed  Google Scholar 

  6. 6.

    Jousilahti P, Salomaa V, Kuulasmaa K, Niemela M, Vartiainen E: Total and cause specific mortality among participants and non-participants of population based health surveys: a comprehensive follow up of 54 372 Finnish men and women. J Epidemiol Community Health. 2005, 59 (4): 310-315.

    Article  PubMed  PubMed Central  Google Scholar 

  7. 7.

    Kjoller M, Thoning H: Characteristics of non-response in the Danish Health Interview Surveys, 1987–1994. Eur J Public Health. 2005, 15 (5): 528-535.

    Article  PubMed  Google Scholar 

  8. 8.

    Eagan TM, Eide GE, Gulsvik A, Bakke PS: Nonresponse in a community cohort study: predictors and consequences for exposure-disease associations. J Clin Epidemiol. 2002, 55 (8): 775-781.

    Article  PubMed  Google Scholar 

  9. 9.

    Rubin D: Inference and missing data. Biometrika. 1976, 63 (3): 581-592.

    Article  Google Scholar 

  10. 10.

    Molenberghs G, Kenward MG: Missing Data in Clinical Studies. 2007, Chichester: John Wiley & Sons Ltd

    Google Scholar 

  11. 11.

    Tolonen H: Towards the High Quality of Population Health Surveys. 2005, KTL: Standardization and quality control. PhD

    Google Scholar 

  12. 12.

    Linden-Bostrom M, Persson C: A selective follow-up study on a public health survey. Eur J Public Health. 2013, 23 (1): 152-157.

    Article  PubMed  Google Scholar 

  13. 13.

    Lehtonen R, Pahkinen E: Practical methods for design and analysis of complex surveys: 2nd ed. 2004, Chichester: Wiley

    Google Scholar 

  14. 14.

    Laaksonen M, Aittomaki A, Lallukka T, Rahkonen O, Saastamoinen P, Silventoinen K, Lahelma E: Register-based study among employees showed small nonparticipation bias in health surveys and check-ups. J Clin Epidemiol. 2008, 61 (9): 900-906.

    Article  PubMed  Google Scholar 

  15. 15.

    Pérez-Duarte S, Sánchez Muñoz C, Törmälehto V-M: Re-weighting to reduce unit nonresponse bias in household wealth surveys: a cross-country comparative perspective illustrated by a case study. Paper prepared for the Conference on European Quality in Statistics, Helsinki, May 4-6 2010. []

  16. 16.

    Statistics Finland, Official Statistics of Finland (OSF): Population structure. Quality description: Population structure 2011. []

  17. 17.

    Finland S: Use of Registers and Administrative Data Sources for Statistical Purposes: Best Practises of Statistics Finland: Helsinki: Statistics Finland. 2004

    Google Scholar 

  18. 18.

    Anonymous: Proceedings of the IAOS Conference on Reshaping Official Statistics. 2008, Bejing: National Bureau of Statistics of China

    Google Scholar 

  19. 19.

    Tolppanen A, Taipale H, Koponen M, Lavikainen P, Tanskanen A, Tiihonen J, Hartikainen S: Use of existing data sources in clinical epidemiology: Finnish health care registers in Alzheimer’s disease research–the Medication use among persons with Alzheimer’s disease (MEDALZ-2005) study. Clin Epidemiol. 2013, 5: 277-

    Article  PubMed  PubMed Central  Google Scholar 

  20. 20.

    Haukka J, Suvisaari J, Tuulio-Henriksson A, Lönnqvist J: High concordance between self-reported medication and official prescription database information. Eur J Clin Pharmacol. 2007, 63 (11): 1069-1074.

    Article  PubMed  Google Scholar 

  21. 21.

    Rikala M, Hartikainen S, Sulkava R, Korhonen MJ: Validity of the Finnish prescription register for measuring psychotropic drug exposures among elderly Finns. Drugs Aging. 2010, 27 (4): 337-349.

    Article  PubMed  Google Scholar 

  22. 22.

    Iachina M: The evaluation of the performance of IPWGEE, a simulation study. Commun Stat - Simul Comput. 2009, 38 (6): 1212-1227.

    Article  Google Scholar 

  23. 23.

    Schwarz GE: Estimating the dimension of a model. Ann Stat. 1978, 6 (2): 461-464.

    Article  Google Scholar 

  24. 24.

    Kadane JB, Lazar NA: Methods and criteria for model selection. J Am Stat Assoc. 2004, 99 (465): 279-290.

    Article  Google Scholar 

  25. 25.

    Rosenbaum PR: Model-based direct adjustment. J Am Stat Assoc. 1987, 82 (398): 387-394.

    Article  Google Scholar 

  26. 26.

    McCaffrey DF, Ridgeway G, Morral AR: Propensity score estimation with boosted regression for evaluating causal effects in observational studies. Psychol Methods. 2004, 9 (4): 403-425.

    Article  PubMed  Google Scholar 

  27. 27.

    Bang H, Robins JM: Doubly robust estimation in missing data and causal inference models. Biometrics. 2005, 61 (4): 962-972.

    Article  PubMed  Google Scholar 

  28. 28.

    Wirth KE, Tchetgen EJT, Murray M: Adjustment for missing data in complex surveys using doubly robust estimation: application to commercial sexual contact among Indian men. Epidemiology. 2010, 21 (6): 863-871.

    Article  PubMed  PubMed Central  Google Scholar 

  29. 29.

    R Core Team: R: A Language and Environment for Statistical Computing. 2011, Vienna, Austria: R Foundation for Statistical Computing, []

    Google Scholar 

  30. 30.

    Lumley T: Analysis of complex survey samples. J Stat Softw. 2004, 9 (1): 1--19-19

    Google Scholar 

  31. 31.

    Ridgeway G, McCaffrey D, Morral A, Griffin BA, Burgette L: twang: Toolkit for Weighting and Analysis of Nonequivalent Groups. R package version 1.4-0. []

  32. 32.

    Granberg D, Holmberg S: Self-reported turnout and voter validation. Am J Pol Sci. 1991, 35 (2): 448-459.

    Article  Google Scholar 

  33. 33.

    Martikainen P, Martikainen T, Wass H: The effect of socioeconomic factors on voter turnout in Finland: a register-based study of 2.9 million voters. Eur J Polit Res. 2005, 44 (5): 645-669.

    Article  Google Scholar 

  34. 34.

    Karp JA, Brockington D: Social desirability and response validity: a comparative analysis of overreporting voter turnout in five countries. J Polit. 2005, 67 (3): 825-840.

    Article  Google Scholar 

  35. 35.

    Rubin DB: Multiple Imputation for Nonresponse in Surveys. 1987, New York: John Wiley

    Google Scholar 

  36. 36.

    Austin PC: The performance of different propensity-score methods for estimating relative risks. J Clin Epidemiol. 2008, 61 (6): 537-545.

    Article  PubMed  Google Scholar 

  37. 37.

    Seaman SR, White IR: Review of inverse probability weighting for dealing with missing data. Stat Methods Med Res. 2011, 22 (3): 278-295.

    Article  PubMed  Google Scholar 

  38. 38.

    Brookhart MA, Schneeweiss S, Rothman KJ, Glynn RJ, Avorn J, Sturmer T: Variable selection for propensity score models. Am J Epidemiol. 2006, 163 (12): 1149-1156.

    Article  PubMed  PubMed Central  Google Scholar 

Pre-publication history

  1. The pre-publication history for this paper can be accessed here:

Download references


This work was supported by the Academy of Finland [grant number 266251].

Author information



Corresponding author

Correspondence to Tommi Härkänen.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

TH, RK, EV and SK made substantial contributions to conception and design, or acquisition of data, or analysis and interpretation of data. TH, RK and SK have been involved in drafting the manuscript or revising it critically for important intellectual content. TH, RK, EV and SK have given final approval of the version to be published. TH, RK, and SK agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Härkänen, T., Kaikkonen, R., Virtala, E. et al. Inverse probability weighting and doubly robust methods in correcting the effects of non-response in the reimbursed medication and self-reported turnout estimates in the ATH survey. BMC Public Health 14, 1150 (2014).

Download citation


  • Missing data
  • Population survey
  • Register data
  • Model selection
  • Inverse probability weighting
  • Doubly robust methods