Skip to main content

Table 5 Validation results

From: Exploring predictors of welfare dependency 1, 3, and 5 years after mental health-related absence in danish municipalities between 2010 and 2012 using flexible machine learning modelling

Follow-up

1 year

3 years

5 years

Model

MLR

PMLRim

XGB

XGBim

MLR

PMLRim

XGB

XGBim

MLR

PMLRim

XGB

XGBim

AUC-ROC

 Apparent

0.71

0.71

0.73

0.72

0.70

0.70

0.72

0.72

0.71

0.70

0.72

0.72

 tenfold-cv

0.71

0.71

0.71

0.71

0.69

0.70

0.70

0.69

0.70

0.70

0.70

0.70

 Test set

0.71

0.70

0.71

0.71

0.70

0.70

0.71

0.71

0.70

0.70

0.71

0.70

Brier-scaled

 Apparent

0.13

0.13

0.15

0.15

0.10

0.10

0.12

0.12

0.10

0.08

0.10

0.12

 tenfold-cv

0.11

0.11

0.13

0.13

0.09

0.09

0.10

0.10

0.10

0.10

0.10

0.10

 Test set

0.12

0.12

0.14

0.14

0.12

0.12

0.13

0.12

0.12

0.12

0.10

0.12

  1. MLR Multinomial logistic regression, PMLR im Penalized multinomial logistic regression (ridge penalty) with single imputation, XGB XGBoost, XGB im XGBoost with single imputation