Skip to main content

Comparing temporal changes and predictors of different types of mental health and socio-emotional wellbeing outcomes during COVID-19: an overlapping panel study of Spanish residents

Abstract

Objectives

Few panel studies have investigated how different types of mental health (MH) and socio-emotional wellbeing (SEW) outcomes have changed during the pandemic and if their burden has been equally distributed at the population-level. We aimed to examine temporal changes in these outcomes and their socio-ecological predictors using panel data.

Study design

Longitudinal population-based survey with overlapping panels.

Methods

Analyses were carried out using four measurements of data from the Health and Social Survey (April 2020 to April 2021). Participants included Andalusian (Spanish) residents aged 16 years or older who participated in all four measurements (n = 1223). Seven dichotomous MH and SEW outcomes, as well as several socio-ecological predictors informed by a conceptual model, were examined in descriptive and multivariate analyses.

Results

Unadjusted odds of regular/bad perceived mental health (vs. excellent/very good/good), low socio-emotional wellbeing (vs. regular), low happiness (vs. regular), and feeling anxious (vs. not feeling anxious) decreased significantly from the first to the second measurement; however, in the fourth, low socio-emotional wellbeing significantly increased while low optimism decreased. Considering varying coefficients, objectively measured COVID-19 status and self-reported severity levels of the infection were statistically significant. Health status, social support, and household financial difficulty predicted higher adjusted odds in most of the seven assessed outcomes.

Conclusions

Significant temporal variations in MH and SEW outcomes, along with their predictors, were observed during the first year of the pandemic. Some of these outcomes worsened as the pandemic progressed, whereas others improved. Findings also suggest that some individuals such as those experiencing poor health, limited social support, and low socioeconomic status are disproportionately impacted.

Peer Review reports

Introduction

The advent of the novel coronavirus (COVID-19) pandemic has created indisputable urgency to investigate the impact of this unprecedented global crisis on mental health outcomes, [1] as well as to strengthen existing infrastructures and strategies to better promote mental health and wellbeing across socioeconomically and demographically diverse populations [2]. Even before the emergence of this global public health crisis, there were growing demands for governments and decision-makers around the world to prioritize and address the increasing burden of poor mental and socio-emotional wellbeing [3]. The pandemic has undoubtedly further highlighted the global mental health crisis that has been unfolding in recent decades.

Nevertheless, in the new era of COVID-19, opportunities remain to better understand the trajectory of mental health (MH) and socio-emotional wellbeing (SEW) and their underlying social determinants. This is particularly salient when looking into the rapid influx of published research characterized by methodological shortcomings such as data reliant on cross-sectional designs or studies that employed small or selective sampling approaches [4]. For example, a recent systematic review and meta-analysis of 134 cohorts suggests that the pandemic did not significantly exacerbate poor mental health and related disparities, although this review mainly included studies with cross-sectional designs and non-probabilistic samples that are subject to significant bias [5]. In general, there has been increased need for carrying out better-designed studies [4, 6].

Under this purview, studies that leverage panel datasets that consist of multiple observations over time for the same group of individuals may bolster evidence on the impact of COVID-19 on the MH/SEW outcomes of diverse populations. The advantages of this design are well-documented (e.g., enhanced causal inference, better control of unobservable factors, precision in predicting individual outcomes, etc.) [7]. Within the context of COVID-19, panel studies also offer a more robust understanding of the pandemic beyond its characteristics at a specific timepoint given its design allows researchers to better investigate changes in study variables within the same population; the rotating design (where units are replaced/renewed over time) also reduces panelists’ response fatigue and augments researchers’ ability to quickly collect information in real-time (i.e., overcoming limitations of many cross-sectional and longitudinal studies) [8].

Yet, studies employing large-scale panel designs representative of general populations, those seeking to investigate the trajectory of and potential disparities in MH and SEW outcomes throughout the pandemic, are scarce. Panel studies on this topic have primarily focused on examining changes in these outcomes within the early weeks or months of the pandemic [9,10,11,12] and oftentimes have only captured two measurement periods [13,14,15,16,17]. Additionally, most panel studies published in empirical literature have examined temporal changes in clinically diagnosable mental illnesses rather than more general measures of MH or SEW [11, 12, 14, 16, 18, 19]. It also appears that no large-scale panel study representative of general populations has compared trends in different types of MH and SEW outcomes, including in Spain [6]. Furthermore, there is an absence of studies that have concurrently examined various socio-ecological factors that predict them, at key phases of the COVID-19 pandemic when COVID-19 cases, hospitalizations, and policy measures were most pronounced and quick to evolve. Filling these gaps may illuminate opportunities to better address pandemic-related health inequities. Thus, the present study aimed to advance this area of research by examining temporal changes in several types of MH and SEW outcomes between April 2020 to April 2021. This twelve-month period is noteworthy to study as it captures the first (and most challenging) year of the pandemic following the first state of alarm— i.e., key phases of the COVID-19 pandemic in Spain and around the world. A secondary aim was to identify the socio-ecological factors that predict these outcomes during each of these critical timepoints.

Methods

Study design

Data were drawn from the Health and Social Survey (ESSA, Encuesta Sanitaria y Social de Andalucía). ESSA is a longitudinal population-based survey with overlapping panels that collected information on the characteristics and the evolution of health and social status during the COVID-19 pandemic among Andalusian residents aged 16 years and older at April-May 2020 (measurement period 1, M1), June-July 2020 (M2), October-November 2020 (M3), and April-May 2021 (M4). These represent four pivotal phases in the first year of the COVID-19 pandemic in the region (Appendix p 1). Andalusia is the most populated (with over 8 million residents) and the second largest of the 17 regions of Spain. As such, this region may be characterized by significant diversity and potential health disparities in MH and SEW status. A corresponding questionnaire was administered to study participants through a computer-assisted telephone interview conducted using the Pl@teA and MobiNet Gandia Integra software, which was piloted before fieldwork. The survey included questions on household and housing characteristics, time use and cohabitation, health and emotional wellbeing, habits and lifestyles, and economic situation and socio-demographic characteristics. A team of 8–12 trained interviewers solely assigned to the study were responsible for data collection. On average, the survey took participants ~ 20 min to complete. The Research Ethics Committee of the Department of Health and Families of the Andalusian Regional Government approved this study (protocol code 10/20). Additional detailed information on ESSA survey administration and study design have been published elsewhere [8].

Using overlapping panel survey data augments our ability to gain a more nuanced understanding of the temporal changes in mental health outcomes and the underlying factors that shape them. In this paper, the study population comprises 1,223 ESSA panelists who participated in all four above mentioned survey measurements. Additional details regarding the ESSA sample selection are also available [20].

Outcomes

There were seven MH and SEW outcomes of interest: (1) self-reported (perceived) mental health; (2) socio-emotional wellbeing; (3) level of happiness; (4) level of optimism; (5) feeling alone; (6) feeling depressed; and (7) feeling anxious. Perceived mental health was assessed via a single-item measure of self-related mental health adapted from a question that is associated with multi-item measures of mental health and that has been widely used in research, [21] including in the Canadian Health Measures Survey [22]. Socio-emotional wellbeing was measured using the validated Socioemotional Well-being Index (SEWBI), a questionnaire capturing a composite indicator and global measure of subjective wellbeing that has been previously validated with data from the 2006 European Social Survey [23]. Individual questions from the validated SEWBI were also used to measure level of happiness, level of optimism, feeling alone, and feeling depressed. Feeling anxious was measured in part by an individual SEWBI question and by asking participants to indicate the extent to which they felt tightness in their chest pain in the past month. How these variables were operationalized is detailed in the Appendix (p 3).

Socio-ecological predictors

A conceptual model informed by the Social Ecological Model, [24] and existing literature on social determinants of mental health, [25] guided the selection of the predictors in the present study (Fig. 1). Intrapersonal predictors included objectively measured COVID-19 infection status based on official health data sources, self-reported severity of COVID-19 infection, socio-demographic characteristics, and health status. Interpersonal level predictors included social support, family/household member COVID-19 diagnosis status, and household financial characteristics, and household environment predictors. The latter included household situation type, current useful surface area of the home, current number of household members, percentage of household members over 60 years of age, and percentage of household members under 16 years of age. Furthermore, population environment predictors (at the census tract level) included average net income per person, Gini index (i.e., measure of inequality), percentage of population < 18 years of age between 2015 and 2020, percentage of population ≥ 65 years of age between 2015 and 2020, percentage of the foreign population between 2015 and 2020, and percentile of group density. The operationalization of these variables is also detailed in the Appendix (p 5).

Fig. 1
figure 1

Conceptual model of the socio-ecological predictors of mental health status during the COVID-19 pandemic. This model illustrates how different factors may shape mental/emotional health outcomes and how these predictors may vary across time during the COVID-19 pandemic. It is informed by existing literature on the social determinants of mental health [25] and the Social Ecologic Model, which highlights how health extends beyond biological factors and is influenced by a collection of subsystems that occur at various levels [24]. Predictors in the present model were selected based study data from the Andalusian Health and Social Survey (ESSA, Encuesta Sanitaria y Social de Andalucía)

Statistical analysis

Descriptive analyses were carried out on all outcome and predictor variables among participants in each of the four survey measurement periods (Table 1). We devised cross-sectional weighting scheme that includes a non-response adjustment based on propensities through eXtreme Gradient Boosting (XGBoost), optimal combination of the samples from the panels involved, and calibration for completing the representativeness of the population at a given measurement. XGBoost is a state-of-the-art machine learning method, [26] one that builds ensembles of decision trees which optimize an objective function via Gradient Tree Boosting [27]. Additional details regarding that ESSA reweighting are described in Castro et al [20]. Analyses were carried out to examine temporal changes in the seven MH and SEW outcomes and their socio-ecological predictors.

Table 1 Andalusian health and social survey (ESSA, Encuesta Sanitaria Y Social De Andalucía) respondent characteristics by four measurement periods, n = 1,223

On the other hand, we estimated the internal consistency of the Socioemotional Well-being Index (SEWBI), through Cronbach’s alpha for the individual questions that compose it (i.e., level of happiness, level of optimism, feeling alone, feeling anxious and feeling depressed). Specifically, we estimated Cronbach’s alpha equal to 0.760, i.e. a high level of reliability.

Unadjusted temporal changes in each of these seven outcomes are shown in Table 2. They were assessed by generalized linear mixed models (GLMM) with a variable response with link zero-inflated binomial (i.e., equivalent to logistic regression). This link allowed for the presence of heteroskedasticity in the response variable. We included several random effects in the models. First, we included random effects focused on unobserved confounding. These random effects sought to capture individual heterogeneity— i.e., unobserved confounders, specific to the subject and invariant between the survey waves, which may influence the probability that the subject declares the occurrence of the outcome. Second, we included random effects capturing the evolution of the probability over time and the fact that we had four measurements for each of the subjects. It should be noted that we allowed for this evolution to be non-linear. Furthermore, we also included random effects to control spatial dependency and to consider that subjects who reside nearby show more similar values of the outcome variables than subjects who reside far away. More details on these random effects can be found in the Appendix (p 10). We re-ran these models with all the predictor variables of interest simultaneously to assess predictors of the seven mental and emotional health outcomes (Table 3).

Table 2 Unadjusted fixed effect odds ratios and 95% credibility intervals for seven mental health and socio-emotional wellbeing outcomes at four measurement periods during the COVID-19 pandemic, April 2020 to April 2021 (n=1223)
Table 3 Predictors of seven mental health and socio-emotional wellbeing outcomes during the COVID-19 pandemic, April 2020 to April 2021 (n = 1223)

The impact of COVID-19 infection status, both objectively measured COVID-19 status based on hospital records and self-reported infection severity, may have varied over time based on the probability of occurrence of each of the outcomes. Thus, the adjusted (predictor) models shown in Table 3 included other structured random effects associated with each of the COVID-19 variables (Table 4). All data was managed using R (version 4.3.1) and STATA version 14.1 (StataCorp LP, College Station, Texas, USA). All analyses were carried out using the free software R (version 4.3.1), through the INLA package. All inferences made following a Bayesian perspective, using the INLA approach, are detailed elsewhere (Appendix p 10). In addition to the parameters of interest, we estimate their 95% and 90% credibility intervals. A credibility interval contains the true value of the parameter with a given probability (95% or 90%, in our case).

Table 4 Varying coefficients and 95% credibility interval for seven mental health and socio-emotional health outcomes by objectively measured COVID-19 diagnosis status and self-reported COVID-19 level of severity at four measurement periods during the COVID-19 pandemic, April 2020 to April 2021 (n = 1223)

Role of the funding sources

The funders of the present study played no role in the design, collection, analysis, or interpretation of the study data. They also did not participate in writing or the decision to submit the manuscript.

Results

Descriptive results

Only individuals who participated in all four measurement periods of the general ESSA population survey were included in the analyses. The response rate of M1 (n = 2950), M2 (n = 1978), M3 (n = 1491), and M4 (n = 1223) was 88.5%, 67.1%, 75.4%, and 82.0%, respectively. This corresponds to a retention rate of 58% in M2, 51% in M3, and 42% in M4. The most prevalent poor MH/SEW outcome among participants from M1 to M4 was feeling depressed. The most important results of the descriptive analyses are presented in Table 1. For example, the proportion of participants infected with COVID-19 incrementally increased from 5% in M1 to over 8% in M4, corresponding with trends in the prevalence of participants reporting their COVID-19 infection severity as ‘very severe/severe‘ (0.2% in M1, 0.2% in M2, 0.5% in M3, and 1.1% in M4). The same pattern was observed for the percentage of respondents reporting members of their family/household being diagnosed with COVID-19. The majority of participants were female (55.5%). Participants predominately perceived their physical health as ‘excellent/very good/good’ across the four measurement periods, although there was a descending pattern from M1(86.1%) to M4 (80.9%). Conversely, the percentage of participants that were objectively diagnosed with diabetes, dislipemia, obstructive pulmonary disease, and having four or more chronic conditions incrementally increased. Other characteristics of ESSA participants, as well as missing data, by measurement periods are presented in the Appendix (p 11).

Temporal changes in MH and SEW outcomes

There were significant differences in the unadjusted odds ratios (OR) and 95% credibility intervals (95% CI) for the seven mental/emotional health outcomes of interest by measurement period (Table 2). Participants had 21% higher odds of reported regular/bad perceived mental health in M1 compared to excellent/very good/good (OR 1.21 [95% CI 1.05–1.39]), but this declined by about 34% in M2, with participants reporting 20% lower odds of regular/bad perceived mental health (OR 0.80 [95% CI 0.69–0.92]). Odds of low socio-emotional wellbeing, low happiness, and currently feeling anxious also significantly declined from M1 to M2 by 56%, 66%, and 34%, respectively. However, only the odds of low socio-emotional wellbeing were higher in M4 (OR 1.69 [95% CI 1.44–1.98]) compared to M1. Conversely, the odds of low happiness, low optimism and feeling alone continued to decrease after M1.

Predictors of the MH and SEW outcomes

There were several socio-ecological factors that predicted poor MH and SEW status, although associations varied across the seven outcomes examined (Table 3). Overall, inconsistent associations were observed between the other intra-personal, inter-personal, household environment, and population environment factors and the outcomes of interest. However, a few exceptions should be highlighted. At the intra-personal level, regular/bad perceived general health status, and having one objectively diagnosed chronic condition were associated with higher odds for six of the seven MH and SEW outcomes examined (all except feeling depressed). Similarly, at the interpersonal level, perceiving intermediate levels of social support and financial household difficulty were associated with higher odds with five of the seven outcomes examined (all except for feeling anxious and feeling depressed). Furthermore, it should be noted that in regression models that varied over time (Table 4), objectively measured COVID-19 status and self-reported severity levels were significant predictors of the poor MH and SEW outcomes.

Discussion

The present study appears to be the first to leverage overlapping panel data to compare temporal changes in and socio-ecological predictors of different types of MH and SEW outcomes during the initial (and pivotal stages) of the COVID-19 pandemic. Its findings shed light on the state of MH and SEW in a large, urban population. Overall, descriptive analyses showed that there was a reduction in the prevalence of the seven poor MH and SEW outcomes from April 2020 (M1) to June 2020 (M2), with the magnitude of reduction being lowest for low optimism (10%) and highest for low happiness (65%). Yet, patterns in the prevalence change of these outcomes were mixed at M4 compared to M1. Namely, the prevalence of low socio-emotional wellbeing, feeling alone increased by 4%, and 18%, respectively. On the other hand, the prevalence of regular/bad mental health, low happiness, low optimism, feeling depressed, and currently feeling anxious was lower in M4 than M1. Similar patterns were observed in regression analyses. Odds of the population having regular/bad perceived mental health, low socio-emotional wellbeing, low happiness, and feeling anxious significantly declined in M2 compared to M1. Instead, odds of low socio-emotional wellbeing were significantly higher in M4 compared to M1, while odds of low happiness and low optimism were lower during this period. Socio-ecological predictors of the seven outcomes varied both by the type and survey measurement period, although some intra-personal factors (i.e., health status) and inter-personal factors (i.e., perceived level of social support, financial household difficulty) did appear to exacerbate poor MH and SEW among study participants.

What seems to be an initial improvement in MH and SEW around the first month of the COVID-19 pandemic is unsurprising given the timeline of key COVID-19 phases and events in Spain and Andalusia by ESSA survey measurement period (Appendix p 1). In early 2020, around the time when M1 was conducted, there was uncertainty about the nature of the COVID-19 virus and stringent policy measures to mitigate spread of the virus had been initiated. It is possible that this was the first time in recent memory that Andalusian residents had dealt with such a public health crisis. Thus, this initial shock may explain the high prevalence of poor mental and emotional health outcomes observed in the present study. However, around when M2 was conducted, COVID-19 policy measures began to ease in all of Spain. Perhaps the initial shock of this global public health emergency began to dissipate among Andalusian residents, consequently improving their MH and SEW. Another possible explanation is the number of COVID-19 cases and deaths in Andalusia (compared to Spain as a whole) during the first epidemic wave; in particular, around the time M2 was carried out, deaths were less pronounced in Andalusia than across Spain (Appendix p 16). It is possible that Andalusian residents may have perceived the COVID-19 pandemic to be less of a threat to their lives and livelihood compared to their Spanish counterparts. However, about halfway into the second epidemic period in Spain (i.e., around the time that M3 was conducted), cases in Andalusia began to rise and reflected patterns observed in the rest of Spain. This trend continued in M4, which may explain high levels of poor socio-emotional wellbeing among Andalusian study participants about a year after the start of the pandemic.

For the most part, these results are consistent with existing evidence on the trajectories of MH and SEW of general (and mostly adult) populations during the COVID-19 pandemic. For example, although not based on panel data, in line with our findings, previous studies have found general (non-clinical) aspects of MH worsened one year into the COVID-19 pandemic among Spanish populations [28, 29]. There is also evidence that there was an initial increase in anxiety and a gradual decline in the burden of depression at the nascent stage of the pandemic [30]. Large-scale panel studies have similarly documented initial surges in and/or high burden of poor MH/SEW at the start of the pandemic [9, 11,12,13, 15,16,17].

Findings regarding predictors of MH and SEW are also somewhat congruent with other study results. At the intra-personal level, for instance, we found evidence that self-reporting ones’ health as regular/bad and being diagnosed with a chronic condition are risk factors for poor MH and SEW. These findings align with research that has found self-rated health, [31] and chronic conditions, [16] put individuals at risk for poor MH. At the inter-personal level, we also found evidence that lower levels of social support increase individuals’ risk for poor MH and SEW, a finding which has been previously reported [29]. Furthermore, our finding that financial household difficulty puts individuals at risk is consistent with previous studies indicating that low income is associated with increased risk for poor MH [14] and SEW [10].

However, there were a few findings that did not fully align with previous large-scale panel studies representative of general (mostly adult) populations. For instance, one such study focused on U.S. adults found that the burden of depressive symptoms increased throughout the pandemic, [14] whereas we found no significant differences. Instead, our findings revealed a significant decline in socio-emotional wellbeing approximately one year into the pandemic. And in contrast to another panel study conducted in Italy, which reported a decline in general mental health from April to September 2020, [15] our study observed improvements in general mental health around a similar time frame, approximately at M1 and M2. Furthermore, other panel studies carried out in England have documented that being female/woman puts individuals at risk for loneliness [10] and depression [11]. In our study, despite examining various multilevel characteristics (including being female), none significantly predicted feeling depressed. However, it is important to note that previous research underscores that individuals’ psychological reactions to the pandemic appear to be predominantly influenced by the evolving pandemic context, country-specific variables, and individual traits and circumstances [32]. Thus, there may be possible heterogeneous effects of COVID-19 on mental health and socio-emotional wellbeing outcomes that were not fully captured in study analysis, those which have been previously observed in other studies [33]. Consequently, these factors may contribute to the discrepancies highlighted above.

The current study is also subject to a few limitations that should be acknowledged when interpreting results. First, it has been recommended that longitudinal analyses seeking to impact of COVID-19 on mental health include a pre-pandemic comparison, [4] which we were unable to do in the present analysis given the absence of data for the outcome measures. Second, panel attrition is often a major disadvantage of longitudinal studies. In the present study, the survey retention rate dropped to 42% in M4. However, our sample size is still large enough to maintain statistical power and Bayesian approaches were employed to provide more robust estimates and bolster the generalizability of our findings. Moreover, the observed biases produced mainly by non-response in the ESSA survey can be showed through the differences between the sample and the study population at a given measurement, according to the intersection of the sex variable with other segmentation variables such as age, province, degree of urbanization and nationality. With respect to age, the largest differences between the values observed from the sample in M4, compared to those from the larger population, are found in the youngest men age group (under 30 years old), in middle-aged women age group (between 35 and 54 years old) and in the oldest women and men age group (over 70 years old), with these differences increasing with age. With regard to the other segmentation variables, the largest differences were found among people with a nationality other than Spanish, especially among men. These results are also observed (although to a lesser extent) in the previous measurements, showing that ESSA has a non-monotone missing pattern and a lower participation of some population groups. Therefore, they justify the need to adjust the sample weights. Accordingly, we combine suitable reweighting methods such as Propensity Score Adjustment (PSA), [27] as well as XGBoost and calibration, [20] to address the biases associated with dropout from overlapping panel survey data [8]. Third, our study was conducted in Andalusia, potentially limiting our study’s generalizability. However, Andalusia is the most populated (with over 8 million residents) and the largest of the 19 regions of Spain [34, 35]. Thus, the present study may capture a diverse population and the study findings may still be relevant to other regions of Spain and around the world. Fourth, temporality bias may also be present in our study given that it was carried out in the first year of the COVID-19 pandemic; albeit our study focused on assessing mental health outcomes during the most critical time of the COVID-19 public health emergency, not to capture the long-term effects of the pandemic on mental health. Given the threat of future pandemics, [36] the results from our study are relevant and may help to inform future efforts to protect mental health during public health emergencies. Fifth, race/ethnicity and migration background are well-known demographic factors associated with various health outcomes and COVID-19 related outcomes that should have been included as control variables in study analyses. Unfortunately, collecting this information is typically prohibited in Spain, [37] preventing us from collecting this information in the present study. Sixth, given that participants self-reported answers to trained interviewers various questions through a computer-assisted telephone survey, response and social desirability bias may have been introduced to the study, especially for sensitive questions such as income. Furthermore, a single-item measure was used to assess participant’s perceived mental health status, happiness, optimism, feeling alone, feeling depressed, feeling anxious. Yet, the single-item measure of self-rated health used in the present study is adapted from one often used in research that is associated with multi-item measures of mental health [21]. The single-item measures of happiness, optimism, feeling alone, feeling depressed, feeling anxious were based on questions from the validated Socioemotional Well-being Index. In general, there is also growing attention to the benefits of using single-item mental health questions [38].

Despite these limitations, our study has several key strengths that lend support to the findings. First, the overlapping panel design allowed us to complete each measurement with new cross-sectional samples that subsequently became longitudinal, thereby enabling us to better examine changes in the mental/emotional health outcomes of interest over time and providing us with greater control over the confounding variables. This panel design, where the same study participants were tracked at various survey measurement periods, is what allowed us to detect that some individual-level COVID-19 variables (i.e., objectively measured COVID-19 status and self-reported COVID-19 severity levels) influenced the outcome variables. Second, the panel design allowed us to collect a large amount of high-quality data in real-time and was representative of the general population, filling existing research gaps [6]. Third, the dataset used was obtained using stratified random sampling and survey adjusted weights application which bolsters statistical power. Fourth, the original data from which the sample was initially extracted (i.e., vital statistics registries, population censuses, housing censuses) were subsequently linked to other probabilistic registries that collected clinical, epidemiologic, demographic, and environmental information. Fifth, other rigorous approaches implemented to enhance the quality of data collected included training and regularly checking in with a team of interviewers solely assigned to the study to administer the survey via a computer-assistant telephone system. Sixth, we measured seven MH and SEW outcomes, most of them based on validated measurement tools, such as the SEWBI which was specifically validated for European populations [23, 39]. Seventh, COVID-19 and chronic condition diagnoses were objectively measured based on clinic records. Eight, the study measurements correspond to critical timepoints during the pandemic. Furthermore, analyses were guided by a conceptual model that captured a multitude of socio-ecological factors that have the potential to shape mental/emotional health outcomes.

Study implications

Our study offers evidence that the evolution of poor mental and socio-emotional health outcomes during the first (and most challenging) year of the pandemic following the first state of alarm varied according to the type of outcome under consideration. This suggests that careful distinctions should be made in how mental health outcomes are assessed and addressed by practitioners and policymakers alike. Likewise, our study also found that mental health/socio-emotional wellbeing risks and protective factors varied by outcome examined, although some groups such as individuals experiencing poor health, limited social support, and low socioeconomic status were found to be at greatest risk for poor mental and emotional health in most of the outcomes examined. Stakeholders and decision-makers seeking to curb poor MH/SEW outcomes should consider varying mental health burdens across different populations and tailor interventions to such groups disproportionately impacted during ongoing and future efforts to address underlying social determinants of mental health during public health crises. In general, there may be a need to make behavioral health services more widely available to populations experiencing health inequalities MH and SEW as a preventative measure.

Conclusion

Although the pandemic is receding in the mind of the public and decision-makers, the findings from this study may guide ongoing and future efforts to address underlying social determinants of mental health in the new era of COVID-19. Now more than ever, examining current trends in and risk factors for poor MH and SEW may illuminate opportunities to maximize scarce resources and inadequate infrastructures to improve health outcomes during public health emergencies. After all, there is increasing recognition that mental healthcare infrastructures, which were inadequate before the pandemic, have failed even further within this context [40]. Ultimately, more studies with strong research designs are warranted to investigate temporal changes in and predictors of these outcomes from the start of the pandemic to the present.

Availability of data and materials

The dataset and code supporting the conclusions of this article will be available in the ESSA repository at www.easp.es/ESSA. Code will be available at www.researchprojects.es.

Abbreviations

95% CI:

95% Credibility intervals

ESSA:

Health and Social Survey (Encuesta Sanitaria y Social de Andalucía)

GLMM:

Generalized linear mixed models

M1:

Measurement period 1

M2:

Measurement period 2

M3:

Measurement period 3

M4:

Measurement period 4

MH:

Mental Health

OR:

Odds ratio

SEW:

Socio-emotional wellbeing

SEWBI:

Socioemotional Well-being Index

XGBoost:

eXtreme Gradient Boosting

References

  1. The Lancet Public Health. COVID-19 pandemic: what’s next for public health?. Lancet Public Health. 2022;7:e391.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Kola L, Kumar M, Kohrt BA, Fatodu T, Olayemi BA, Adefolarin AO. Strengthening public mental health during and after the acute phase of the COVID-19 pandemic. Lancet. 2022;399:1851–2.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Patel V, Saxena S, Lund C, et al. The Lancet Commission on global mental health and sustainable development. Lancet. 2018;392:1553–98.

    Article  PubMed  Google Scholar 

  4. Penninx BWJH, Benros ME, Klein RS, Vinkers CH. How COVID-19 shaped mental health: from infection to pandemic effects. Nat Med. 2022;28:2027–37.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Sun Y, Wu Y, Fan S, et al. Comparison of mental health symptoms before and during the covid-19 pandemic: evidence from a systematic review and meta-analysis of 134 cohorts. BMJ. 2023;380:e074224.

    Article  PubMed  Google Scholar 

  6. Sánchez-Cantalejo Garrido C, Yucumá Conde D, del Rueda M. Scoping review of the methodology of large health surveys conducted in Spain early on in the COVID-19 pandemic. Front Public Health. 2023;11:1217519.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Kalton G, Citro CF. Panel surveys: adding the fourth dimension. Surv Methodol. 1993;19:2015–15.

    Google Scholar 

  8. Sánchez-Cantalejo C, Rueda MDM, Saez M, et al. Impact of COVID-19 on the health of the general and more vulnerable population and its determinants: health care and social survey-ESSOC, study protocol. Int J Environ Res Public Health. 2021;18:8120.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Mata J, Wenz A, Rettig T, et al. Health behaviors and mental health during the COVID-19 pandemic: a longitudinal population-based survey in Germany. Soc Sci Med. 2021;287:114333.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Bu F, Steptoe A, Fancourt D. Loneliness during a strict lockdown: trajectories and predictors during the COVID-19 pandemic in 38,217 United Kingdom adults. Soc Sci Med. 2020;265:113521.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Fancourt D, Steptoe A, Bu F. Trajectories of anxiety and depressive symptoms during enforced isolation due to COVID-19 in England: a longitudinal observational study. Lancet Psychiatry. 2021;8:141–9.

    Article  PubMed  Google Scholar 

  12. Duarte F, Jiménez-Molina Á. A Longitudinal Nationwide Study of Psychological Distress during the COVID-19 pandemic in Chile. Front Psychiatry. 2022;13:744204.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Benke C, Asselmann E, Entringer TM, Pané-Farré CA. The role of pre-pandemic depression for changes in depression, anxiety, and loneliness during the COVID-19 pandemic: results from a longitudinal probability sample of adults from Germany. Eur Psychiatry. 2022;65:e76.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Ettman CK, Cohen GH, Abdalla SM, et al. Persistent depressive symptoms during COVID-19: a national, population-representative, longitudinal study of U.S. adults. Lancet Reg Health Americas. 2022;5:100091.

    Article  PubMed  Google Scholar 

  15. Lucchini M, Gerosa T, Pancheva M, Pisati M, Respi C, Riva E. Differential effects of COVID-19 and containment measures on mental health: evidence from ITA.LI-Italian lives, the Italian household panel. PLoS ONE. 2021;16:e0259989.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Zhou Y, Cai W, Xie L. The impact of the COVID-19 pandemic on depressive symptoms in China: a Longitudinal, Population-based study. Int J Public Health. 2022;67:1604919.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Riepenhausen A, Veer IM, Wackerhagen C, et al. Coping with COVID: risk and resilience factors for mental health in a German representative panel study. Psychol Med. 2023;53:3897–907.

    Article  PubMed  Google Scholar 

  18. Bu F, Steptoe A, Fancourt D. Depressive and anxiety symptoms in adults during the COVID-19 pandemic in England: a panel data analysis over 2 years. PLoS Med. 2023;20:e1004144.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Parola A, Rossi A, Tessitore F, Troisi G, Mannarini S. Mental Health through the COVID-19 Quarantine: a growth curve analysis on Italian young adults. Front Psychol. 2020;11:567484.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Castro L, Del Mar Rueda M, Sánchez-Cantalejo C, Ferri R, Cabrera-León A. Calibration and XGBoostc reweighting to reduce coverage and non-response biases in overlapping panel surveys: application to the Healthcare and Social Survey. BMC Med Res Methodol. 2024;24:36. https://doi.org/10.1186/s12874-024-02171-z.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Ahmad F, Jhajj AK, Stewart DE, Burghardt M, Bierman AS. Single item measures of self-rated mental health: a scoping review. BMC Health Serv Res. 2014;14:398. https://doi.org/10.1186/1472-6963-14-398.

  22. Statistics Canada. Canadian Health Measures Survey (CHMS). https://www.statcan.gc.ca/en/survey/household/5071 (Accessed 23 Jan 2024).

  23. Bericat E. The Socioemotional Well-Being Index (SEWBI): theoretical Framework and empirical operationalisation. Soc Indic Res. 2014;119:599–626.

    Article  Google Scholar 

  24. McLeroy KR, Bibeau D, Steckler A, Glanz K. An ecological perspective on health promotion programs. Health Educ Q. 1988;15:351–77.

    Article  CAS  PubMed  Google Scholar 

  25. Alegría M, NeMoyer A, Falgàs Bagué I, Wang Y, Alvarez K. Social Determinants of Mental Health: where we are and where we need to go. Curr Psychiatry Rep. 2018;20:95.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Chen T, Guestrin C. XGBoost:. A scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. San Francisco: ACM 2016 Proceedings; p. 785–794.

  27. Friedman J, Hastie T, Tibshirani R. Additive logistic regression: a statistical view of boosting (with discussion and a rejoinder by the authors). Ann Stat. 2000;28(2):337–407. https://doi.org/10.1214/aos/1016218223.

  28. Esteve-Matalí L, Llorens-Serrano C, Alonso J, Vilagut G, Moncada S, Navarro-Giné A. Mental health inequalities in times of crisis: evolution between 2005 and 2021 among the Spanish salaried population. J Epidemiol Community Health. 2022;ahead of print:jech–2022.

    Google Scholar 

  29. Monistrol-Mula A, Felez-Nobrega M, Moneta MV, et al. Mental health symptoms 1 year after the COVID-19 outbreak in Spain: the role of pre-existing mental disorders and their type. J Affect Disord. 2022;318:22–8.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Raventós B, Pistillo A, Reyes C, et al. Impact of the COVID-19 pandemic on diagnoses of common mental health disorders in adults in Catalonia, Spain: a population-based cohort study. BMJ Open. 2022;12:e057866.

    Article  PubMed  Google Scholar 

  31. Lachytova M, Katreniakova Z, Mikula P, Jendrichovsky M, Nagyova I. Associations between self-rated health, mental health problems and physical inactivity among urban adolescents. Eur J Public Health. 2017;27:984–9.

    Article  PubMed  Google Scholar 

  32. Zrnić Novaković I, Ajduković D, Bakić H et al. Shaped by the COVID-19 pandemic: psychological responses from a subjective perspective-A longitudinal mixed-methods study across five European countries. PLoS ONE. 2023;18(4):e0285078. https://doi.org/10.1371/journal.pone.0285078.

  33. Kim J, Park S, Subramanian SV, Kim T. The psychological costs of the COVID-19 pandemic and heterogeneous effects in South Korea: evidence from a difference-in-differences analysis. J Happiness Stud. 2023;24:455–76.

    Article  PubMed  Google Scholar 

  34. Böhme K, Lüer C, Besana F, Hans S, Schuh B, Münch A, Gorny H. Commission for Economic Policy: the state of the regions, cities and villages in the areas of socio-economic policies contribution to the 2021 EU Annual Regional and local barometer. Eur Comm Reg. 2021. https://doi.org/10.2863/153679.

  35. Autonomous Community Profiles. Andalusia. https://www.caixabankresearch.com/en/publications/autonomous-community-profiles/andalusia (Accessed 17 Jul 2024).

  36. Coccia M. Sources, diffusion and prediction in COVID-19 pandemic: lessons learned to face next health emergency. AIMS Public Health. 2023;10:145.

    Article  PubMed  PubMed Central  Google Scholar 

  37. European Commission. Data collection in the field of ethnicity. https://commission.europa.eu/system/files/2021-09/data_collection_in_the_field_of_ethnicity.pdf (Accessed 16 Jul 2024).

  38. Allen MS, Iliescu D, Greiff S. Single item measures in psychological science: a call to action [Editorial]. Eur J Psychol Assess. 2022;38(1):1–5.

    Article  Google Scholar 

  39. Bericat E. accessed Jan 23,. Excluidos de la Felicidad. Las Desigualdades de Bienestar Emocional en España y Europa. https://www.researchgate.net/publication/287814426_EXCLUIDOS_DE_LA_FELICIDAD_Las_desigualdades_de_bienestar_emocional_en_Espana_y_Europa (2024).

  40. Campion J, Javed A, Lund C, et al. Public mental health: required actions to address implementation failure in the context of COVID-19. Lancet Psychiatry. 2022;9:169–82.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

This study was carried out within the ‘Health Inequalities and COVID-19’ subprogram of CIBER of Epidemiology and Public Health (CIBERESP). We appreciate the comments from the editor and three anonymous reviewers of a previous version of this work who, without a doubt, have helped us to improve our work. The usual disclaimer applies.

Declaration of Generative AI and AI-assisted technologies in the writing process

During the writing of the article the authors have not used any type of AI and AI-assisted technologies.

Funding

This work was partially financed by the COVID-19 Competitive Grant Program (ID#61605991) from Pfizer Global Medical Grants; the SUPERA COVID-19 Fund, from SAUN: Santander Universidades, CRUE and CSIC; the Strategic Plan for Research and Innovation in Health (PERIS), Department of Health, Government of Catalonia; and the Consolidated research group ‘Compositional and Spatial Data Analysis (COSDA)’ 2021 SGR 01197, AGAUR, Government of Catalonia; the Andalusian Institute of Statistics and Cartography (IECA, Spanish acronym) and the Andalusian School of Public Health (EASP, Spanish acronym) [financed the first and second survey measurements]; and the Maria Zambrano ‘Grants for the requalification of the Spanish university system’ supported by ‘Next Generation EU’, the ‘European Union, Recovery, Transformation and Resilience Plan,’ and the Spanish Government. The funding sources did not participate in the design or conduct of the study, the collection, management, analysis, or interpretation of the data, or the preparation, review, or approval of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization, BR; Methodology, BR, MS, MAB, AC and CSC; Resources, MS, MAB and MJL; Data curation CSC and AC; Analysis BR, MS, AC and CSC; Writing-original draft preparation, BR; Writing-review and editing, MS, MAB, AC and MJL; Project administration, MS, MAB and AC; Funding acquisition, MS and AC. All authors (BR, MS, AC, CSC, MJL and MAB) have read and agree to the published version of the manuscript. All authors (BR, MS, AC, CSC, MJL and MAB) had full access to all the data in the study and accept full responsibility for the findings reported.

Corresponding author

Correspondence to Maria A. Barceló.

Ethics declarations

Ethics approval and consent to participate

All methods were carried out in accordance with relevant guidelines and regulations on which.

An informed consent was obtained from all subjects involved in the ESSA survey on which this study is based. It was also approved by the Research Ethics Committee of the Department of Health and Families of the Andalusian Regional Government (protocol code 10/20, dated 07 December 2020). The ESSA is an activity included in the processing activities registry of the Department of Health and Families of the Andalusian Regional Government and is linked to the Andalusian Health Survey (EAS, Encuesta Andaluza de Salud), an official statistical operation included in the Andalusian Statistical and Cartographic Plan (Plan Estadístico y Cartográfico de Andalucía), code 02.02.21.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Robles, B., Saez, M., Cabrera-Leon, A. et al. Comparing temporal changes and predictors of different types of mental health and socio-emotional wellbeing outcomes during COVID-19: an overlapping panel study of Spanish residents. BMC Public Health 24, 2284 (2024). https://doi.org/10.1186/s12889-024-19817-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-024-19817-8

Keywords