Skip to main content
Download PDF

The effect of nonrestorative sleep on incident hypertension 1–2 years later among middle-aged Hispanics/Latinos

BMC Public Health volume 23, Article number: 1456 (2023) Cite this article

Abstract

Background

Insomnia is known to be a major risk factor for incident hypertension. Nonrestorative sleep (NRS), which refers to insufficiently rested sleep, has reported to associate with various diseases. This study aimed to investigate the longitudinal association between insomnia-related symptoms including NRS and incident hypertension 1–2 years later by age group (young, 18–39 years and middle-age, 40–64 years) using existing cohort data involving Hispanics/Latinos.

Methods

This study included 1100 subjects who had participated in both the Hispanic Community Health Study/Study of Latinos and its follow-up study, the Sueño Ancillary Study, and met additional eligibility criteria. Incident hypertension was assessed by self-reported history and/or the use of antihypertensives. The Women’s Health Initiative Insomnia Rating Scale (WHIIRS) was used to evaluate insomnia-related symptoms (difficulty initiating sleep, difficulty maintaining sleep, early morning awakening, difficulty returning to sleep, and NRS). Logistic regression analyses were conducted to assess the degree to which insomnia-related symptoms at baseline predicted incident hypertension.

Results

Among the participants (64% middle-aged, 36% young adults), 140 (12.7%) developed hypertension during the follow-up period. Among the sleep-related symptoms, only NRS predicted incident hypertension after adjusting for sociodemographic factors and physical condition (odds ratio: 1.88, 95% confidence interval: 1.10–3.21, p = 0.022) in middle-aged adults. None of the insomnia-related symptoms were associated with incident hypertension in the young adults. No association was found between WHIIRS-defined insomnia (total score ≥ 9) and incident hypertension in middle-aged adults or young adults.

Conclusion

The present findings suggest the importance of focusing on NRS to help prevent the development of hypertension in middle-aged adults.

Peer Review reports

Background

At present, one in three adults around the world are diagnosed as having hypertension, and the number of hypertensive patients has doubled in the past 30 years [1]. Hypertension is the principal risk factor for major life-threatening diseases such as stroke and ischemic heart disease [2]. Furthermore, the incidence of hypertension increases with age [3], and the global population aged ≥ 65 years is growing faster than all other age groups. Thus, the establishment of early and efficient methods for the prevention of hypertension is urgently needed.

Diabetes, obesity, male sex, insufficient exercise, insomnia, smoking, and alcohol consumption have been reported to be risk factors for incident hypertension [4,5,6,7,8]. Therefore, focusing on such factors is considered useful for reducing the incidence of hypertension. However, a recent study reported that the effect of these risk factors on hypertension differ depending on age. Zang et al. reported that male sex was a significant risk factor in young and middle-aged individuals, but not in older adults. Moreover, obesity, diabetes, a family history of stroke, and hypertriglyceridemia were significant risk factors in all age groups, but the degrees of the effects differed depending on age [9]. Consequently, for more effective prevention, individual risks should be examined by age.

In addition to the above factors, insomnia is also recognized as a risk factor for hypertension. A recent meta-analysis reported that insomnia increased the risk of incident hypertension by about 1.2 times [10]. As for subtypes of insomnia symptoms (difficulty initiating sleep [DIS], difficulty maintaining sleep [DMS], and early morning awakening [EMA]), a previous study found that DIS was not associated with the development of hypertension, whereas DMS and EMA were, with 1.3- and 1.1-fold increased risks, respectively [10]. Because the incidence of insomnia increases with age [11], the significance of insomnia as a risk factor for hypertension may also vary with age. However, how each insomnia symptom relates to the development of hypertension in different generations remains unclear.

Nonrestorative sleep (NRS), which refers to sleep that does not result in feeling rested [12], was excluded from the core symptoms of insomnia in the revision of the International Classification of Sleep Disorders from the Second to the Third Edition [13]. However, NRS has recently been reported to be associated with various diseases, such as diabetes, gastroesophageal reflex disease, eye diseases, arthritis, eczema, and depression [14,15,16]. In addition, a prospective study reported that NRS was a risk factor for incident coronary artery heart disease (CHD) [17]. Given that hypertension is one of the major risk factors for CHD [18], NRS may be associated with the development of CHD via the develop of hypertension.

A few studies have investigated the association between NRS and hypertension, but the results are conflicting, possibly due to methodological differences [15, 19]. As mentioned earlier, the degrees of the effects of risk factors for the incidence of hypertension differ depending on age. Therefore, the effect of NRS on the development of hypertension should also be examined by age group.

Given this background, the present study aimed to investigate the longitudinal association between insomnia-related symptoms (DIS, DMS, EMA, difficulty returning to sleep [DRS], and NRS) and incident hypertension by age group (young, 18–39 years and middle-age, 40–64 years) using existing cohort data from studies involving Hispanics/Latinos living in the USA [20, 21].

Methods

We used existing longitudinally measured cohort data from Hispanics/Latinos living in the USA taken from the Hispanic Community Health Study/Study of Latinos (HCHS/SOL) and its follow-up study conducted 1–2 years later, the Sueño Ancillary Study.

The present study was approved by the ethics committee of the National Center of Neurology and Psychiatry (A2020-012). All data analyzed in this are publicly available (sleepdata.org).

Description of the data set

The HCHS/SOL study (Visit 1: V1) was a multicenter cohort study involving Hispanics/Latinos living in the USA conducted by the National Heart, Lung, and Blood institute and six other institutes of the National Institutes of Health from 2008 to 2010. The study was conducted at four sites to specify protective and harmful factors in regard to the health of Hispanics/Latinos: Bronx, Chicago, Miami, and San Diego. The HCHS/SOL study sample and design have been described elsewhere [22, 23]. The participants were identified and recruited for the present study using population-based sampling. The total number of participants (age range, 18–74 years) was 16,415. After the date was decided by telephone, the participants came to the field center to undergo the examination.

The Sueño Ancillary Study (Visit 2: V2), the follow-up study of the HCHS/SOL study, was conducted from 2010 to 2013. The inclusion criteria were as follows: age 18–64 years, the absence of severe sleep-disordered breathing (respiratory event index [REI] > 50 events per hour at the baseline examination or positive airway pressure treatment for obstructive sleep apnea [OSA]), or narcolepsy. Consequently, 2,252 individuals were selected and underwent the re-examination at each field center. Finally, 1,912 participants gave permission to researchers outside the HCHS/SOL to use their data (Fig. 1). Approval for both studies was obtained from the Institutional Review Boards at each of the participating sites. All participants provided informed consent.

Fig. 1
figure 1

Sample flowchart

HCHS/SOL: Hispanic Community Health Study/Study of Latinos, V1: Visit 1, V2: Visit 2, REI: respiratory event index, WHIIRS: Women’s Health Initiative Insomnia Rating Scale, CES-D-10: 10-item Center for Epidemiologic Studies Depression Scale

Full size image

Additional criteria for the present study

The following inclusion criteria were added for the present study: (1) those who had more than 1 year of follow-up between V1 and V2; (2) those who had complete data on covariates (i.e., age, sex, participating sites, body mass index [BMI], alcohol use, cigarette use, marital status, income, education level, follow-up periods, sleep duration, Global Physical Activity Questionnaire [GPAQ], Short-Form 12-Item Survey—version 2 [SF-12v2], 10-item Center for Epidemiologic Studies Depression Scale [CES-D-10], chronic obstructive pulmonary disease [COPD], diabetes, and respiratory event index [REI]) and the Women’s Health Initiative Insomnia Rating Scale (WHIIRS) from V1; (3) those who had complete data on hypertension (questions about the diagnosis and use of antihypertensives) from both V1 and V2; (4) those who had completed the CES-D-10 at V1; and (5) those who did not have hypertension at V1. Finally, 1100 subjects were included in this study (Fig. 1).

Measures

Incident hypertension

The presence of hypertension was assessed using questions about the diagnosis and use of antihypertensives. At both V1 and V2, the participants were asked about a diagnosis of hypertension by using the following question: “Has a doctor ever said that you have high blood pressure or hypertension?” They were also asked to declare all prescribed or over-the-counter medications taken within the past 4 weeks at both time periods. Participants who had been diagnosed with hypertension and/or were taking antihypertensive medications at V1 were excluded. Among the other participants, those who had been diagnosed with hypertension and/or were taking antihypertensive medications at V2 were defined as those who developed hypertension during the follow-up period.

Insomnia-related symptoms

The WHIIRS [24], the internal consistency of which has been confirmed within acceptable limits (α = 0.78) [24], was used to assess the following five insomnia-related symptoms for the previous 4 weeks:

1) DIS: “Did you have trouble falling asleep?”

2) DMS: “Did you wake up several times at night?”

3) EMA: “Did you wake up earlier than you planned to?”

4) DRS: “Did you have trouble getting back to sleep after you woke up too early?”

5) NRS: “Overall, was your typical night’s sleep during the past 4 weeks:”

For questions 1) through 4), the participants chose from the following five responses: 1, No, not in past 4 weeks; 2, Yes, less than once a week; 3, Yes, 1 or 2 times a week; 4, Yes 3 or 4 times a week; and 5, Yes, 5 or more times a week. We regarded those who answered 1 and 2 as not having the respective sleep problem, and those who answered 3–5 as having the respective sleep problem [25]. For question 5), the participants chose from the following five responses: 0, Very sound or restful; 1, Sound or restful; 2, Average quality; 3, Restless; and 4, Very restless. We defined those who answered 0–2 to the questions as having restorative sleep, and those who answered 3 and 4 as having NRS [25].

Based on a previous study [24], a WHIIRS total score of ≥ 9 was used as the cutoff for insomnia. The original response score ranges from 0 to 4, whereas the response score used in the present study ranged from 1 to 5. The total score was calculated using the following formula [16]: WHIIRS total score = DIS + DMS + EMA + DRS + NRS – 4.

Covariates

Sociodemographic variables

We treated all sociodemographic data at V1, except for physical health, as categorical variables. The sociodemographic variables included as covariates were as follows: age (≤29, 30–39, 40–49, 50–59, ≥ 60 years), gender (male, female), BMI (< 25, ≥ 25 kg/m2), field center (Bronx, Chicago, Miami, San Diego), income (< 30,000 USD, ≥ 30,000 USD, not reported), education level (less than high school, high school, and more than high school), marital status (single, married or living with a partner, separated, divorced, or widowed), alcohol drinking (never, former, current), and smoking (never, former, current). Physical activity was assessed using the GPAQ, and was categorized into three levels (low, moderate, high) [26].

Physical health was evaluated using the SF-12v2, which provided a numeric variable score that was calculated using a standardized score of 0–100 [27].

Sleeping pill use

The use of sleeping pills at V1 was assessed the following question: “Did you take sleeping pills to help you sleep ?”. Participants chose from the following five responses: 1, No, not in the past 4 weeks; 2, Yes, less than once a week; 3, Yes, 1 or 2 times a week; 4, Yes, 3 or 4 times a week; and 5, Yes, 5 or more times a week. We defined those who answered 2–5 as sleeping pill users.

Sleep duration

Sleep duration was assessed separately for weekdays and weekends by using the following questions: “What time do you usually go to bed?” and “What time do you usually wake up?”. Average weekly sleep duration was calculated using the following formula:

Average sleep duration = ([weekend sleep duration] × 2 + [weekday sleep duration] × 5) / 7.

Sleep duration was divided into five groups (< 6 h; ≥6 to < 7 h; ≥7 to < 8 h; ≥8 to < 9 h; ≥9 h). A previous meta-analysis reported a U-shaped relationship between sleep duration and mortality [28], with those who slept approximately 7 h having the lowest risk of death. Therefore, we used those who slept ≥7 to < 8 h with the lowest health risk as a reference [29].

Follow-up period

We classified the follow-up period into two groups (1 year: ≥365 to ≤729 days and 2 years: ≥730 days).

Physical and mental disorders

Obstructive sleep apnea (OSA)

The presence of OSA at V1 was examined using a home sleep apnea devise (ARES Unicorder 5.2; B-Alert, Carlsbad, CA). Those who had an REI: respiratory event frequency per hour of monitoring ≥ 15 were defined as having OSA.

Chronic obstructive pulmonary disease (COPD)

The participants who answered on a self-report respiratory form that a doctor had informed them that they had COPD or emphysema were considered to have COPD.

Diabetes

The presence of diabetes was assess using the following questions: “Has a doctor ever said that you have diabetes?” and “Was this during pregnancy?”. Those who answered that a doctor had told them that they had diabetes were considered to have diabetes.

Depression

The CES-D-10 is composed of 10 items to assess depression over the past week, with a cutoff score of 10 [30]. The validity and reliability of the CES-D-10 have been confirmed in HCHS/SOL samples [31].

As the dependent variable was insomnia-related symptoms, we excluded the item related to sleep (item 7: “My sleep was restless”) to account for confounding bias. As a result, a total of nine items (CES-D-9) were used. The total score was calculated using the following formula:

Total CES-D-9 score = SUM (items 1–6, items 8–10) × 10/9 [16].

Participants with a score of 10 or more at V1 were considered to have depression [30].

Statistical analysis

Differences in demographic characteristics between the participants with and without incident hypertension were examined using χ2 and t tests.

We chose possible confounders for their potential association with incident hypertension based on clinical knowledge. Due to small number of case of incident hypertension in the younger adults, we used the propensity score to calculate the effect for all confounders. A logistic regression model was conducted to estimate the propensity score, in which each insomnia-related symptom was a dependent variable and the sociodemographic and health status factors (age, gender, BMI, field center, income, education level, marital status, drinking alcohol, smoking, OSA, sleep duration, sleeping pills use, follow-up period, GPAQ, SF-12v2, depression, COPD, diabetes) were independent variables. After examining the risk of each insomnia-related symptom at V1 for the development of V2 hypertension in univariate regression, each insomnia-related symptom at V1 was regressed on the incident hypertension in V2 adjusting for the propensity score of the sociodemographic and health status factors. The level of statistical significance was set at p < 0.05. All statistical analyses were performed using SPSS ver. 26.0 (IBM, New York, USA).

We defined those aged 18–39 years as young adults and those aged 40–64 years as middle-aged, referring to the 2019 NICE NG136 criteria for developing hypertension in young adults (< 40 years old) [32].

Results

Demographic characteristics

Of the 1100 participants, 393 and 707 were categorized as young and middle-aged adults, respectively. Tables 1 and 2 show the participants’ demographic characteristics at V1 for both age groups.

Table 1 Demographic data among young adults in this study
Full size table
Table 2 Demographic data among middle-aged adults in this study
Full size table

The mean age of the young adults, who were predominantly female, was 28.7 ± 7.0 years. 70% of the sample reported having obesity and being a nonsmoker. More than half of the individuals had a household income < 30,000 USD, an education history of high school or more than high school, were single, and currently consumed alcohol. Most of the individuals had not used sleeping pills in the past 4 weeks, did not have OSA or COPD, and had low or moderate physical activity. The mean sleep duration was 8.1 ± 1.4 h. About 25% of the individuals had depressive symptoms, and 3% reported diabetes.

The mean age of the middle-aged adults, who were also predominantly female, was 49.8 ± 6.1 years. 80% of the sample reported having obesity. More than half of the individuals had a household income < 30,000 USD, an education history of high school or more than high school, were married or living with a partner, and had consumed alcohol. 70% were nonsmokers. Most of individuals had not used sleeping pills in the past 4 weeks, did not have OSA or COPD, and had low or moderate physical activity. The mean sleep duration was 7.7 ± 1.4 h. Almost 30% of the individuals had depressive symptoms and 15% reported diabetes.

Incident hypertension

The average follow-up period was 786 ± 135 days. Of 1100 participants included in the analysis, 140 (12.7%) had incident hypertension at V2. No significant difference in incident hypertension was found by gender (male vs. female: 13.5% vs. 12.3%, χ2 = 0.29, df = 1, p = 0.59). In addition, the proportion of those who developed hypertension increased with age (χ2 = 31.58, df = 4, p < 0.001), incident hypertension was almost twice as high in those aged 40–59 as in those aged 18–39 years, and was twice as high in those aged 60–64 as in those aged 40–59 years (Table 3). The prevalence of incident hypertension was 6.9% among young and 16.0% among middle-aged adults.

Table 3 Incident hypertension by age group
Full size table

Prevalence of insomnia/insomnia-related symptoms

The young adults had a significantly lower prevalence of insomnia and WHIIRS scores compared with the middle-age adults (young vs. middle-aged, prevalence of insomnia: 27.0% vs. 37.6%, χ2 = 12.8, df = 1, p < 0.001, WHIIRS: 5.9 ± 4.9 vs. 7.2 ± 5.5, t (887) = − 3.97, p < 0.001). Table 4 shows the results regarding the prevalence of insomnia and the five insomnia-related symptoms by gender and age. Females had a significantly higher prevalence of insomnia and all five symptoms compared with males (insomnia: χ2 = 12, df = 1, p < 0.001, DIS: χ2 = 10, df = 1, p = 0.002, DMS: χ2 = 5.9, df = 1, p = 0.015, EMA: χ2 = 5.3, df = 1, p = 0.021, DRS: χ2 = 10, df = 1, p = 0.002, NRS: χ2 = 10, df = 1, p = 0.001).

Table 4 Prevalence of each of the five insomnia-related symptoms by sex and age
Full size table

In all subjects, the prevalences of insomnia (χ2 = 27.6, df = 4, p < 0.001), DIS (χ2 = 12.4, df = 4, p = 0.015), DMS (χ2 = 27.5, df = 4, p < 0.001), EMA (χ2 = 15.9, df = 4, p = 0.003), and DRS (χ2 = 24.1, df = 4, p < 0.001) tended to increase with advanced age. However, no such increase with age was observed for NRS.

Association between insomnia/insomnia-related symptoms and incident hypertension

Table 5 shows the results of logistic regression analysis for the association between insomnia/insomnia-related symptoms and incident hypertension. Neither insomnia nor any insomnia-related symptoms was associated with incident hypertension in univariate logistic analysis among the young adults.

Table 5 Association between insomnia-related symptoms and incident hypertension
Full size table

On the other hand, among middle-aged adults, significant associations were found between incident hypertension and insomnia, DIS and NRS and (insomnia, odds ratio [OR] = 1.65; DMS, OR = 1.60; NRS, OR = 2.04) in univariate logistic regression analysis. After adjusting for the propensity scores of sociodemographic factors and health status factors, only NRS showed a significant association with incident hypertension (OR: 1.88, 95% confidence interval: 1.10–3.21, p = 0.022).

Discussion

The results of the present study indicated age differences in the association between insomnia-related symptoms and incident hypertension. In middle-aged adults (40–64 years), multivariate analysis revealed that among the insomnia-related symptoms, only NRS was a significant predictor of incident hypertension at 1–2 years later. Conversely, in young adults (18–39 years), none of the insomnia-related symptoms were associated with incident hypertension at 1–2 years later. No association was found between WHIIRS-defined insomnia (total score ≥ 9) and incident hypertension in middle-aged adults or young adults.

To the best of our knowledge, this is the first study to investigate the longitudinal association between NRS and incident hypertension by age group. Our findings suggest the importance of focusing on NRS in addition to other insomnia symptoms to help prevent the development of hypertension in middle-aged adults.

Incident hypertension

The rate of incident hypertension in this study was 12.7%. Previous studies investigating the association between insomnia and incident hypertension in the USA reported that the rate of incident hypertension ranged from 5.4–36.0% [33,34,35]. This wide range of incidence might be due to methodological differences such as observational periods. Given that the follow-up period in the present study was approximately 2 years, the incidence of hypertension was comparable to those of previous studies. However, the Hispanic Latinos living in the USA are characterized by lower rates of disease awareness compared with non-Hispanic whites [36]. Therefore, the actual incidence of hypertension might be higher.

Prevalence of insomnia/insomnia-related symptoms

The prevalence of insomnia, DIS, DMS, and EMA were 33.8%, 40.3%, 53.6%, and 41.9%, respectively. The prevalence of insomnia and DMS were similar to those reported in previous general adult population surveys, but the prevalence of DIS and EMA were higher than those of the general population [37]. This may be due to differences in the participants’ age and gender. Furthermore, we also found that the prevalence of these core symptoms of insomnia increased with age and were significantly higher in women than in men; these findings were also in agreement with a previous study [37].

The prevalence of NRS in the present study was 15.3%, which was comparable with that reported by a study involving a large European population (10.8%) [38]. The present results are consistent with that study in that NRS was significantly more common in females than in males [38]. No age differences were found with regard to the prevalence of NRS, but a previous study reported that the prevalence of NRS tended to be higher in a younger age group [38]. On the other hand, another study reported finding a higher prevalence of NRS in middle-aged and older adults [39]. Therefore, no agreement has been obtained with regard to the age-related prevalence of NRS.

Association between insomnia/insomnia-related symptoms and incident hypertension

In the present study, no significant association was found between insomnia/insomnia-related symptoms and incident hypertension in young adults. Young adults tend to complain of insomnia-related symptoms less frequently than do middle-aged adults [40]. Therefore, factors other than insomnia-related symptoms may have affected the prevalence of incident hypertension in this age group. Indeed, based on a comparison of demographic data between young adults with and without hypertension (Table 2), differences were found in some factors, including alcohol consumption, OSA, depressive symptoms, and diabetes. These risk factors may have contributed to incident hypertension more than to insomnia-related symptoms. In addition, the small sample size of young adults in this study may have reduced the statistical power.

Although NRS was a predictor of incident hypertension in middle-aged adults, insomnia and other sleep-related symptoms were not. Some general population studies targeting similar age groups have reported inconsistent findings. A study involving military personnel reported that insomnia was associated with incident hypertension [41]. The discrepancy of these results might be explained by whether chorionic insomnia was investigated. Cheng et al. [33] investigated the association between the core symptoms of insomnia (DIS and DMS) and the onset of hypertension 1 year later in those aged in their 30 to 50 s, and reported that DMS was a significant risk factor of incident hypertension. Rod et al. [42] investigated these relationships over a longer follow-up period (19 years), and reported that DMS and EMA were significant predictors of incident hypertension in females and males, respectively. However, several methodological differences should be noted between our study and previous studies. Cheng et al. [33] and Rod et al. [42] evaluated the symptoms of insomnia using items different from those used in the present study and determined the presence of incident hypertension based only on the presence of hypertension, not the presence or absence of antihypertensive medication, in a questionnaire survey. In addition, some differences in terms of covariates and the prevalence of incident hypertension may have contributed to the discrepancies in the results.

NRS as a predictor of incident hypertension among middle-aged adults

The results of the present study indicated that NRS was a predictor of incident hypertension in middle-aged adults. It is generally considered that the ability to maintain homeostasis in response to physical load is superior in younger adults than in middle-aged adults, and thus the association between NRS and the development of hypertension may be found only in middle-aged adults. Although the present results are consistent with those of another study involving middle-aged and older adults [19], an additional study involving only middle-aged adults showed discordant results [15]. The latter study included participants with persistent hypertension; that is, they did not exclude participants who had hypertension at baseline. This methodological difference might be associated with the inconsistency with our results.

Although it remains unclear why only NRS predicted incident hypertension at 1–2 years later in middle-aged adults, the following explanations might be adequate. Daytime dysfunction was considered to be profoundly associated with NRS. Ohayon et al. [38] mentioned that compared with those with the core symptoms of insomnia, subjects with NRS more often experienced a more depressive mood, anxious mood, physical fatigue, decreased efficacy, memory problems, and excessive daytime sleepiness, and consulted a physician about their sleep problems more frequently. Therefore, NRS has a close relationship with mental and physical health problems and daytime impairments, and could reflect restorative dysfunctions of the physical and psychological systems more than the core symptoms of insomnia, such as DIS, DMS, and EMA.

The present results might also be explained by the link between NRS and inflammation. Zhang et al. [43] compared C-reactive protein (CRP) in blood among four groups—subjects without NRS or insomnia, those with only NRS, those with only insomnia, and those with NRS and insomnia—and found that those with NRS and with both NRS and insomnia had significantly higher CRP levels compared with those without NRS or insomnia. It has been considered that increased CRP levels are associated with future incident hypertension and arterial stiffness [44, 45]. Therefore, NRS could lead to the development of hypertension via microinflammation. Furthermore, Mathews et al. reported decreased delta power during NREM periods in females who developed hypertension [46]. NRS has also been associated with increased alpha waves during NREM periods [47]. The association between NRS and the development of hypertension in middle-aged adults may be mediated by changes in NREM periods. Finally, NRS has been reported to be more prevalent in females [38] and almost 70% of the middle-aged subjects in this study were females. Although menopausal symptoms may underpin the significant association between NRS and the development of hypertension in middle-aged women [48], menopausal status was not evaluated in this study. Further studies using inflammatory markers and evaluations such as polysomnography and menopausal status are needed to confirm these associations.

Limitations

The strengths of this study were the longitudinal design, division of participants into age groups, and the consideration of 18 potential confounders. However, this study had also several limitations. First, the sample size was small and no older adults were included in this study. Moreover, the sample sizes of young and middle-aged adults differed. Validation studies with a larger sample size and wider age range are needed. Second, a self-report questionnaire was used to assess hypertension and the use of antihypertensive medications. Objective assessments of hypertension such as blood pressure measurements or a review of medical records are needed for the more accurate detection of incident hypertension. Third, since the definition of NRS differed among previous studies, it was difficult to compare it with previous studies. A unified definition of NRS will be needed in the future. Fourth, this study examined with only Hispanics/Latinos living in the USA. To generalize the results of the present study, it remains necessary to confirm whether similar results can be obtained in more diverse populations. Fifth, hypertension was measured using questionnaires about hypertension and the use of antihypertensive medications that were not graded. Therefore, the effect of insomnia-related symptoms on the severity of hypertension remains unclear. Finally, the covariates did not include menopausal status or a family history of cardiovascular disease or stroke. As we did not fully adjust for these factors, and they might have affected the accuracy of the results.

Conclusion

None of the insomnia-related symptoms examined in the present study were associated with incident hypertension among young adults. By contrast, NRS was a predictor of the development of hypertension in middle-aged adults. These findings suggest the importance of focusing on NRS in addition to other insomnia symptoms to help prevent the development of hypertension in middle-aged adults.

Data Availability

All data analyzed in this are publicly available (sleepdata.org).

Abbreviations

NRS:

Nonrestorative sleep

HT:

hypertension

DIS:

difficulty initiating sleep

DMS:

difficulty maintaining sleep

EMA:

early morning awaking

DRS:

difficulty returning to sleep

CHD:

coronary artery heart disease

HCHS/SOL:

the Hispanic Community Health Study/Study of Latinos

V1:

Visit 1

V2:

Visit 2

REI:

respiratory event index

OSA:

obstructive sleep apnea

BMI:

body mass index

GPAQ:

Global Physical Activity Questionnaire

SF-12v2:

Short-Form 12-Item Survey—version 2

CES-D-10:

10-item Center for Epidemiologic Studies Depression Scale

COPD:

chronic obstructive pulmonary disease

WHIIRS:

the Women’s Health Initiative Insomnia Rating Scale

OR:

odds ratio

CI:

confidence interval

NREM:

non-rapid eye movement sleep

References

  1. Worldwide trends in. Hypertension prevalence and progress in treatment and control from 1990 to 2019: a pooled analysis of 1201 population-representative studies with 104 million participants. Lancet. 2021;398(10304):957–80.

    Article  Google Scholar 

  2. Lawes CM, Vander Hoorn S, Rodgers A. Global burden of blood-pressure-related disease, 2001. Lancet. 2008;371(9623):1513–8.

    Article  PubMed  Google Scholar 

  3. He J, Whelton PK. Epidemiology and prevention of hypertension. Med Clin North Am. 1997;81(5):1077–97.

    Article  CAS  PubMed  Google Scholar 

  4. Fryar CD, Ostchega Y, Hales CM, Zhang G, Kruszon-Moran D. Hypertension prevalence and control among adults: United States, 2015–2016. NCHS Data Brief. 2017(289):1–8.

  5. Fernandez-Mendoza J, Vgontzas AN, Liao D, Shaffer ML, Vela-Bueno A, Basta M, et al. Insomnia with objective short sleep duration and incident hypertension: the Penn State Cohort. Hypertension. 2012;60(4):929–35.

    Article  CAS  PubMed  Google Scholar 

  6. Schroeder EC, DuBois L, Sadowsky M, Hilgenkamp TIM. Hypertension in adults with intellectual disability: prevalence and risk factors. Am J Prev Med. 2020;58(5):630–7.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Henry P, Thomas F, Benetos A, Guize L. Impaired fasting glucose, blood pressure and cardiovascular disease mortality. Hypertension. 2002;40(4):458–63.

    Article  CAS  PubMed  Google Scholar 

  8. Jordan J, Kurschat C, Reuter H. Arterial hypertension. Dtsch Arztebl Int. 2018;115(33–34):557–68.

    PubMed  PubMed Central  Google Scholar 

  9. Zhang Y, Yang H, Ren M, Wang R, Zhao F, Liu T, et al. Distribution of risk factors of hypertension patients in different age groups in Tianjin. BMC Public Health. 2021;21(1):247.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Li L, Gan Y, Zhou X, Jiang H, Zhao Y, Tian Q, et al. Insomnia and the risk of hypertension: a meta-analysis of prospective cohort studies. Sleep Med Rev. 2021;56:101403.

    Article  PubMed  Google Scholar 

  11. Morin CM, LeBlanc M, Daley M, Gregoire JP, Mérette C. Epidemiology of insomnia: prevalence, self-help treatments, consultations, and determinants of help-seeking behaviors. Sleep Med. 2006;7(2):123–30.

    Article  CAS  PubMed  Google Scholar 

  12. Stone KC, Taylor DJ, McCrae CS, Kalsekar A, Lichstein KL. Nonrestorative sleep. Sleep Med Rev. 2008;12(4):275–88.

    Article  PubMed  Google Scholar 

  13. American Academy of Sleep Medicine. International classification of Sleep Disorders. 3rd ed. Darien, IL: American Academy of Sleep Medicine; 2014.

    Google Scholar 

  14. Okamoto M, Kobayashi Y, Nakamura F, Musha T. Association between Nonrestorative Sleep and risk of diabetes: a cross-sectional study. Behav Sleep Med. 2017;15(6):483–90.

    Article  PubMed  Google Scholar 

  15. Zhang J, Lam SP, Li SX, Li AM, Wing YK. The longitudinal course and impact of non-restorative sleep: a five-year community-based follow-up study. Sleep Med. 2012;13(6):570–6.

    Article  PubMed  Google Scholar 

  16. Saitoh K, Yoshiike T, Kaneko Y, Utsumi T, Matsui K, Nagao K, et al. Associations of nonrestorative sleep and insomnia symptoms with incident depressive symptoms over 1–2 years: longitudinal results from the Hispanic Community Health Study/Study of Latinos and Sueño Ancillary Study. Depress Anxiety. 2022;39(5):419–28.

    Article  PubMed  Google Scholar 

  17. Leineweber C, Kecklund G, Janszky I, Akerstedt T, Orth-Gomér K. Poor sleep increases the prospective risk for recurrent events in middle-aged women with coronary disease. The Stockholm Female Coronary Risk Study. J Psychosom Res. 2003;54(2):121–7.

    Article  PubMed  Google Scholar 

  18. Turin TC, Okamura T, Afzal AR, Rumana N, Watanabe M, Higashiyama A, et al. Impact of hypertension on the lifetime risk of coronary heart disease. Hypertens Res. 2016;39(7):548–51.

    Article  PubMed  Google Scholar 

  19. Otsuka Y, Kaneita Y, Tanaka K, Itani O, Kaneko Y, Suzuki M, et al. Nonrestorative sleep is a risk factor for metabolic syndrome in the general japanese population. Diabetol Metab Syndr. 2023;15(1):26.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Zhang GQ, Cui L, Mueller R, Tao S, Kim M, Rueschman M, et al. The National Sleep Research Resource: towards a sleep data commons. J Am Med Inform Assoc. 2018;25(10):1351–8.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Redline S, Sotres-Alvarez D, Loredo J, Hall M, Patel SR, Ramos A, et al. Sleep-disordered breathing in Hispanic/Latino individuals of diverse backgrounds. The Hispanic Community Health Study/Study of Latinos. Am J Respir Crit Care Med. 2014;189(3):335–44.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Sorlie PD, Avilés-Santa LM, Wassertheil-Smoller S, Kaplan RC, Daviglus ML, Giachello AL, et al. Design and implementation of the Hispanic Community Health Study/Study of Latinos. Ann Epidemiol. 2010;20(8):629–41.

    Article  PubMed  PubMed Central  Google Scholar 

  23. LaVange LM, Kalsbeek WD, Sorlie PD, Avilés-Santa LM, Kaplan RC, Barnhart J, et al. Sample Design and Cohort Selection in the Hispanic Community Health Study/Study of Latinos. Ann Epidemiol. 2010;20(8):642–9.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Levine DW, Kripke DF, Kaplan RM, Lewis MA, Naughton MJ, Bowen DJ, et al. Reliability and validity of the women’s Health Initiative Insomnia Rating Scale. Psychol Assess. 2003;15(2):137–48.

    Article  PubMed  Google Scholar 

  25. Carroll JE, Irwin MR, Levine M, Seeman TE, Absher D, Assimes T, et al. Epigenetic aging and Immune Senescence in Women with insomnia symptoms: findings from the women’s Health Initiative Study. Biol Psychiatry. 2017;81(2):136–44.

    Article  PubMed  Google Scholar 

  26. World Health Organization.Global Physical Activity Questionnaire (GPAQ). Analysis Guide Geneva, Switzerland: World Health Organization; [cited 2022 August 16]. Available from: https://cdn.who.int/media/docs/default-source/ncds/ncd-surveillance/gpaq-analysis-guide.pdf?sfvrsn=1e83d571_2.

  27. Ware, J. E., Kosinski, M., Turner-Bowker, D. M., Gandek, B. How to score version 2 of the SF-12® health survey (with a supplement documenting version 1). Lincoln, RI: QualityMetric Incorporated. 2002.

  28. Cappuccio FP, D’Elia L, Strazzullo P, Miller MA. Sleep duration and all-cause mortality: a systematic review and meta-analysis of prospective studies. Sleep. 2010;33(5):585–92.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Amagai Y, Ishikawa S, Gotoh T, Doi Y, Kayaba K, Nakamura Y, et al. Sleep duration and mortality in Japan: the Jichi Medical School Cohort Study. J Epidemiol. 2004;14(4):124–8.

    Article  PubMed  Google Scholar 

  30. Andresen EM, Malmgren JA, Carter WB, Patrick DL. Screening for depression in well older adults: evaluation of a short form of the CES-D (center for epidemiologic Studies Depression Scale). Am J Prev Med. 1994;10(2):77–84.

    Article  CAS  PubMed  Google Scholar 

  31. González P, Nuñez A, Merz E, Brintz C, Weitzman O, Navas EL, et al. Measurement properties of the Center for epidemiologic Studies Depression Scale (CES-D 10): findings from HCHS/SOL. Psychol Assess. 2017;29(4):372–81.

    Article  PubMed  Google Scholar 

  32. National Institute for Health and Care Excellence. 2019 [Available from: https://www.nice.org.uk/guidance/ng136.

  33. Cheng P, Pillai V, Mengel H, Roth T, Drake CL. Sleep maintenance difficulties in insomnia are associated with increased incidence of hypertension. Sleep Health. 2015;1(1):50–4.

    Article  PubMed  Google Scholar 

  34. Phillips B, Bůzková P, Enright P. Insomnia did not predict incident hypertension in older adults in the cardiovascular health study. Sleep. 2009;32(1):65–72.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Phillips B, Mannino DM. Do insomnia complaints cause hypertension or cardiovascular disease? J Clin Sleep Med. 2007;3(5):489–94.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Sorlie PD, Allison MA, Avilés-Santa ML, Cai J, Daviglus ML, Howard AG, et al. Prevalence of hypertension, awareness, treatment, and control in the Hispanic Community Health Study/Study of Latinos. Am J Hypertens. 2014;27(6):793–800.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Hartz AJ, Daly JM, Kohatsu ND, Stromquist AM, Jogerst GJ, Kukoyi OA. Risk factors for Insomnia in a Rural Population. Ann Epidemiol. 2007;17(12):940–7.

    Article  PubMed  Google Scholar 

  38. Ohayon MM. Prevalence and correlates of nonrestorative sleep complaints. Arch Intern Med. 2005;165(1):35–41.

    Article  PubMed  Google Scholar 

  39. Ohayon MM, Partinen M. Insomnia and global sleep dissatisfaction in Finland. J Sleep Res. 2002;11(4):339–46.

    Article  PubMed  Google Scholar 

  40. Ohayon M. Epidemiological study on insomnia in the general population. Sleep. 1996;19(3 Suppl):7–15.

    Article  Google Scholar 

  41. Lewis PE, Emasealu OV, Rohrbeck P, Hu Z. Risk of type II diabetes and hypertension associated with chronic insomnia among active component, U.S. Armed Forces, 1998–2013. Msmr. 2014;21(10):6–13.

    PubMed  Google Scholar 

  42. Rod NH, Vahtera J, Westerlund H, Kivimaki M, Zins M, Goldberg M, et al. Sleep disturbances and cause-specific mortality: results from the GAZEL cohort study. Am J Epidemiol. 2011;173(3):300–9.

    Article  PubMed  Google Scholar 

  43. Zhang J, Lamers F, Hickie IB, He JP, Feig E, Merikangas KR. Differentiating nonrestorative sleep from nocturnal insomnia symptoms: demographic, clinical, inflammatory, and functional correlates. Sleep. 2013;36(5):671–9.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Cheung BM, Ong KL, Tso AW, Leung RY, Xu A, Cherny SS, et al. C-reactive protein as a predictor of hypertension in the Hong Kong Cardiovascular risk factor prevalence study (CRISPS) cohort. J Hum Hypertens. 2012;26(2):108–16.

    Article  CAS  PubMed  Google Scholar 

  45. Yasmin McEnieryCM, Wallace S, Mackenzie IS, Cockcroft JR, Wilkinson IB. C-reactive protein is associated with arterial stiffness in apparently healthy individuals. Arterioscler Thromb Vasc Biol. 2004;24(5):969–74.

    Article  CAS  PubMed  Google Scholar 

  46. Matthews KA, Chang Y, Kravitz HM, Bromberger JT, Owens JF, Buysse DJ, et al. Sleep and risk for high blood pressure and hypertension in midlife women: the SWAN (study of women’s Health across the Nation) Sleep Study. Sleep Med. 2014;15(2):203–8.

    Article  PubMed  Google Scholar 

  47. Branco J, Atalaia A, Paiva T. Sleep cycles and alpha-delta sleep in fibromyalgia syndrome. J Rheumatol. 1994;21(6):1113–7.

    CAS  PubMed  Google Scholar 

  48. Reckelhoff JF. Gender differences in the regulation of blood pressure. Hypertension. 2001;37(5):1199–208.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

The Hispanic Community Health Study/Study of Latinos (HCHS/SOL) was performed as a collaborative study supported by contracts from the National Heart, Lung, and Blood Institute (NHLBI) to the University of North Carolina (N01-HC65233), University of Miami (N01-HC65234), Albert Einstein College of Medicine (N01-HC65235), Northwestern University (N01-HC65236), and San Diego State University (N01-HC65237) (AG05407, AR35582, AG05394, AR35584, AR35583, AG08415). The National Sleep Research Resource was supported by the NHLBI (R24 HL114473, 75N92019R002). We thank Professors Makoto Uchiyama and Tetsuya Taniguchi for their helpful advice.

Funding

This work was funded by Ministry of Health, Labour and Welfare of Japan (19FA1009, 21FA1002). The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

  1. Department of Psychiatry, Nihon University School of Medicine, 30-1 Oyaguchi-kamicho, Itabashi-ku, Tokyo, 173-8610, Japan

    Kaori Saitoh, Yoshiyuki Kaneko, Rei Otsuki & Masahiro Suzuki

  2. Department of Sleep-Wake Disorders, National Institute of Mental Health, National Center of Neurology and Psychiatry, Tokyo, Japan

    Kaori Saitoh, Takuya Yoshiike, Yoshiyuki Kaneko, Tomohiro Utsumi, Kentaro Matsui, Kentaro Nagao, Aoi Kawamura, Rei Otsuki, Sayaka Aritake-Okada, Yoshitaka Kaneita, Kenichi Kuriyama & Masahiro Suzuki

  3. Fondation FondaMental, Créteil, France

    Kaori Saitoh

  4. Université Paris Est Créteil, INSERM U955, IMRB, Laboratoire Neuro-Psychiatrie translationnelle, Créteil, France

    Kaori Saitoh

  5. Department of Psychiatry, The Jikei University School of Medicine, Tokyo, Japan

    Tomohiro Utsumi

  6. Department of Clinical Laboratory, National Institute of Mental Health, National Center of Neurology and Psychiatry, Tokyo, Japan

    Kentaro Matsui

  7. Department of Psychiatry, Tokyo Women’s Medical University, Tokyo, Japan

    Kentaro Matsui

  8. Department of Psychiatry, National Center Hospital, National Center of Neurology and Psychiatry, Tokyo, Japan

    Kentaro Nagao & Kenichi Kuriyama

  9. Department of Psychiatry and Behavioral Sciences, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan

    Kentaro Nagao

  10. Division of Public Health, Department of Social Medicine, Nihon University School of Medicine, Tokyo, Japan

    Yuichiro Otsuka & Yoshitaka Kaneita

  11. Department of Health Sciences, Saitama Prefectural University, Saitama, Japan

    Sayaka Aritake-Okada

  12. Department of Psychiatry, Shiga University of Medical Science, Shiga, Japan

    Hiroshi Kadotani

Authors
  1. Kaori Saitoh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Takuya Yoshiike
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yoshiyuki Kaneko
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tomohiro Utsumi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kentaro Matsui
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Kentaro Nagao
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Aoi Kawamura
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Rei Otsuki
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Yuichiro Otsuka
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Sayaka Aritake-Okada
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Yoshitaka Kaneita
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Hiroshi Kadotani
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Kenichi Kuriyama
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Masahiro Suzuki
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Saitoh K, Suzuki M, Yoshiike T, and Kuriyama K conceptualized and designed research. Saitoh K, Yoshiike T, Kaneko Y, Utsumi T, Matsui K, Nagao K, Kawamura A, Otsuki R, Otsuka Y, Aritake-Okada S, Kaneita Y, Kadotani H, Kuriyama K, and Suzuki M analyzed or interpreted data. Saitoh K and Suzuki M drafted the original manuscript. Yoshiike T, Kaneko Y, Utsumi T, Matsui K, Nagao K, Kawamura A, Otsuki R, Otsuka R, Aritake-Okada S, Kaneita Y, Kadotani H, Kuriyama K made a critical revision of the manuscript for important intellectual content. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Masahiro Suzuki.

Ethics declarations

Ethics approval and consent to participate

The Institutional Review Boards of the study sites (San Diego State University, University of Miami, Albert Einstein College of Medicine, and University of Illinois at Chicago) and the Coordinating Center (University of North Carolina-Chapel Hill) each approved the study protocol. The study was conducted in accordance to the Declaration of Helsinki and all participants provided informed consent. This study was approved by the ethics committee of the National Center of Neurology and Psychiatry (A2020-012).

Consent for publication

Not applicable.

Competing interests

Dr. Saitoh reports personal fees from Yoshitomi Pharmaceutical and Eisai, outside the submitted work. Dr. Yoshiike reports personal fees from MSD and Takeda Pharmaceutical, outside the submitted work. Dr. Kaneko reports personal fees from Eisai, Meiji Seika Pharma, Otsuka Pharmaceutical, and Sumitomo Pharma, outside the submitted work. Dr. Utsumi reports speaker’s honorarium from Eisai, outside the submitted work. Dr. Matsui reports speaker’s bureau from Eisai, Meiji Seika Pharma, MSD, Otsuka Pharmaceutical, Yoshitomi Pharmaceutical, and Takeda Pharmaceutical, outside the submitted work. Dr. Nagao reports personal fees from Dainippon Sumitomo, Takeda Pharmaceutical, outside the submitted work. Dr. Kawamura reports speaker’s honorarium from Otsuka Pharmaceutical, outside the submitted work. Dr. Aritake-Okada reports personal fees from Idorsia Pharmaceutical Ltd and Philips, grants and personal fees from Takeda Pharmaceutical Co., and grants from Kao Corporation, outside the submitted work. Dr. Kadotani is associated with a laboratory that was supported by donations from Fukuda Lifetech Co., Ltd. And Fukuda Life Tech Keiji Co., Ltd., Tanaka Sleep Clinic, Akita Sleep Clinic, and Ai Care Co., Ltd. To Shiga University of Medical Science, outside the submitted work. Dr. Kadotani received grants from Merck Sharp and Dohme LLC/MSD K.K. (the Investigator-Initiated Studies Program), Eisai Co., Ltd., and SECOM Science and Technology Foundation, consulting fees from Takeda Pharmaceutical Co., Ltd., Aculys Pharma, Inc., and Seed Planning, Inc., speaker’s honorarium from Fukuda Life Tech Keiji Co., Ltd., Eisai Co., Ltd., Nobelpharma Co., Ltd., Ono Pharmaceutical CO., Ltd., and Takeda Pharmaceutical Co., Ltd., and honoraria for manuscript writing from Nipponrinshosha Co., Ltd., Iyaku-Joho-Kenkyujo,Inc. and the Yomiuri Shimbun, outside the submitted work. Dr. Kuriyama reports research grants from Otsuka Pharmaceutical, Mitsubishi Tanabe Pharma, and Pfizer, research grants and speaker’s honorarium from Meiji Seika Pharma, Eisai, MSD, Takeda Pharmaceutical, Tsumura, and Eli Lilly, and speaker’s honorarium from Yoshitomi Pharmaceutical and Sumitomo Pharma, outside the submitted work. Dr. Suzuki has received research grants from Mochida Pharmaceutical and Shionogi Pharma, research grants and speaker’s honorarium from EA Pharma, Eisai, Otsuka Pharmaceutical, Sumitomo Pharma and Takeda Pharmaceutical, and speaker’s honorarium from Meiji Seika Pharma, MSD, Viatris, and Yoshitomi Pharmaceutical, and payment for expert testimony from Mochida Pharmaceutical, outside the submitted work. All other authors report no financial relationships with any other commercial interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saitoh, K., Yoshiike, T., Kaneko, Y. et al. The effect of nonrestorative sleep on incident hypertension 1–2 years later among middle-aged Hispanics/Latinos. BMC Public Health 23, 1456 (2023). https://doi.org/10.1186/s12889-023-16368-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-023-16368-2

Keywords

BMC Public Health

ISSN: 1471-2458

Contact us