Skip to main content

Trends in age-specific varicella incidences following the introduction of the general recommendation for varicella immunization in Germany, 2006–2022

Abstract

Background

In Germany, general childhood varicella vaccination has been recommended since 2004. A feared effect of low vaccination coverage is a possible shift in incidence from children to teenagers and young adults who are at higher risk of severe outcomes. If true, this shift would possibly necessitate changes to the national immunization strategy.

We aimed to evaluate the effects of the general vaccination recommendation on age-specific varicella incidences in Germany in general and examine specifically whether a shift from children to teenagers (15 to 19 years) has occurred.

Methods

Trends in age-specific incidences were evaluated using triangulation with the following datasets: national mandatory notification data (N) (2014–2022), billing data of the statutory health insurance associations (I) (2009–2017) and data from a doctor's sentinel system (S) (2006–2017). Similar clinical case definitions were used in N and S, while I used ICD-10-codes. Age groups were stratified as available in all three systems. Incidences per year were calculated based on the total population (N), the number of statutory health insured (I), and extrapolated from S to the total population.

Results

During all years of observation, age-specific incidences have dropped significantly across all age-groups for S und I. The age groups (under 10 years) with initially highest incidences were the ones with the strongest reductions (under 1 year: -90%, 1–4 years: -95.5%, 5–9 years: -89.2% for S; -67.7%, -78%, -79.3% for I). A single 53.1% increase in the low incidence in S among 15–19-year olds observed in 2017 compared to 2016 could not be confirmed in N or I. Increases in incidences during the first two years of N are probably due to improved notification behaviour over these years. In 2019, all age-specific incidences increased (N), with 15 to 19-year olds showing the highest relative increase (28.2%).

Conclusions

Since the introduction of the general vaccine recommendation against varicella, incidences across all age-groups have declined significantly. Available data indicate no evidence for a shift in disease incidence to older age groups. Every incidence increase beyond childhood age should however be followed up closely. So far, children and adolescents have both benefitted from the current vaccination strategy.

Peer Review reports

Background

The clinical disease of varicella is the consequence of a primary infection with the varicella-zoster virus (VZV). In susceptible populations, it can cause significant morbidity and thus puts a considerable burden on countries´ health and economic systems. In countries of the western hemisphere young children under 10 years are mainly affected. However, an effective vaccination is available to limit this burden.

In Germany, the Standing Committee on Vaccination (STIKO) made a general recommendation for the vaccination of children in 2004, thus responding to several hundred thousand cases of varicella that occurred every year [1]. Five years later, the recommendation was further expanded and then envisaged two vaccinations, the first during the age of 11–14 months, the second during 15–23 months, nowadays at 11 and 15 months. Germany is one of the few countries worldwide that have added a general recommendation for VZV immunization to their national immunization schedule. Vaccination is voluntary and usually offered by the treating pediatrician or general practitioner. Costs for both vaccination and treatment are covered by the individual`s health insurance.” Vaccination coverage has reached 88.9% (85.1%) for the first (second) dose for 4 to 7-year-old children at school entry examination in 2020 [2].

One of the feared negative effects of VZV immunization in childhood—which might discourage other countries from adopting it—is the possible risk of a shift of disease burden from younger children towards teenagers and young adults [1]. This would be concerning as older individuals have a higher risk of a complicated disease course. This fear is based on the following reasoning: If coverage is not high enough to successfully limit virus circulation and grant herd immunity, the proportion of susceptible persons is growing and their first virus exposure may happen later in life. According to modelling results the threshold for herd immunity was calculated as >  = 80% population immunity for Germany [3].

Hitherto, no evaluation of the long-term effects of the general recommendation for VZV immunization on age-specific varicella incidences in Germany has been performed. We therefore aimed to:

  1. 1.

    describe trends in age-specific varicella incidences in Germany in general and

  2. 2.

    examine specifically whether a shift in absolute varicella incidence from younger ages towards teenagers (aged 15 to 19 years) has occurred,

following the introduction of the general recommendation for varicella immunization.

The results of this study are relevant as the aforementioned, possible rise in incidence and morbidity in teenagers and young adults might require either a modification of the current varicella vaccination schedule or increased efforts to improve the vaccine uptake according to the existing schedule.

Methods

Study design

This was a retrospective, observational study on the age-specific incidences of varicella in Germany from 2006 to 2022, with a specific focus on the age group of teenagers (15–19 years old).

Data sources

The analysis was done using a triangulation approach with the following three datasets:

  1. 1.

    A sentinel system for varicella, with data from 2006 to 2017 (S)

  2. 2.

    Physicians’ claims data on statutory health insured persons, with data 2009 to 2017 (I)

  3. 3.

    The countrywide statutory notification system, with data from 2014 to 2022 (N)

All three datasets comprise data on varicella incidence on a nationwide scale. The characteristics of each data source will be described in the following.

Varicella sentinel data (S)

After the addition of the varicella vaccine to the routine immunization scheme in Germany in 2004, there was a need to monitor the impact of the vaccination. As varicella was not a generally notifiable disease at that time, RKI decided to use a sentinel surveillance system to monitor varicella cases. The system consisted of 200–350 General practices (GP) (consisting of “Praktische Ärzte, Allgemeinärzte and hausärztlich tätige Internisten”) and between 350–500 pediatric practices (mean monthly numbers), depending on the year. Consistent data was collected from the beginning of 2005 to the end of 2017. Participation was voluntary and no financial incentives were provided. By design, the distribution of the sentinel practices resembled the distribution of all GP and pediatric practices throughout the country. Every month, all practices were asked to fill in a paper form with the cumulative number of varicella cases (including zero cases) that met the clinical case definition during the last month, with additional information on patient age (stratified into < 1, 1–4, 5–9, 10–14, 15–19 and >  = 20 years) along with the practice ID. This ID—which served as unique identifier—was linked to a separate database at the RKI which among others gave information on the type of practice (GP vs. pediatric) and the federal state where the practice was based at. Cases were counted as per practice. All practices were outpatient facilities. More detailed information on the Sentinel can be found in the literature [4, 5].

Statutory health insurance claims data (I)

In Germany, around 85% of the population are members of the statutory health insurance system, the other 15% having private health insurance. The statutory health insurance claims data are generated by all outpatient physicians (irrespective of specialization) that are registered with one of the 17 associations of statutory health insurance physicians (ASHIP) in Germany. There is one ASHIP per federal state, North Rhine-Westphalia being the exception with 2 ASHIP. In order to being reimbursed by the ASHIP, physicians electronically collect information on, among others, patient name, age, date of birth, gender, main diagnosis and diagnostic category for every consultation. This information is then sent electronically to the responsible ASHIP every quarter. The date of the consultation is not provided. This means that in terms of time, consultations can only be allocated to the respective quarter. In general, there are 4 different diagnostic categories that can be linked to a diagnosis, usually reflecting the diagnostic certainty. Those categories are “confirmed”, “suspicion of”, “recovered” and “ruled out” (“Gesichert”, “Verdacht auf”, “Zustand nach”, “Ausschluss”). Every ASHIP sent quarterly relevant patient related data in an anonymized form to a central database at the Robert Koch Institute which forms the National vaccination monitoring project. The project has been described in more detail by Rieck et al. in 2014 [6].

Countrywide notification system data (N)

Any person with suspected varicella as diagnosed by a physician or any person in whom a laboratory test has confirmed an acute varicella infection should be reported to the local health authorities. Reporting is mandatory according to Sects. 6 and 7 of the German Infection Protection Act. The presence of clinical symptoms that are typical for varicella (usually assessed by a doctor) with or without laboratory or epidemiological confirmation is needed in order to fulfill the reference definition for a varicella case. Thus, the reporting by physicians and laboratories is essential for the detection of varicella cases. All physicians involved with patient care (inpatient and outpatient) are obligated to report within 24 h starting from the initial clinical suspicion.

The countrywide notification system data was retrieved through the national notification database and case information on age (by full years), gender, reporting date (by month/year), reporting federal state and hospitalization were collected. As the countrywide notification of varicella was introduced in March 2013 and data for that year are incomplete, we only include cases from 2014 onwards.

More information on the German countrywide notification system can be found online (in German language) [7].

Estimation of age-specific varicella incidences

Extrapolation of varicella incidence from sentinel data (S)

The sentinel data provide the number of cases per month per participating practice. In order to estimate incidences for the whole population, we first calculated a monthly patient/practice index for every federal state. This index displays the number of varicella patients that have been diagnosed on average per sentinel practice in that given month and federal state. The method of using practice indices in order to estimate incidences has been described by Zoch-Lesniak et al. in 2018 [4]. Assuming that the sentinel practices are (in number of patients) representative of all practices in that federal state, we multiplied the patient/practice index with the total number of practices in that federal state. This was done for each practice category (GP vs. pediatric) separately. The information on the number of practices in each federal state per year was provided upon request by the German registry of physicians (“Deutsches Arztregister”). Thus, the total number of cases for each age stratum per month per federal state could be estimated. Subsequently, the estimated number of cases of all federal states were summed up per month, resulting in the estimated total monthly number of cases for the whole country. To calculate incidences, population data from the information system of the Federal Statistical Office were used [8].

As incidence calculation for the Sentinel data was based on the sample of participating physicians over the years, these incidences should rather be considered estimates that are accompanied by a certain degree of uncertainty, in contrast to the incidences derived from total population samples for the notification and insurance claims data.

Calculation of varicella incidence from statutory health insurance claims data (I)

Varicella diagnosis in this dataset was identified with the respective ICD-10 codes. As many patients with a diagnosis of varicella see several doctors or the same doctor more than once, several observations for each patient were anticipated. For this analysis, we only kept the first observation where a patient´s varicella diagnosis was classified as either confirmed (“gesichert”) or recovered (“Zustand nach”). To calculate incidences, we used data on all members of the statutory health insurance system, stratified by the mentioned age groups. For the age group from 0–14 years, membership numbers are collected for the whole group. No data on more detailed age strata within that group were available. As our calculations depend on the specific number of members for our age strata, we calculated the fraction of the insured aged 0–14 years in relation to the total population aged 0–14 years. Once that fraction was obtained, it was multiplied with the total population in our prespecified age strata (i.e. < 1, 1–4, 5–9, 10–14 years) in order to receive stratum specific number of members.

Calculation of varicella incidence using countrywide notification system data (N)

Here, no calculation needed to be performed as age-specific incidences are readily available and can be extracted from the national surveillance database [9].

Data management

For data management and calculation of incidences for Sentinel and notification data, Microsoft Excel Version 2010 and MS Access were used. Incidence calculation of insurance data, creation of tables, graphs and statistical tests were performed in R using RStudio (R Foundation for Statistical Computing and RStudio, Inc). For more adequate comparison with the statutory health insurance claims data, months within each year were stratified into quarters for the countrywide notification system data as well as the sentinel data. For better comparison with the sentinel data, both other datasets were age-stratified equivalent to the sentinel stratification (< 1, 1–4, 5–9, 10–14, 15–19 and >  = 20 years).

Data protection and ethical clearance

No new information on patients was gathered. All data analyzed had already been collected at the time the study had started. All data used had either already been anonymized before being sent to the RKI (Countrywide notification system data and statutory health insurance claims data) or were collected as anonymized, aggregated data (number of cases per month per practice, by age group) in case of the Sentinel data. The group size of each aggregated data unit was so big that it did not allow for inferences concerning any individual case included. Data for Sentinel and statutory health insurance claims data are not publicly available. Countrywide notification system data are readily available (Link: https://www.rki.de/EN/Content/infections/epidemiology/SurvStat/survstat_node.html). Informed consent and ethical committee clearance had already been attained for the Sentinel and statutory health insurance claims data before those data were collected. The procedure of the sentinel study and the submission of anonymized sentinel data was proved and permitted by the Federal Data Protection Commissioner and proved by the Ethics Committee of Charité Berlin. For the statutory health insurance claims data, the transmission of data for the purpose of analysis over longer periods of time from the health insurance companies to federal and state health reporting institutions like the RKI is legitimized by the Social Security Code V (SGB V), which came into force in 2003.

Results

As can be seen in Fig. 1, both Sentinel and insurance claims data show a clear reduction of overall varicella incidence since the beginning of data collection in 2006 and 2009, respectively. This decrease in case numbers could be observed for all pediatric age groups as well as adults above 20 years, throughout almost all years under observation. All incidences in N were constantly below the incidences in S an I in the years 2014 to 2017.

Fig. 1
figure 1

Age-specific varicella incidences (cases/100,000) by year and age group, 2006-2022 , Germany

The age groups up to 9 years which showed the highest incidence at the beginning were the ones with the strongest subsequent absolute and relative reductions, with decreases in case numbers ranging from fourfold to more than 20-fold (Tables 1 and 2). A decrease in incidence could be described in the first years following the introduction of the vaccination recommendation, also in those age groups that were not included in the above recommendation.

Table 1 Age-specific varicella incidences (cases/100.000) and relative changes per year, Sentinel data, 2006–2017, Germany
Table 2 Age-specific varicella incidences (cases/100.000) and relative changes per year, Insurance claims data, 2009–2017, Germany

A rise in total varicella incidence in 2015 and 2016 for N could not be observed in S and I. While incidences for N undulated during 2017 and 2018, a rise in incidence in all age groups occurred in 2019 (Table 3). It should be noted that all age specific incidences calculated by N started and remained below the values that were calculated by sentinel or billing data in the first years of the study period.

Table 3 Age-specific varicella incidences (cases/100.000) and relative changes per year, Mandatory notification data, 2014–2022, Germany

For teenagers from 15 to 19 years of age, incidence decreased initially followed by a stable trend undulating between incidences of 35 to 50/100.000 since 2012 (S) and between 97 to 103 since 2011 (I), respectively. An increase from 39.2 in 2016 to 60.0 in 2017 in the Sentinel data could not be observed in the other two datasets. While the notification data showed a general increase in case numbers in 2019 for all ages, incidence for the age group from 15 to 19 had the biggest relative increase of 28.2% (From 20.7 in 2018 to 26.4 in 2019) (Tables 1, 2 and 3).

In 2020 and 2021, all age-specific incidences decreased significantly, most likely as a consequence of the introduction of non-pharmaceutical interventions during the COVID-19 pandemic.

Discussion

As our results show, age-specific varicella incidences in Germany have dropped significantly since the introduction of the general recommendations for a varicella childhood vaccination in 2004 and 2009.

This incidence reduction has been most pronounced in the age groups younger than 10 years that comprised the highest proportion of susceptible individuals and thus disease burden. In this respect, the general recommendations for vaccination have reached the envisaged goal of reducing the then high varicella morbidity in Germany.

Moreover, the drop in incidence was not limited to vaccinated age groups only but also included infants, older children, adolescents and adults, possibly due to less circulation of the virus and thus lower infection pressure in the community. This observation illustrates an additional positive effect of an improving, vaccine-induced herd-immunity, namely a reduced risk of infection for vulnerable population groups that might not be eligible for (catch-up) vaccination themselves (e.g. premature infants, immunocompromised, pregnant women).

The fact that the decline in incidences was most pronounced during the first years after introduction of the general recommendation might be explained by its rapidly improving implementation during that time period: while less than 50% of school-aged children had received the 1st vaccine dose in 2009, this number had risen to over 80% by 2014. Since then, vaccination coverage increased only moderately [2].

The initial rise in overall incidence in N during the first two years after varicella had become a notifiable disease might be due to an improving notification behavior by physicians over the years. However, it should be noted that these rises were not proportionally distributed across all age groups and that a rise across all age groups was also observed in 2019, even though incidences had been relatively stable for the two years prior. The development in 2019 thus warrants further close observation.

The rise in incidence in the sentinel data for 15–19-year olds in 2017 could not be observed in the same year or the year thereafter in the other two datasets.

Although we found rising incidences for nearly all age groups in 2019, the age group of the 15 to 19-year olds showed the highest relative rise of more than 28%. Whether this signal represents a true, beginning trend could not be determined as varicella incidences for all age groups dropped significantly in 2020 and 2021, most likely due to nonpharmaceutical interventions in conjunction with the COVID-19 pandemic However, we would like to emphasize that the discussed incidences in this age-group in 2017 (S) and 2019 (N) were still significantly below those observed in the initial years following the introduction of the vaccine recommendation.

As a consequence, we did not find convincing evidence that a shift of age-specific incidences from younger age groups to teenagers has taken place in Germany or that incidences in older age groups had started to rise.

Our findings match well with the published literature where none of the countries that have introduced a general recommendation for a varicella vaccine has observed subsequent significant rises of age-specific incidences in teenagers and (young) adults. In the US, where a general vaccination recommendation has existed since 1995, a decrease of age-specific disease incidences could be repeatedly shown for all age groups [10, 11]. Similar results were reported by Canada, Italy and Australia where reduced hospitalization rates due to varicella among adults were observed [12,13,14] following the introduction of varicella vaccination. In Turkey, where a single-dose regimen was introduced in 2013, incidences decreased in children between 6 and 17 years and remained largely unchanged in the population aged > 17 years [15]. A recently published systematic review could neither find any evidence in favor of a shift of disease burden towards older age groups [16].

Limitations

Calculation of incidences for the insurance claims data only included those 85% of the German population that are members of the statutory health insurance system. We are not aware that age-specific varicella incidences in the 15% of privately insured subjects are significantly different from the rest of the population and even if this was the case, this should not significantly distort trends over time.

Concerning the sentinel data, a central assumption preceding the calculation of total incidence rates from the dataset was that the sentinel practices are representative in terms of patient size and geographic distribution of all practices in the federal states. Both aspects were considered during the sentinel design, but a previous internal evaluation suggested that average practice size of sentinel participants was slightly higher than the countrywide average, possibly leading to an overestimation of case numbers. However, we do not believe that this overly affected trends for age-specific incidences over the years.

A limitation that is common to all datasets is possible misclassification of zoster cases as varicella during the notification or reporting process. Given that age-specific incidences in our datasets constantly drop from younger to older adults, we do not believe that this issue had relevant effects on our results.

As our data show, incidences for N consistently were below those for S and I during those years where data was available for all datasets, suggesting a level of underreporting for N. Although such underreporting is known for mandatory reporting systems, we believe that age-specific trends in disease incidence would still be detected by the varicella notification system if they occurred in the future.

Conclusion

Varicella incidence considerably decreased in all age groups in the first years following the general recommendation of varicella childhood vaccination until a plateau was reached. We did not find a relevant rise in age-specific varicella incidence thereafter, especially not among teenagers. The relative rise in this age group in 2019 illustrates the need for continuous disease monitoring through a well-equipped national surveillance system.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Robert Koch Institute. Zur Varizellenimpfung. Epid Bull. 2004;49:421–5.

    Google Scholar 

  2. Rieck T, Feig M, Siedler A. Impfquoten von Kinderschutzimpfungen in Deutschland – aktuelle Ergebnisse aus der RKI-Impfsurveillance. Epid Bull. 2022;48:3–25. https://doi.org/10.25646/10838.

    Article  Google Scholar 

  3. Nardone A, de Ory F, Carton M, Cohen D, van Damme P, Davidkin I, et al. The comparative sero-epidemiology of varicella zoster virus in 11 countries in the European region. Vaccine. 2007;25(45):7866–72.

    Article  CAS  PubMed  Google Scholar 

  4. Zoch-Lesniak B, Tolksdorf K, Siedler A. Trends in herpes zoster epidemiology in Germany based on primary care sentinel surveillance data, 2005–2016. Hum Vaccines Immunother. 2018;14(7):1807–14.

    Article  Google Scholar 

  5. Robert Koch Institute. AGM/V: Masern-Sentinel (AGM) wird durch Sentinel der Varizellen ergänzt. Epid Bull. 2005;13:111–2.

    Google Scholar 

  6. Rieck T, Feig M, Eckmanns T, Benzler J, Siedler A, Wichmann O. Vaccination coverage among children in Germany estimated by analysis of health insurance claims data. Hum Vaccines Immunother. 2014;10(2):476–84.

    Article  Google Scholar 

  7. Robert Koch Institute. Infektionsepidemiologisches Jahrbuch für 2018. Available from: https://www.rki.de/DE/Content/Infekt/Jahrbuch/Jahrbuch_2018.pdf?__blob=publicationFile.

  8. Die Datenbank des Statistischen Bundesamtes. Available from: https://www-genesis.destatis.de/genesis//online/data?operation=ergebnistabelleAnzeigen&index=0&levelindex=0&levelid=1572543673941.

  9. SurvStat@RKI 2.0. Available from: https://survstat.rki.de/.

  10. Seward JF, Watson BM, Peterson CL, Mascola L, Pelosi JW, Zhang JX, et al. Varicella disease after introduction of varicella vaccine in the United States, 1995–2000. JAMA. 2002;287(5):606–11.

    Article  PubMed  Google Scholar 

  11. Lopez AS, Zhang J, Marin M. Epidemiology of varicella during the 2-dose varicella vaccination program - United States, 2005–2014. MMWR Morb Mortal Wkly Rep. 2016;65(34):902–5.

    Article  PubMed  Google Scholar 

  12. Waye A, Jacobs P, Tan B. The impact of the universal infant varicella immunization strategy on Canadian varicella-related hospitalization rates. Vaccine. 2013;31(42):4744–8.

    Article  PubMed  Google Scholar 

  13. Heywood AE, Wang H, Macartney KK, McIntyre P. Varicella and herpes zoster hospitalizations before and after implementation of one-dose varicella vaccination in Australia: an ecological study. Bull World Health Organ. 2014;92(8):593–604.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Boccalini S, Bonanni P, Bechini A. Preparing to introduce  the varicella vaccine into the Italian immunisation programme: varicella-related hospitalisations in Tuscany, 2004–2012. Euro Surveill Bull Eur Sur Mal Transm Eur Commun Dis Bull. 2016;21(24). https://www.eurosurveillance.org/content/10.2807/1560-7917.ES.2016.21.24.30257.

  15. Soysal A, Gönüllü E, Yıldız İ, Karaböcüoğlu M. Incidence of varicella and herpes zoster after inclusion of varicella vaccine in national immunization schedule in Turkey: time trend study. Hum Vaccines Immunother. 2021;17(3):731–7.

    Article  Google Scholar 

  16. Varela FH, Pinto LA, Scotta MC. Global impact of varicella vaccination programs. Hum Vaccines Immunother. 2019;15(3):645–57.

    Article  Google Scholar 

Download references

Acknowledgements

We thank Thorsten Rieck for his support to extract datasets relevant for the project from the database of the National vaccination monitoring project as well as Achim Dörre for his statistical assistance and critical review of the manuscript.

Funding

Open Access funding enabled and organized by Projekt DEAL. The author(s) received no financial support for the research, authorship, and/or publication of this article.

Author information

Authors and Affiliations

Authors

Contributions

AS conceived the idea for the study, made all used datasets available, gave critical input during the analysis stages, critically reviewed and further edited the manuscript. FM compiled all datasets, performed the statistical analysis and drafted the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Felix Moek.

Ethics declarations

Ethics approval and consent to participate

No new information on patients was gathered. All data analyzed had already been collected at the time the study had started. All data used had either already been pseudonymized before being sent to the RKI (Countrywide notification system data and statutory health insurance claims data) or were collected as aggregated data (number of cases per month per practice, by age group) in case of the Sentinel data. The group size of each aggregated data unit was so big that it did not allow for inferences concerning any individual case included. Informed consent and ethical committee clearance had already been attained for the Sentinel and statutory health insurance claims data before those data were collected.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Moek, F., Siedler, A. Trends in age-specific varicella incidences following the introduction of the general recommendation for varicella immunization in Germany, 2006–2022. BMC Public Health 23, 2191 (2023). https://doi.org/10.1186/s12889-023-17098-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-023-17098-1

Keywords