Skip to main content
  • Research article
  • Open access
  • Published:

Overview of systematic reviews on the health-related effects of government tobacco control policies

Abstract

Background

Government interventions are critical to addressing the global tobacco epidemic, a major public health problem that continues to deepen. We systematically synthesize research evidence on the effectiveness of government tobacco control policies promoted by the Framework Convention on Tobacco Control (FCTC), supporting the implementation of this international treaty on the tenth anniversary of it entering into force.

Methods

An overview of systematic reviews was prepared through systematic searches of five electronic databases, published up to March 2014. Additional reviews were retrieved from monthly updates until August 2014, consultations with tobacco control experts and a targeted search for reviews on mass media interventions. Reviews were assessed according to predefined inclusion criteria, and ratings of methodological quality were either extracted from source databases or independently scored.

Results

Of 612 reviews retrieved, 45 reviews met the inclusion criteria and 14 more were identified from monthly updates, expert consultations and a targeted search, resulting in 59 included reviews summarizing over 1150 primary studies. The 38 strong and moderate quality reviews published since 2000 were prioritized in the qualitative synthesis. Protecting people from tobacco smoke was the most strongly supported government intervention, with smoke-free policies associated with decreased smoking behaviour, secondhand smoke exposure and adverse health outcomes. Raising taxes on tobacco products also consistently demonstrated reductions in smoking behaviour. Tobacco product packaging interventions and anti-tobacco mass media campaigns may decrease smoking behaviour, with the latter likely an important part of larger multicomponent programs. Financial interventions for smoking cessation are most effective when targeted at smokers to reduce the cost of cessation products, but incentivizing quitting may be effective as well. Although the findings for bans on tobacco advertising were inconclusive, other evidence suggests they remain an important intervention.

Conclusion

When designing and implementing tobacco control programs, governments should prioritize smoking bans and price increases of tobacco products followed by other interventions. Additional studies are needed on the various factors that can influence a policy’s effectiveness and feasibility such as cost, local context, political barriers and implementation strategies.

Peer Review reports

Background

The global tobacco epidemic is a major public health problem that continues to deepen, with nearly 1 billion smokers worldwide in 2012 [1]. It is the leading cause of preventable death, resulting in approximately 6 million unnecessary deaths per year [2, 3]. Cigarettes will kill half their current users through conditions such as cardiovascular disease, respiratory conditions and cancers, and mortality from smoking is expected to increase to an estimated 8 million people per year by 2030 [3]. Secondhand smoke (SHS) is a significant concern as well: more than 600,000 of the total annual deaths from smoking are due to SHS exposure [2].

The year 2015 marks the tenth anniversary since the World Health Organization (WHO) Framework Convention on Tobacco Control (FCTC) came into force, the first international treaty specially adopted through WHO. This instrument aims to reduce tobacco consumption and protect all people from tobacco exposure through provisions that direct countries to implement tobacco control programs [4]. To guide countries in this process, WHO introduced the six MPOWER measures (Table 1), each of which corresponds to one or more FCTC provisions [5]. The 180 parties to the FCTC (as of May 2015) are all mandated to take action [6]. However, the bi-annual reports that ratifying countries must submit show uneven progress [7].

Table 1 MPOWER measures

The aim of this systematic overview of systematic reviews is to take stock of the global research evidence base in this decennial year about the likely health effects of different government tobacco control policies. This provides policymakers with an evidence-based resource to help with policy deliberations and decision-making on setting priorities for national FCTC implementation [8]. Systematic reviews aim to identify, assess and synthesize all available primary evidence on a research question, and use an objective, optimized and structured methodology to maximize transparency and minimize bias. Overviews of systematic reviews build on the strengths of individual reviews and add breadth by integrating the findings of many reviews together.

Methods

Relevant systematic reviews were identified through systematic searches of the electronic databases Health Evidence for research on public health and health promotion, Health Systems Evidence for research on health systems, Rx for Change for research on behaviour-change interventions, Cochrane Database of Systematic Reviews for research on healthcare and health policy, and Database of Abstracts of Reviews of Effects for research on healthcare and health services delivery, published up to March 2014. These databases are continuously updated and together represent the leading repositories of health-related systematic reviews. For Health Evidence, the search term “tobacco use” was entered; for other databases, “tobacco” was entered. This search strategy was designed to be very broad and capture as many systematic reviews related to tobacco use as possible. Relevant reviews in monthly updates from Health Evidence, Health Systems Evidence and the Quebec Public Health Research Network were included as well up to August 2014. Two tobacco control experts known to the authors were also consulted to identify any reviews missed by the systematic searches. An additional targeted search for systematic reviews on mass media campaigns was conducted in May 2015 in response to peer review feedback.

The present overview includes systematic reviews evaluating government tobacco control policies. Reviews that did not follow a systematic methodology and other overviews of systematic reviews were not included; the latter’s references were scanned to identify reviews for inclusion. The MPOWER components were used as an organizing framework to classify the interventions. Clinical interventions, such as pharmacologic therapy and counselling services, were not included. Reviews on multicomponent programs were excluded if the effects of individual interventions were not independently studied or could not be differentiated. Outcome measures relating to tobacco use, SHS exposure and primary health outcomes were considered. Tobacco use outcomes include smoking prevalence, quantity of cigarettes consumed, smoking cessation and smoking initiation. SHS exposure outcomes include both self-reported and biomarker-validated measures of exposure. Health outcomes include hospital admissions and risk of any adverse medical event. Measures that did not directly assess change in smokers, such as recall of media campaigns and perceptions of smoking, were not included. Reviews were not excluded on the basis of language.

Titles and abstracts were assessed to identify reviews for inclusion. The full texts were then read to confirm inclusion. The following data from selected studies were abstracted into a summary table: number of studies included, year of last search and key findings. The quality ratings given to each review by their source databases were extracted as well. Health Evidence uses an independent quality assessment tool specific for public health intervention literature [9]. Total scores can range from 0 to 10, based on which a quality rating is assigned: “strong” (8 to 10), “moderate” (5 to 7) or “weak” (4 or less). Health Systems Evidence and Rx for Change use the AMSTAR tool, which evaluates the quality of systematic reviews and meta-analyses by 11 quality criteria [1012]. Reviews with scores from 9 to 11 are rated as “high,” from 5 to 8 as “medium,” and from 0 to 4 as “low.” For this overview, the “strong,” “moderate” and “weak” terminology was used for AMSTAR to maintain consistency with Health Evidence. Cochrane Database of Systematic Reviews does not provide ratings and Database of Abstracts of Reviews of Effects offers a descriptive quality assessment [13]. A quality assessment was independently performed using the AMSTAR tool for reviews without a numerical quality rating. Strong and moderate quality reviews published since 2000 were prioritized in the qualitative synthesis.

Results

Six hundred and twelve reviews were identified through the search strategy. Screening titles and abstracts yielded 67 reviews that possibly met the inclusion criteria. Two reviewers screened the full-text of reviews and confirmed 45 met the inclusion criteria. Any conflicts were resolved by discussion between the two reviewers and a third reviewer was consulted when required. Four additional reviews for inclusion were identified from monthly updates, nine were identified by tobacco control experts and one was identified from the targeted search for reviews on mass media campaigns. In total, 59 reviews were included that together summarized over 1150 primary studies (see Fig. 1) [1472].Footnote 1 The 22 reviews excluded after full-text screening either evaluated excluded outcome measures (n = 1) [73], were overviews of systematic reviews (n = 3) [7476], did not follow a systematic methodology (n = 1) [77], only reported results of multicomponent programs (n = 4) [7881], did not adequately describe what interventions were evaluated (n = 2) [82, 83], or were not relevant for assessing government tobacco control policies (n = 11) [8494]. Findings from the 38 reviews that were either strong or moderate quality and published since 2000 are presented here (see Fig. 2) [1451]. A Web Appendix contains individualized summaries of these reviews as well as the lower quality and older reviews (see Additional file 1) [5272].

Fig. 1
figure 1

Process of review selection

Fig. 2
figure 2

Overview of results from strong and moderate quality systematic reviews published since 2000. A green square indicates the review found the intervention had a beneficial effect on the outcome measure. A yellow square indicates the review found an unclear or conditional effect. A red square indicates the review found the intervention had no effect. Thomas et al. 2008 could not be included in this table under “Protect people from tobacco smoke” since it looked at the effect of smoking bans on social inequalities in smoking; it did not evaluate their overall impact or the conditions under which they are effective. Kohler & Minkner 2014 conducted a review of state smoke-free laws and petitions, initiatives and referendums to protect non-smokers in Germany, finding 56 laws and amendments and 15 initiatives. HE = Health Evidence; HSE = Health Systems Evidence; RC = Rx for Change

Protect people from tobacco smoke

Twelve reviews summarize the health-related effects of smoking bans and restrictions in public spaces, workplaces or residences. Three are strong in quality [1416], eight are moderate [1724] and one is rated as moderate by HE and as strong by HSE [25]. Overall, most of the eight reviews on smoking behaviour reported reductions in smoking prevalence and cigarette consumption and increases in smoking cessation [14, 15, 1719, 21, 24, 25]. Hopkins et al. found that workplace smoke-free policies lead to an absolute reduction in smoking prevalence of 3.4 % (interquartile range (IQR) = −6.3 to −1.4), reduced cigarette consumption by 2.2 cigarettes per day (IQR = −1.7 to −3.3), increased quit attempts by 4.1 % (IQR = −0.7 to 6.8) and increased successful cessation by 6.4 % (IQR = 2.0 to 9.7) [15]. Three reviews found inconsistent evidence for smoking prevalence or cessation, but reported improvements in other smoking behaviour outcomes [14, 18, 21]. Thomas et al. looked at the effect of smoking bans on social inequalities in smoking [19] and Kohler and Minkner reviewed the conditions under which state smoking bans are effective [24], but neither assessed their overall efficacy. Three reviews investigating SHS all reported reductions in SHS exposure with smoke-free policies, in both adults and children and across various settings including workplaces, public spaces and hospitality establishments [14, 21, 25]. Similarly, all six reviews investigating primary health outcomes found decreases in adverse events [16, 2023, 25]. Tan and Glantz looked at hospital admissions data and found a reduced risk of admission for coronary events (relative risk (RR) = 0.85, 95 % confidence interval (CI) = 0.82 to 0.88), other heart diseases (RR = 0.61, 95 % CI = 0.44 to 0.85), cerebrovascular accidents (RR = 0.81, 95 % CI = 0.70 to 0.94) and respiratory diseases (RR = 0.76, 95 % CI = 0.68 to 0.85) with smoke-free policies [22]. The reductions were greatest with comprehensive policies that banned smoking in workplaces, restaurants and bars. Therefore, there is very strong evidence that smoke-free legislation reduces smoking behaviour, exposure to SHS and adverse health outcomes.

Offer help to quit tobacco use

Twelve reviews present research evidence on the effect of financial assistance or incentives for smokers to quit smoking and for healthcare professionals to provide smoking cessation interventions.Footnote 2 Eight are strong in quality [14, 2632] and four are moderate [3336]. Financial interventions appear to have different effects depending on whether they are incentives to quit smoking or assistance to lower the cost of cessation therapies, and whether they target smokers or healthcare providers. Two reviews investigated smoker-directed financial assistance and found increased uptake of cessation therapies and greater levels of smoking cessation [14, 28]. The effect of incentives and competitions for smokers is less clear, with four reviews reporting increased cessation [3032, 35] and four reviews finding an unclear or no effect [26, 27, 29, 33]. Giles et al. [31] and Cahill and Lancaster [32] found that smokers offered incentives were 2.48 times (95 % CI = 1.77 to 3.46) and 1.60 times (95 % CI = 1.12 to 2.30) more likely to quit smoking, respectively. In pregnant women, Likis et al. reported that financial incentives increased smoking cessation and were the most important component of multicomponent programs that promote cessation [30]. Conversely, Cahill and Perera found no effect of incentives on long-term quit rates [27], and a separate review by the same authors estimated that community “quit-and-win” contests lead to fewer than one in 500 smokers quitting smoking [26]. The three reviews that looked at provider-directed financial interventions found no effect on smoking abstinence and prevalence in patients [28, 34, 36]. Financial interventions may thus be more effective for smoking cessation when they are targeted to make cessation therapies more affordable, but incentivizing quitting may be effective as well. They do not appear to influence smoking behaviour when directed at healthcare professionals.

Warn about the dangers of tobacco

Three reviews contained evidence on the effects of health warning labels or plain packaging on tobacco products. All three are moderate in quality [19, 21, 37]. Two reviews found health warning labels decrease smoking behaviour, reporting reductions in tobacco use and increases in motivation to quit, quitting likelihood and likelihood of abstinence after quitting [21, 37]. Thomas et al. found no effect [19]. Among seven reviews assessing mass media campaigns, four are strong in quality [14, 3840] and three are moderate [21, 41, 42]. Five reviews looked at media campaigns as part of comprehensive tobacco control programs and four reported reductions in smoking behaviour [14, 21, 38, 41]. Bala et al. showed inconsistent effects and raised concerns about the quality of the evidence [40]. An update to this review found strong evidence that mass media campaigns, within the context of multicomponent programs, promote cessation and reduce smoking prevalence [41]. This updated review identified several features of effective campaigns: wide population reach, high intensity, long duration, use of television and messages on the negative health effects of smoking [41]. The remaining systematic reviews focused on mass media campaigns in subpopulations. Guillaumier et al. found insufficient evidence for their effect on smokers of low socioeconomic status [42], while Brinn et al. [39] reported inconsistent evidence for their effect on young people. Therefore, the evidence suggests that interventions cautioning people about tobacco’s harms may be effective strategies, with mass media campaigns being potentially important parts of multicomponent programs.

Enforce bans on tobacco advertising, promotion and sponsorship

Four reviews present research evidence on the health-related effects of tobacco advertising bans and restrictions, all of which are moderate in quality [19, 21, 43, 44]. None of the reviews found clear reductions in smoking behaviour, with Quentin et al. reporting inconsistent effects [43] and Capella et al. showing no reduction in cigarette consumption [44]. Although Mozaffarian et al. did not report any direct effects, this review postulated that advertising restrictions should decrease smoking behaviour based on the well-established association between advertisements and tobacco use [21]. Indeed, individual studies have demonstrated that tobacco marketing and cigarette use in movies alter adolescents’ attitudes and susceptibilities to smoking, which in turn places them at risk of initiating cigarette use and continuing this behaviour into adulthood [9599]. Although systematic reviews have not conclusively shown that banning tobacco marketing is an effective tobacco control measure, substantial evidence exists on the harmful consequences of unregulated advertising on smoking behaviour.

In addition, there are individual studies that support the effectiveness of these interventions. Saffer and Chaloupka looked at 22 OECD countries and showed that comprehensive advertising bans reduce tobacco consumption, but that limited advertising bans—where other avenues of promotion are still available to companies—do not reduce tobacco consumption [100]. An analogous study by Blecher that included the OECD countries as well as 30 developing countries had similar findings [101]. A sub-analysis of the developing countries showed that both comprehensive and limited bans reduced smoking in these countries, with comprehensive bans having greater effects [101]. The scope of advertising restrictions and how they are enforced may therefore be critical factors in their effectiveness.

Raise taxes on tobacco

Among the six reviews evaluating tobacco price increases, one is high in quality [14] and five are moderate [19, 21, 4547]. All but one of the reviews found that increasing the price of tobacco reduces smoking behaviour, with decreases in cigarette consumption and smoking prevalence and increases in smoking cessation. Hopkins et al. combined seven studies that estimated price elasticities of demand and found that every 10 % increase in cigarette prices decreased smoking prevalence and cigarette consumption by 3.7 and 2.3 %, respectively [14]. Price increases appear to be most effective among adolescents, young adults and persons of low socioeconomic status [19, 45, 46]. Rice et al. reported negative price elasticities for smoking participation, prevalence, consumption and initiation, and greater smoking cessation in youths with price increases [46]. However, Guindon found inconclusive results on the effect of tobacco price increases on smoking initiation [47]. Overall the evidence indicates increasing the price of tobacco products is a very important intervention for tobacco control.

Restrict sales to minors

Five reviews summarize the health-related effects of restricting youth access to tobacco products, all of which are moderate in quality [19, 4851]. This intervention is not part of MPOWER but is promoted in the FCTC under Article 16 (“prohibiting sales to and by minors”). Across the systematic reviews there was no consistent effect found for youth access interventions on smoking behaviour. Fichtenberg and Glantz showed that such restrictions do not reduce smoking prevalence among teens, even with high compliance among cigarette merchants [48]. However, DiFranza reported that banning the sale of tobacco products to minors is effective in decreasing youth smoking, but only if the restrictions are strongly enforced [51]. The three remaining reviews found inconsistent evidence [19, 49, 50]. The literature on youth access interventions is thus inconclusive; restrictions, if they are effective, appear to depend on robust enforcement.

Discussion

Principal findings

This systematic overview of systematic reviews summarizes the research evidence on the likely health-related effects of government tobacco control policies promoted in the FCTC, identifying gaps in the literature and providing a framework for policy deliberations and future research. It includes 59 systematic reviews, encompassing more than 1150 individual studies.

Among the government tobacco control policies identified, protecting people from tobacco smoke through smoking bans and price increases of tobacco products have the strongest evidence of effectiveness. Smoke-free policies were consistently associated with reductions in smoking behaviour, SHS exposure and adverse health outcomes. Their success has been demonstrated in diverse settings. Robust evidence was similarly found for raising tobacco prices, such as through taxation, with decreases in smoking behaviour found by five reviews. The cumulative evidence from this overview suggests that smoke-free policies and tobacco taxation may be the two most important interventions promoted by the FCTC and should be prioritized by governments when developing their tobacco control programs.

Positive results were also found for warning people about the dangers of tobacco through mass media campaigns and cigarette packaging interventions, with the former likely being integral parts of multicomponent programs. Financial assistance reducing the costs of smoking cessation interventions and financial incentives may be effective strategies; the effect of provider-directed interventions is less clear. Limited evidence was found for advertising restrictions, but evidence on how advertisements influence smoking behaviour, the substantial investments that cigarette companies have made to promote their products and individual studies demonstrating their effectiveness all suggest these interventions remain important. No reviews were identified for monitoring tobacco use and prevention policies, indicating a need for research syntheses on their effectiveness.

Although this overview assesses the effectiveness of individual government tobacco control policies, countries should implement comprehensive programs that contain two or more FCTC provisions and that are tailored specifically to their national situations. Such multicomponent programs are the most effective approach to tobacco control, with policies acting synergistically when enacted together [102, 103]. While greater research evidence exists for certain interventions, all tobacco control measures under the FCTC are important and should ideally be implemented concurrently. However, it is often not possible for countries to dedicate equal resources to each policy or to introduce them simultaneously. The 2014 Global Progress Report showed variability in implementation rates across FCTC provisions, with over 90 % of parties reporting to have prioritized one or more areas of the treaty over others [104]. Lack of financial, human, research and political resources were also identified as barriers to full implementation [104]. Thus, while countries would ideally implement all tobacco control policies concurrently, regulations that ban smoking and increase tobacco product prices should be prioritized in situations where resources are constrained. The other FCTC provisions can then further strengthen and work synergistically with these priority policies. This will help promote an evidence-based prioritization of policies and maximize the likelihood that limited resources will be allocated to those measures most likely to protect people from the harmful effects of tobacco.

Strengths and limitations

This overview has several methodological strengths. First, prioritizing systematic reviews allowed a huge body of research evidence to be synthesized—over 1150 studies—covering a wide variety of interventions, outcomes, conditions and populations in a single analysis. Second, a systematic and transparent search protocol was implemented, minimizing bias while ensuring that as many systematic reviews evaluating government tobacco control policies as possible were identified and assessed for inclusion. Third, the quality of each systematic review was considered, with quality ratings either extracted from source databases or independently scored. These quality ratings were then used, along with the date of publication, to prioritize included reviews, maximizing confidence in the resulting analyses as a good starting point for decision-making.

This overview also has several limitations. First, searches were restricted to the five leading databases of systematic reviews; unpublished reviews will have been missed. Furthermore, many disciplines have different approaches to literature reviews that place less emphasis on describing the search strategy and inclusion/exclusion criteria. As such, some excellent comprehensive reviews may have been excluded by the databases or have low quality ratings [67, 103, 105]. Second, the intricacies and details of each individual study are invariably lost when integrating findings from over 1150 primary sources. Third, evaluations of multicomponent policies were excluded, limiting this overview to summarizing the impact of interventions when used in isolation.

Future directions

Based on the cumulative evidence, the effectiveness of smoke-free policies is well established; the current evidence demonstrates smoke-free policies are critical tobacco control interventions. Tobacco price increases are also well supported by the literature, although future studies and reviews could helpfully assess outcomes other than smoking behaviour. More evaluations of the remaining interventions are important to determine their overall effectiveness and the conditions under which they are most impactful. For all interventions, studies and syntheses of the various factors that can influence their effectiveness and feasibility, such as cost, local context, political barriers and implementation strategies, are needed. The differential effect of these policies, such as by a nation’s level of development or by a population’s demographic characteristics, is also an important research gap. Studies and syntheses evaluating the synergistic effects of multicomponent programs and determining which combinations of policies are most effective would be particularly beneficial for governments in establishing or expanding evidence-based tobacco control programs. Research should also not be limited to the FCTC provisions; innovative and radical approaches, or “endgame proposals,” should be encouraged to further reduce and ultimately eliminate tobacco use [106].

Conclusion

This overview of systematic reviews provides a summary of current research evidence on the effectiveness of individual government tobacco control policies. The 180 state parties to the FCTC and other countries can use this work as a resource for policy decisions on prioritizing, designing and implementing their tobacco control programs. Based on this overview, governments should focus their efforts on enacting smoke-free legislation and taxing tobacco products. Other tobacco control policies should then be considered to build on their effectiveness and establish comprehensive programs.

Notes

  1. The exact number of primary studies could not be calculated because some reviews did not report the number of studies they summarized. The estimate of 1150 primary studies is conservative.

  2. Evidence from systematic reviews on the effects of providing telephone counselling and cessation advice from healthcare workers was not included due to the clinical context in which these interventions were implemented. This overview focuses on evidence from evaluations of government tobacco control policies.

References

  1. Ng M, Freeman MK, Fleming TD, Robinson M, Dwyer-Lindgren L, Thomson B, et al. Smoking prevalence and cigarette consumption in 187 countries, 1980–2012. JAMA. 2014;311(2):183–92. doi:10.1001/jama.2013.284692.

  2. Tobacco. World Health Organization. 2013. http://www.who.int/mediacentre/factsheets/fs339/en/.

  3. Smoking: Do you really know the risks? American Heart Association. 2013. http://www.heart.org/HEARTORG/GettingHealthy/QuitSmoking/QuittingSmoking/Smoking-Do-you-really-know-the-risks_UCM_322718_Article.jsp.

  4. About the WHO Framework Convention on Tobacco Control. World Health Organization. http://www.who.int/fctc/about/en/.

  5. MPOWER. World Health Organization. http://www.who.int/tobacco/mpower/en/.

  6. Parties to the WHO Framework Convention on Tobacco Control. World Health Organization. 2015. http://www.who.int/fctc/signatories_parties/en/.

  7. Hoffman SJ, Rizvi Z. WHO’s undermining tobacco control. Lancet. 2012;380(9843):727–8. doi:10.1016/S0140-6736(12)61402-0.

    Article  PubMed  Google Scholar 

  8. Hoffman SJ, Lavis JN, Bennett S. The use of research evidence in two international organizations’ recommendations about health systems. Healthc Policy. 2009;5(1):66–86.

    PubMed  PubMed Central  Google Scholar 

  9. Our Appraisal Tools. Health Evidence. http://www.healthevidence.org/our-appraisal-tools.aspx.

  10. Why use it and who’s behind it? Health Systems Evidence. http://www.healthsystemsevidence.org/why-use-it.aspx.

  11. Rx for Change. Canadian agency for drugs and technologies in health. 2011. https://www.cadth.ca/rx-change.

    Google Scholar 

  12. AMSTAR Checklist. AMSTAR. http://amstar.ca/Amstar_Checklist.php.

  13. About DARE. Centre for Reviews and Dissemination. 2014. http://www.crd.york.ac.uk/CRDWeb/AboutPage.asp.

  14. Hopkins DP, Briss PA, Ricard CJ, Husten CG, Carande-Kulis VG, Fielding JE, et al. Reviews of evidence regarding interventions to reduce tobacco use and exposure to environmental tobacco smoke. Am J Prev Med. 2001;20(2 Suppl):16–66.

    Article  CAS  PubMed  Google Scholar 

  15. Hopkins DP, Razi S, Leeks KD, Priya Kalra G, Chattopadhyay SK, Soler RE, et al. Smokefree policies to reduce tobacco use. A systematic review. Am J Prev Med. 2010;38(2 Suppl):S275–89. doi:10.1016/j.amepre.2009.10.029.

    Article  PubMed  Google Scholar 

  16. Been JV, Nurmatov UB, Cox B, Nawrot TS, van Schayck CP, Sheikh A. Effect of smoke-free legislation on perinatal and child health: a systematic review and meta-analysis. Lancet. 2014;383(9928):1549–60. doi:10.1016/S0140-6736(14)60082-9.

    Article  PubMed  Google Scholar 

  17. Fichtenberg CM, Glantz SA. Effect of smoke-free workplaces on smoking behaviour: systematic review. BMJ. 2002;325(7357):188.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Levy DT, Friend KB. The effects of clean indoor air laws: what do we know and what do we need to know? Health Educ Res. 2003;18(5):592–609.

    Article  PubMed  Google Scholar 

  19. Thomas S, Fayter D, Misso K, Ogilvie D, Petticrew M, Sowden A, et al. Population tobacco control interventions and their effects on social inequalities in smoking: systematic review. Tob Control. 2008;17(4):230–7. doi:10.1136/tc.2007.023911.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Mackay DF, Irfan MO, Haw S, Pell JP. Meta-analysis of the effect of comprehensive smoke-free legislation on acute coronary events. Heart. 2010;96(19):1525–30. doi:10.1136/hrt.2010.199026.

    Article  CAS  PubMed  Google Scholar 

  21. Mozaffarian D, Afshin A, Benowitz NL, Bittner V, Daniels SR, Franch HA, et al. Population approaches to improve diet, physical activity, and smoking habits: a scientific statement from the American Heart Association. Circulation. 2012;126(12):1514–63.

    Article  PubMed  Google Scholar 

  22. Tan CE, Glantz SA. Association between smoke-free legislation and hospitalizations for cardiac, cerebrovascular, and respiratory diseases: a meta-analysis. Circulation. 2012;126(18):2177–83. doi:10.1161/CIRCULATIONAHA.112.121301.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Lin H, Wang H, Wu W, Lang L, Wang Q, Tian L. The effects of smoke-free legislation on acute myocardial infarction: a systematic review and meta-analysis. BMC Public Health. 2013;13:529. doi:10.1186/1471-2458-13-529.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Kohler S, Minkner P. Smoke-free laws and direct democracy initiatives on smoking bans in Germany: a systematic review and quantitative assessment. Int J Environ Res Public Health. 2014;11(1):685–700. doi:10.3390/ijerph110100685.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Callinan JE, Clarke A, Doherty K, Kelleher C. Legislative smoking bans for reducing secondhand smoke exposure, smoking prevalence and tobacco consumption. Cochrane Database Syst Rev. 2010;4:CD005992. doi:10.1002/14651858.CD005992.pub2.

    Google Scholar 

  26. Cahill K, Perera R. Quit and Win contests for smoking cessation. Cochrane Database Syst Rev. 2008;4:CD004986. doi:10.1002/14651858.CD004986.pub3.

    Google Scholar 

  27. Cahill K, Perera R. Competitions and incentives for smoking cessation. Cochrane Database Syst Rev. 2011;4:CD004307. doi:10.1002/14651858.CD004307.pub4.

    Google Scholar 

  28. Reda AA, Kotz D, Evers SM, van Schayck CP. Healthcare financing systems for increasing the use of tobacco dependence treatment. Cochrane Database Syst Rev. 2012;6:CD004305. doi:10.1002/14651858.CD004305.pub4.

    Google Scholar 

  29. Johnston V, Liberato S, Thomas D. Incentives for preventing smoking in children and adolescents. Cochrane Database Syst Rev. 2012;10:CD008645. doi:10.1002/14651858.CD008645.pub2.

    PubMed  Google Scholar 

  30. Likis FE, Andrews JC, Fonnesbeck CJ, Hartmann KE, Jerome RN, Potter SA, et al. Smoking cessation interventions in pregnancy and postpartum care. In: Evidence Report/Technology Assessment No. 214. (Prepared by the Vanderbilt Evidence-based Practice Center under Contract No. 290-2007-10065-I.) AHRQ Publication No. 14-E001-EF. Rockville, MD: Agency for Healthcare Research and Quality; 2014. http://www.effectivehealthcare.ahrq.gov/ehc/products/517/1871/smoking-pregnancy-infants-report-140226.pdf.

    Google Scholar 

  31. Giles EL, Robalino S, McColl E, Sniehotta FF, Adams J. The effectiveness of financial incentives for health behaviour change: systematic review and meta-analysis. PLoS One. 2014;9(3):e90347. doi:10.1371/journal.pone.0090347.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Cahill K, Lancaster T. Workplace interventions for smoking cessation. Cochrane Database Syst Rev. 2014;2:CD003440. doi:10.1002/14651858.CD003440.pub4.

    Google Scholar 

  33. Leeks KD, Hopkins DP, Soler RE, Aten A, Chattopadhyay SK, Task Force on Community Preventive Services. Worksite-based incentives and competitions to reduce tobacco use. A systematic review. Am J Prev Med. 2010;38(2 Suppl):S263–74. doi:10.1016/j.amepre.2009.10.034.

    Article  PubMed  Google Scholar 

  34. Papadakis S, McDonald P, Mullen KA, Reid R, Skulsky K, Pipe A. Strategies to increase the delivery of smoking cessation treatments in primary care settings: a systematic review and meta-analysis. Prev Med. 2010;51(3–4):199–213. doi:10.1016/j.ypmed.2010.06.007.

    Article  PubMed  Google Scholar 

  35. Isensee B, Hanewinkel R. Meta-analysis on the effects of the smoke-free class competition on smoking prevention in adolescents. Eur Addict Res. 2012;18(3):110–5. doi:10.1159/000335085.

    Article  PubMed  Google Scholar 

  36. Hamilton FL, Greaves F, Majeed A, Millett C. Effectiveness of providing financial incentives to healthcare professionals for smoking cessation activities: systematic review. Tob Control. 2013;22(1):3–8. doi:10.1136/tobaccocontrol-2011-050048.

    Article  CAS  PubMed  Google Scholar 

  37. Hammond D. Health warning messages on tobacco products: a review. Tob Control. 2011;20(5):327–37. doi:10.1136/tc.2010.037630.

    Article  PubMed  Google Scholar 

  38. Jepson R, Harris F, Rowa-Dewar N, MacGillivray S, Hastings G, Kearney N, et al. A review of the effectiveness of mass media interventions which both encourage quit attempts and reinforce current and recent attempts to quit smoking. National Institute for Health and Care Excellence. 2006.

    Google Scholar 

  39. Brinn MP, Carson KV, Esterman AJ, Chang AB, Smith BJ. Mass media interventions for preventing smoking in young people. Evid Based Child Health. 2012;7(1):86–144. doi:10.1002/ebch.1808.

    Article  Google Scholar 

  40. Bala MM, Strzeszynski L, Topor-Madry R, Cahill K. Mass media interventions for smoking cessation in adults. Cochrane Database Syst Rev. 2013;6:CD004704. doi:10.1002/14651858.CD004704.pub3.

    Google Scholar 

  41. Durkin S, Brennan E, Wakefield M. Mass media campaigns to promote smoking cessation among adults: an integrative review. Tob Control. 2012;21(2):127–38. doi:10.1136/tobaccocontrol-2011-050345.

    Article  PubMed  Google Scholar 

  42. Guillaumier A, Bonevski B, Paul C. Anti-tobacco mass media and socially disadvantaged groups: a systematic and methodological review. Drug Alcohol Rev. 2012;31(5):698–708. doi:10.1111/j.1465-3362.2012.00466.x.

    Article  PubMed  Google Scholar 

  43. Quentin W, Neubauer S, Leidl R, König HH. Advertising bans as a means of tobacco control policy: a systematic literature review of time-series analyses. Int J Public Health. 2007;52(5):295–307.

    Article  PubMed  Google Scholar 

  44. Capella ML, Taylor CR, Webster C. The effect of cigarette advertising bans on consumption. J Advertising. 2008;37(2):7–18.

    Article  Google Scholar 

  45. Bader P, Boisclair D, Ferrence R. Effects of tobacco taxation and pricing on smoking behavior in high risk populations: a knowledge synthesis. Int J Environ Res Public Health. 2011;8(11):4118–39. doi:10.3390/ijerph8114118.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Rice N, Godfrey C, Slack R, Sowden A, Worthy G. A systematic review of the effects of price on the smoking behaviour of young people. UK: PHRC Project Outputs; A2-06; 2009.

    Google Scholar 

  47. Guindon GE. The impact of tobacco prices on smoking onset: a methodological review. Tob Control. doi:10.1136/tobaccocontrol-2012-050496.

  48. Fichtenberg CM, Glantz SA. Youth access interventions do not affect youth smoking. Pediatrics. 2002;109(6):1088–92.

    Article  PubMed  Google Scholar 

  49. Stead LF, Lancaster T. Interventions for preventing tobacco sales to minors. Cochrane Database Syst Rev. 2005;1:CD001497.

    Google Scholar 

  50. Richardson L, Hemsing N, Greaves L, Assanand S, Allen P, McCullough L, et al. Preventing smoking in young people: a systematic review of the impact of access interventions. Int J Environ Res Public Health. 2009;6(4):1485–514. doi:10.3390/ijerph6041485.

    Article  PubMed  PubMed Central  Google Scholar 

  51. DiFranza JR. Which interventions against the sale of tobacco to minors can be expected to reduce smoking? Tob Control. 2012;21(4):436–42. doi:10.1136/tobaccocontrol-2011-050145.

    Article  PubMed  Google Scholar 

  52. Goldman LK, Glantz SA. Evaluation of antismoking advertising campaigns. JAMA. 1998;279(10):772–7.

    Article  CAS  PubMed  Google Scholar 

  53. Eriksen MP, Gottlieb NH. A review of the health impact of smoking control at the workplace. Am J Health Promot. 1998;13(2):83–104.

    Article  CAS  PubMed  Google Scholar 

  54. Willemsen MC, de Zwart WM. The effectiveness of policy and health education strategies for reducing adolescent smoking: a review of the evidence. J Adolesc. 1999;22(5):587–99.

    Article  CAS  PubMed  Google Scholar 

  55. Wakefield M, Chaloupka F. Effectiveness of comprehensive tobacco control programmes in reducing teenage smoking in the USA. Tob Control. 2000;9(2):177–86.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  56. Lantz PM, Jacobson PD, Warner KE, Wasserman J, Pollack HA, Berson J, et al. Investing in youth tobacco control: a review of smoking prevention and control strategies. Tob Control. 2000;9(1):47–63.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  57. Silver MZ. Efficacy of anti-tobacco mass media campaigns on adolescent tobacco use. Pediatr Nurs. 2001;27(3):293–6.

    CAS  PubMed  Google Scholar 

  58. Friend K, Levy DT. Reductions in smoking prevalence and cigarette consumption associated with mass-media campaigns. Health Educ Res. 2002;17(1):85–98.

    Article  PubMed  Google Scholar 

  59. Gallet CA, List JA. Cigarette demand: a meta-analysis of elasticities. Health Econ. 2003;12(10):821–35.

    Article  PubMed  Google Scholar 

  60. Snyder LB, Hamilton MA, Mitchell EW, Kiwanuka-Tondo J, Fleming-Milici F, Proctor D. A meta-analysis of the effect of mediated health communication campaigns on behavior change in the United States. J Health Commun. 2004;9 Suppl 1:71–96.

    Article  PubMed  Google Scholar 

  61. Greaves L, Johnson J, Bottorff J, Kirkland S, Jategaonkar N, McGowan M, et al. What are the effects of tobacco policies on vulnerable populations? A better practices review. Can J Public Health. 2006;97(4):310–5.

    PubMed  Google Scholar 

  62. Laporte A. Price responsiveness of demand for cigarettes: does rationality matter? Subst Use Misuse. 2006;41(4):511–31.

    Article  PubMed  Google Scholar 

  63. Niederdeppe J, Kuang X, Crock B, Skelton A. Media campaigns to promote smoking cessation among socioeconomically disadvantaged populations: what do we know, what do we need to learn, and what should we do now? Soc Sci Med. 2008;67(9):1343–55. doi:10.1016/j.socscimed.2008.06.037.

    Article  PubMed  Google Scholar 

  64. Hahn EJ. Smokefree legislation: a review of health and economic outcomes research. Am J Prev Med. 2010;39(6 Suppl 1):S66–76. doi:10.1016/j.amepre.2010.08.013.

    Article  PubMed  Google Scholar 

  65. Kabir Z, Alpert HR, Goodman PG, Haw S, Behm I, Connolly GN, et al. Effect of smoke-free home and workplace policies on second-hand smoke exposure levels in children: an evidence summary. Pediatric Health. 2010;4(4):391–403.

    Article  Google Scholar 

  66. Oncken CA, Dietz PM, Tong VT, Belizán JM, Tolosa JE, Berghella V, et al. Prenatal tobacco prevention and cessation interventions for women in low- and middle-income countries. Acta Obstet Gynecol Scand. 2010;89(4):442–53. doi:10.3109/00016341003678450.

    Article  PubMed  PubMed Central  Google Scholar 

  67. IARC. Handbooks of cancer prevention, tobacco control, Vol. 14: effectiveness of tax and price policies for tobacco control. France: International Agency for Research on Cancer; 2011.

    Google Scholar 

  68. Wilson LM, Avila Tang E, Chander G, Hutton HE, Odelola OA, Elf JL, et al. Impact of tobacco control interventions on smoking initiation, cessation, and prevalence: a systematic review. J Environ Public Health. 2012;2012:961724. doi:10.1155/2012/961724.

    Article  PubMed  PubMed Central  Google Scholar 

  69. Reducing tobacco use and secondhand smoke exposure: reducing out-of-pocket costs for evidence–based tobacco cessation treatments. Community Preventive Services Task Force. 2012a. www.thecommunityguide.org/tobacco/outofpocketcosts.html.

  70. Reducing tobacco use and secondhand smoke exposure: interventions to increase the unit price for tobacco products. Community Preventive Services Task Force. 2012b. www.thecommunityguide.org/tobacco/increasingunitprice.html.

  71. Reducing tobacco use and secondhand smoke exposure: smoke-free policies. Community Preventive Services Task Force. 2012c. www.thecommunityguide.org/tobacco/smokefreepolicies.html.

  72. Reducing tobacco use and secondhand smoke exposure: mass-reach health communication interventions. Community Preventive Services Task Force. 2013. www.thecommunityguide.org/tobacco/massreach.html.

  73. Moodie C, Stead M, Bauld L, McNeill A, Angus K, Hinds K, et al. Plain tobacco packaging: a systematic review. London: Public Health Research Consortium; 2012.

    Google Scholar 

  74. Dobbins M, DeCorby K, Manske S, Goldblatt E. Effective practices for school-based tobacco use prevention. Prev Med. 2008;46(4):289–97.

    Article  PubMed  Google Scholar 

  75. Lemmens V, Oenema A, Knut IK, Brug J. Effectiveness of smoking cessation interventions among adults: a systematic review of reviews. Eur J Cancer Prev. 2008;17(6):535–44. doi:10.1097/CEJ.0b013e3282f75e48.

    Article  PubMed  Google Scholar 

  76. Medical Advisory Secretariat. Population-based smoking cessation strategies: a summary of a select group of evidence-based reviews. Ont Health Technol Assess Ser. 2010;10(1):1–44.

    Google Scholar 

  77. Siegel M. The effectiveness of state-level tobacco control interventions: a review of program implementation and behavioral outcomes. Annu Rev Public Health. 2002;23:45–71.

    Article  PubMed  Google Scholar 

  78. Secker-Walker RH, Gnich W, Platt S, Lancaster T. Community interventions for reducing smoking among adults. Cochrane Database Syst Rev. 2002;3:CD001745.

    Google Scholar 

  79. Murphy-Hoefer R, Griffith R, Pederson LL, Crossett L, Iyer SR, Hiller MD. A review of interventions to reduce tobacco use in colleges and universities. Am J Prev Med. 2005;28(2):188–200.

    Article  PubMed  Google Scholar 

  80. Carson KV, Brinn MP, Labiszewski NA, Esterman AJ, Chang AB, Smith BJ. Community interventions for preventing smoking in young people. Cochrane Database Syst Rev. 2011;7:CD001291.

    Google Scholar 

  81. Carson KV, Brinn MP, Labiszewski NA, Peters M, Chang AB, Veale A, et al. Interventions for tobacco use prevention in Indigenous youth. Cochrane Database Syst Rev. 2012;8:CD009325. doi:10.1002/14651858.CD009325.pub2.

    Google Scholar 

  82. Thomson G, Wilson N, Howden-Chapman P. Population level policy options for increasing the prevalence of smokefree homes. J Epidemiol Community Health. 2006;60(4):298–304.

    Article  PubMed  PubMed Central  Google Scholar 

  83. Resnicow K, Robinson TN. School-based cardiovascular disease prevention studies: review and synthesis. Ann Epidemiol. 1997;S7:S14–31.

    Article  Google Scholar 

  84. Sussman S. Effects of sixty six adolescent tobacco use cessation trials and seventeen prospective studies of self-initiated quitting. Tob Induc Dis. 2003;1(1):35–81.

    Article  Google Scholar 

  85. Smedslund G, Fisher KJ, Boles SM, Lichtenstein E. The effectiveness of workplace smoking cessation programmes: a meta-analysis of recent studies. Tob Control. 2004;13(2):197–204.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  86. Wiehe SE, Garrison MM, Christakis DA, Ebel BE, Rivara FP. A systematic review of school-based smoking prevention trials with long-term follow-up. J Adolesc Health. 2005;36(3):162–9.

    Article  PubMed  Google Scholar 

  87. La Torre G, Chiaradia G, Ricciardi G. School-based smoking prevention in children and adolescents: review of the scientific literature. J Public Health. 2005;13(6):285–90.

    Article  Google Scholar 

  88. Müller-Riemenschneider F, Bockelbrink A, Reinhold T, Rasch A, Greiner W, Willich SN. Long-term effectiveness of behavioural interventions to prevent smoking among children and youth. Tob Control. 2008;17(5):301–2. doi:10.1136/tc.2007.024281.

    Article  PubMed  Google Scholar 

  89. Flay BR. The promise of long-term effectiveness of school-based smoking prevention programs: a critical review of reviews. Tob Induc Dis. 2009;5(1):7. doi:10.1186/1617-9625-5-7.

    Article  PubMed  PubMed Central  Google Scholar 

  90. Uthman O, Yahaya I, Pennant M, Bayliss S, Aveyard P, Jit M, et al. School-based interventions to prevent the uptake of smoking among children and young people: effectiveness review. Birmingham (UK): National Institute for Health and Clinical Excellence (UK); 2009. p. 55.

    Google Scholar 

  91. Sherman EJ, Primack BA. What works to prevent adolescent smoking? A systematic review of the National Cancer Institute’s Research-Tested Intervention Programs. J Sch Health. 2009;79(9):391–9. doi:10.1111/j.1746-1561.2009.00426.x.

    Article  PubMed  PubMed Central  Google Scholar 

  92. Goldgruber J, Ahrens D. Effectiveness of workplace health promotion and primary prevention interventions: a review. J Public Health. 2010;18(1):75–88.

    Article  Google Scholar 

  93. Saraf DS, Nongkynrih B, Pandav CS, Gupta SK, Shah B, Kapoor SK, et al. A systematic review of school-based interventions to prevent risk factors associated with noncommunicable diseases. Asia-Pac J Public Health. 2012;24(5):733–52.

    Article  PubMed  Google Scholar 

  94. Thomas RE, McLellan J, Perera R. School-based programmes for preventing smoking. Cochrane Database Syst Rev. 2013;4:CD001293. doi:10.1002/14651858.CD001293.pub3.

    Google Scholar 

  95. Sargent JD, Dalton MA, Beach ML, Mott LA, Tickle JJ, Ahrens MB, et al. Viewing tobacco use in movies: does it shape attitudes that mediate adolescent smoking? Am J Prev Med. 2002;22(3):137–45.

    Article  PubMed  Google Scholar 

  96. Sargent JD, Beach ML, Adachi-Mejia AM, Gibson JJ, Titus-Ernstoff LT, Carusi CP, et al. Exposure to movie smoking: its relation to smoking initiation among US adolescents. Pediatrics. 2005;116(5):1183–91.

    Article  PubMed  Google Scholar 

  97. Charlesworth A, Glantz SA. Smoking in the movies increases adolescent smoking: a review. Pediatrics. 2005;116(6):1516–28.

    Article  PubMed  Google Scholar 

  98. Wellman RJ, Sugarman DB, DiFranza JR, Winickoff JP. The extent to which tobacco marketing and tobacco use in films contribute to children’s use of tobacco: a meta-analysis. Arch Pediatr Adolesc Med. 2006;160(12):1285–96.

    Article  PubMed  Google Scholar 

  99. Morgenstern M, Sargent JD, Engels RC, Scholte RH, Florek E, Hunt K, et al. Smoking in movies and adolescent smoking initiation: longitudinal study in six European countries. Am J Prev Med. 2013;44(4):339–44. doi:10.1016/j.amepre.2012.11.037.

    Article  PubMed  PubMed Central  Google Scholar 

  100. Saffer H, Chaloupka F. The effect of tobacco advertising bans on tobacco consumption. J Health Econ. 2000;19(6):1117–37.

    Article  CAS  PubMed  Google Scholar 

  101. Blecher E. The impact of tobacco advertising bans on consumption in developing countries. J Health Econ. 2008;27(4):930–42. doi:10.1016/j.jhealeco.2008.02.010.

    Article  PubMed  Google Scholar 

  102. Institute of Medicine of the National Academies. Ending the tobacco epidemic: a blueprint for the nation. Washington D.C: Institute of Medicine of the National Academies; 2007.

    Google Scholar 

  103. Centers for Disease Control and Prevention. Best practices for comprehensive tobacco control programs – 2014. Atlanta: Centers for Disease Control and Prevention; 2014.

    Google Scholar 

  104. World Health Organization. 2014 Global progress report on implementation of the WHO framework convention on tobacco control. Geneva: World Health Organization; 2014.

    Google Scholar 

  105. Centers for Disease Control and Prevention. 2012 Surgeon general’s report – Preventing tobacco use among youth and young adults. Atlanta: Centers for Disease Control and Prevention; 2012.

    Google Scholar 

  106. Warner KE. An endgame for tobacco? Tob Control. 2013;22 Suppl 1:i3–5. doi:10.1136/tobaccocontrol-2013-050989.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

SJH is financially supported by the Canadian Institutes of Health Research, the Research Council of Norway, and the Trudeau Foundation. The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript.

We thank Emmanuel Guindon, Kaelan Moat and Shawn O’Connor for help with our search strategy and feedback on earlier drafts of this manuscript. We thank Waleed Ahmed, Navneet Natt and Lathika Sritharan for their help with the literature search and review.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Charlie Tan.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

SJH conceived of the study, led its methodological design and co-wrote the manuscript. CT led implementation of the study’s methodology and co-wrote the manuscript. Both authors contributed equally to this work. Both authors approved the final version of the manuscript and take responsibility for the integrity of the findings.

Additional file

Additional file 1:

Summary of key findings from 59 systematic reviews.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hoffman, S.J., Tan, C. Overview of systematic reviews on the health-related effects of government tobacco control policies. BMC Public Health 15, 744 (2015). https://doi.org/10.1186/s12889-015-2041-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-015-2041-6

Keywords