- Research article
- Open Access
- Open Peer Review
Trends in influenza vaccination coverage in Portugal from 1998 to 2010: effect of major pandemic threats
BMC Public Healthvolume 13, Article number: 1130 (2013)
Vaccination is the key measure available for prevention of the public health burden of annual influenza epidemics. This article describes national trends in seasonal influenza vaccine (IV) coverage in Portugal from 1998/99 to 2010/11, analyzes progress towards meeting WHO 2010 coverage goals, and addresses the effect of major public health threats of the last 12 years (SARS in 2003/04, influenza A (H5N1) in 2005/06, and the influenza A (H1N1)2009 pandemic) on vaccination trends.
The National Institute of Health surveyed (12 times) a random sample of Portuguese families. IV coverage was estimated and was adjusted for age distribution and country region. Independence of age and sex coverage distribution was tested using a modified F-statistic with a 5% significance level. The effect of SARS, A (H5N1), and the A (H1N1)2009 pandemic was tested using a meta-regression model. The model was adjusted for IV coverage in the general population and in the age groups.
Between 1998/99 and 2010/11 IV, coverage in the general population varied between 14.2% (CI 95%: 11.6%–16.8%) and 17.5% (CI 95%: 17.6%–21.6%). There was no trend in coverage (p = 0.097). In the younger age group (<15 years) a declining trend was identified until 2008/09 (p = 0.005). This trend reversed in 2009/10. There was also a gradual and significant increase in seasonal IV coverage in the elderly (p for trend < 0.001). After 2006/07, IV coverage remained near 50%. Adjusting for baseline trends, there was significantly higher coverage in the general population in 2003/04 (p = 0.032) and 2005/06 (p = 0.018). The high coverage observed in the <15-year age group in season 2009/10 was also significant (p = 0.015).
IV coverage in the elderly population displayed an increasing trend, but the 75% WHO 2010 target was not met. This result indicates that influenza vaccination strategy should be improved to meet the ambitious WHO coverage goals. The major pandemic threats of the past decade had a modest but significant effect on seasonal influenza vaccination. There was an increase in vaccine uptake proportion in the general population in 2003/04 and in 2005/06, and in individuals <15 years old in 2009/10.
The public health burden of annual influenza epidemics represents ongoing vulnerability to pandemic influenza and highlights gaps in bioterrorism preparedness and response efforts [1, 2]. The recent emergence of the pandemic influenza A (H1N1) 2009 virus is a good example of how influenza can impact health systems around the world .
Currently, vaccination is the key measure available for prevention of influenza and associated complications. Strategies that focus on providing routine vaccination to persons at higher risk for influenza complications have long been recommended, although coverage among most of these groups remains low . Concurrently, there is a need to increase seasonal vaccine use through clear immunization policies as a way to stimulate industry to boost production capacity .
During the 2009/10 season, the influenza pandemic led to reinforcement of influenza vaccination recommendations in European countries, including Portugal. The pandemic also led to renewed interest in influenza vaccination surveillance.
Continued annual monitoring is needed to determine the effects of vaccine supply, changes in influenza vaccination recommendations, changes in groups targeted for vaccination, and other factors, on vaccination coverage among adults and children . Vaccine coverage rates constitute the basic measure for evaluation of public health programs designed to improve vaccination uptake and for estimation of how the vaccination program affects the rate of disease.
Circumstantial factors (e.g., personal reasons) may affect the rate of vaccination . In the last 12 years three major pandemic threats, not all caused by influenza virus, affected public and healthcare professionals’ perceptions of the need for influenza vaccine (IV) uptake. These pandemic threats were severe acute respiratory syndrome (SARS) in 2003, “avian influenza” (influenza A (H5N1)) in 2005, and the recent influenza A (H1N1)2009 pandemic. The rapid worldwide dissemination of SARS in 2003 was a rehearsal for the next influenza pandemic . In 2005, the World Health Organization (WHO) declared that the emergence and persistence of influenza A (H5N1) in birds and the associated human fatalities were a public health threat and fostered early response strategies to contain the pandemic . In April 2009, the spread of novel swine flu origin influenza A (H1N1) prompted the declaration of a pandemic by WHO in June of the same year . Whether this raised awareness had a positive or negative effect on IV uptake varies according to country and to situation [6, 10, 11].
Every year, based on surveillance of clinic and laboratory data provided by a global network of Influenza Surveillance Centers, the WHO recommends the composition of the vaccine that will be used the next season . The General Directorate of Health (DGS) in Portugal issues an information guide to Ministry of Health and private sector doctors in September/October of each year. The guide describes vaccine specifications for the current season and indications for vaccine uptake. Each flu season, the main objective of the DGS has been to increase IV coverage in high risk groups (i.e., individuals >65 years old and patients with specific chronic diseases) and priority groups of health professionals [13, 14]. Table 1 describes how the recommendations have changed over time.
In 2004, WHO established a 75% IV coverage target in the elderly (>65 years) that was in effect until 2010 . In 2006, DGS established an interim target of 50% vaccine coverage among individuals aged 65 years and over for the 2006/07 season .
Despite the occurrence of a pandemic due to a new strain of influenza virus in 2009, the DGS has maintained the same seasonal IV recommendations for the major risk groups . Concurrently, the recommendation expanded to include vaccination against pandemic influenza A (H1N1) 2009 for children from 6 months to 12 years. Older individuals were included only if they had a specific chronic disease .
Since the 1998/99 season, the Department of Epidemiology (DEP) of the National Institute of Health Doctor Ricardo Jorge (INSA; previously the National Health Observatory (ONSA)) has monitored IV coverage. This system is the only one in the country that estimates IV coverage in the general Portuguese population and in subgroups. This information cannot be obtained from a count of vaccine sales or from vaccine administration data.
This article describes national trends in seasonal IV coverage in Portugal from 1998 and 2010 in the general population and in age groups presents an analysis of progress towards WHO 2010 coverage goals. It also addresses the effects of the major pandemic threats (SARS in 2003, influenza A (H5N1) in 2005, and the influenza A (H1N1)2009 pandemic) on vaccination trends for the last 12 years.
Between 1998/99 and 2010/11, INSA conducted 12 household telephone surveys using a panel of families (ECOS – Em Casa Observamos Saúde/Observing Health at Home). These surveys were used to collect data on IV coverage in the mainland Portuguese population.
The ECOS panel consisted of a random sample of Portuguese families with a landline telephone and of families with landline and mobile phone since the 2009/10 sample (dual sample frame). The sample was stratified and was evenly distributed to represent the five health regions of the country. Landline phone households were selected by simple random selection from the national telephone directory. Mobile phone households were selected by random digit generation. All households received a letter from INSA with an invitation to participate in the ECOS panel and provide informed consent. Telephone contact was then used to formalize participation and record each household member’s demographic data. The households included in each panel were renewed approximately every 3 years. The ECOS panel of families was approved by the Portuguese Data Protection Authority, which is in charge of ethical issues and protection of individual data collection in Portugal.
The seasons included in the surveys were the winters from 1998/99 to 2010/11, except for the winter of 2000/01. No investigation was carried out in 2000/2001 season owing to lack of financing.
All surveys used the same questionnaire. The questionnaire was presented to one individual (≥18 years of age) in each household using CATI (Computer Assisted Telephone Interview) technology. This individual provided information on his/her vaccination status and information on the household. The terminology “percent of vaccinated” used in reporting results refers to individuals who reported being vaccinated or on which the respondent said they were vaccinated.
The 1998/99, 1999/00, and 2001/02 surveys used the sample set formed in 1998. The surveys from 2002/03 to 2005/06 were carried out with a sample that was selected in 2002. The investigation in the 2006/07, 2007/08, and 2008/09 seasons was conducted with a sample formed in 2006. The 2009/10 and the 2010/11 surveys used a sample that was selected in 2010 (Table 2).
A detailed description of the ECOS methodology can be found in a published report . Permission to use the data for this study was obtained from the National Institute of Health.
IV coverage was analyzed for the entire sample and for specific groups defined by age and sex. Information on demographic questions was collected during the initial survey done at household recruitment time.
For the surveys conducted in 1998/99 to 2008/09, all IV coverage estimates were adjusted by health region using the 2001 Portuguese population census data (2001 Census data from the National Institute of Statistics). For the surveys of the 2009/10 and 2010/11 periods that were conducted using the dual sample frame, the IV coverage estimates were adjusted by health region (Census population 2001) and for cell phone and landline phone coverage of Portuguese households using the methodology described in Brick and Kennedy. Weighting factors were adjusted by post stratification for population age and sex distribution.
To test the association (or independence) with disaggregation variables, we used the modified F-statistics of the second order adjustment of the Rao-Scott Chi-squared test  whose properties are presented in Rao and Thomas. A 5% significance level was used for the statistical tests, and the null hypothesis was rejected when the probability of test significance (p-value) was <0.05. We also calculated 95% confidence intervals for all proportions.
We used a meta-regression model to test the linear trend in IV coverage throughout the study period, and the effect of the SARS, A (H5N1), and A (H1N1)2009 pandemics. Each survey estimate was weighted by the inverse of the variance in the logit scale. The model fitted to the logit of IV coverage included three dummy variables (one for each event) and a sequence of numbers from 1 to 12 years to measure and test the time trend effect. The model was adjusted to IV coverage in the general population and age groups.
Total sample sizes varied between the minimum value of 2192 individuals (2008/09) and the maximum value of 4167 individuals (2001/2002).
For sex distribution, there were no significant deviations from the 2001 population census distribution (i.e., all confidence intervals included the census population estimates). There were small differences between the age group distribution in the panel data and the population age group distribution observed in the 2001 census. These differences varied by year.
Influenza vaccine coverage from 1998/99 to 2010/11
The lowest vaccine uptake occurred in 1998/99 and 2006/07 (14.2%, CI 95%: 11.6%–16.8%; 14.3%, CI 95%: 13.0%–15.8%), and the highest vaccine uptake occurred in the 2005/06 and 2009/10 seasons (19.1%, CI 95%: 17.4%–20.9%; 19.5%, CI 95%: 17.6%–21.6%).
There was no trend in IV coverage of the general population during the study period (p = 0.097).
Influenza vaccine coverage by sex and age group
Over all the studied seasons, there were no statistically significant differences in IV coverage between women and men. However, IV coverage was higher for women than for men in 11 of the 12 seasons (Table 4). The difference between women and men was marginally significant for the 2003/04 (p = 0.058) and the 2010/11 (p = 0.056) seasons.
Differences in IV coverage by age group occurred in all seasons (Table 4, Figure 2). In the younger age group (<15 years), a declining trend (with small fluctuations) was present from 1999/00 to 2008/09 (p = 0.005). This trend reversed in 2009/10, with one of the highest seasonal IV coverages for this age group (12.9%, CI 95%: 9.3%–17.6%).
As expected, the highest IV coverage was observed in individuals >65 years old. Between 1998/99 and 2010/11, there was a gradual and significant increase in seasonal IV coverage in the elderly (p for trend <0.001).
In the 1998/99 season, IV coverage was 31.3% (CI 95%: 26.1%–36.9%) and in the 2010/11 season it was 48.3%, which was similar to the 50% coverage achieved in the four previous seasons (Figure 2, Table 4).
An increasing trend was also identified in individuals aged 45–64 years old (p for trend 0.035). A trend was not present in the 15–44-year age group (p for trend 0.691).
Impact of major pandemic threats on seasonal influenza vaccine coverage from 1998/99 to 2010/11
A meta-regression model was used to test for a potential effect on IV coverage for the seasons 2003/04, 2005/06, and 2009/10, while adjusting for the baseline vaccine coverage trend (Table 5). There was significantly higher coverage in the general population for two seasons: 2003/04 (p = 0.032) and 2005/06 (p = 0.018). Coverage in the 2009/10 season was not significant (p = 0.084).
Two coverage levels were significantly higher at the 5% confidence level: the IV uptake for the 45–64-year age group in the 2005/06 season (p = 0.044), and the vaccine uptake for the 0–14-year age group in the 2009/10 season (p = 0.015).
Influenza vaccine coverage from 1998/99 to 2010/11
Between 1998/99 and 2010/11, IV coverage in Portugal varied between 14.2% and 17.5%. There was no consistent increase in percent IV uptake in the general population (p for trend 0.097).
During this time period (Figure 1, Table 3), there were four seasons that had notably higher IV coverage estimates: 2003/04, 2005/06, 2008/09, and 2009/10. However, except for 2003/04, these seasons did not have the highest coverage proportions in the elderly segment of the population (≥65 years), for whom vaccination has been long recommended. The seasonal IV coverage increase in the general population was primarily due to an increase in coverage in the 45–64-year age group in the 2005/06 and 2008/09 seasons and to an increase in the <15-year age group in the 2009/10 season (Table 4).
During the previous 12 years, healthy children and adolescents were not recommended risk groups for IV uptake in Portugal, except for during the 2009/10 influenza pandemic. Therefore, seasonal IV coverage levels among individuals <15 years old remained low. For most of the seasons, it was <10%. There were four seasons with slightly higher coverage levels in this age group: the 1998/99, 1999/00, 2005/06, and 2009/10 seasons, with coverage point estimates of 12.1%, 14.6%, 11.3%, and 12.9%, respectively.
Children are not considered to be a risk group for seasonal influenza. However, the general increased awareness related to the A (H1N1)2009 pandemic, and specific recommendations from Portuguese health authorities to vaccinate children may have affected seasonal vaccine uptake. More investigation is needed to address this hypothesis. However, the potential effect was not particularly strong considering that elevated vaccine uptake in season 2009/10 was not significantly higher than the other three seasons.
Individuals >65 years old had the highest coverage in all seasons. Values ranged from 31.3% in 1998/99 to 53.3% in the 2008/09 season (point estimates).
Regarding the 12-year pattern, a statistically significant increasing trend (p < 0.001) was observed for IV coverage in Portugal since 1998 in the elderly. However, after 50% coverage was achieved in 2006/07, a plateau was reached and no further improvement was observed in the last 4 years of the study period. The 2009 pandemic did not affect seasonal vaccination coverage in the elderly population in Portugal. Coverage was around 50%, which was similar to the three previous periods. This result is consistent with the fact that seasonal vaccine recommendations did not change throughout this period. Unchanged seasonal coverage rates were also observed in an elderly population in France .
In Europe, estimates for IV coverage in the elderly indicate that some countries failed to meet the target of 50% coverage in 2006. Portugal was not one of these countries . However, other countries achieved the 75% coverage target for 2010. These countries were England, Scotland, Wales (79% in the 2005/06 season) , and The Netherlands (74% CI 95%: 71%–77% in 2001/02) . A recent study of 11 European countries (2006/07 season) found that Spain, with 71% coverage, was close to meeting the goal . This study also estimated that there was 53% IV coverage in Portugal for individuals ≥65 years, which is consistent with the estimate obtained in our study (50.4%, CI 95%: 44.8%–55, 9%). Compared with the other 10 countries included in the study (United Kingdom, Germany, Italy, France, Spain, Austria, Czech Republic, Ireland, Finland, and Poland), IV coverage in the elderly (≥ 65 years) in Portugal was sixth, but was similar to the overall estimate for all countries (53.2%).
In another European study that included 22 European countries (2006/07 season), Portugal ranked thirteenth for IV coverage in the elderly, and represented the median value for coverage in Europe . This finding was consistent with the findings of the previous study.
Given that the elderly had been targeted for vaccination for many years and are the largest risk group, these results indicate that progress has been made toward meeting the WHO coverage goals. They reflect positively on Portuguese vaccination policies. Nevertheless, the 2010 75% coverage goal for 2010 remained far from being achieved. The 50% coverage plateau since 2006/07 indicates that additional effort is needed to further improve vaccination levels. Receiving advice from the family doctor/nurse has been identified as the main motivation to get vaccinated among the Portuguese population , followed (at a considerable distance) by old age as a reason. This result suggests that efforts directed at family doctors could have the greatest effect on IV uptake in the elderly. Public information campaigns that are directed at risk groups may also have an effect.
Effect of major pandemic threats on influenza vaccine coverage from 1998/99 to 2010/11
We hypothesized that 2003/04, 2005/06, and 2009/10 were seasons during which there was special awareness about vaccination among the general Portuguese population, and/or among subgroups defined by age. We used a meta-regression model to test this hypothesis. These seasons were selected based on major public health threats worldwide: SARS in 2003/04, the increase in H5N1 virus infections in humans in Southeast Asia in 2005/06, and the declaration of an influenza pandemic in 2009/10.
Global and national health authorities, and the medical community worldwide, reinforced flu vaccination recommendations in 2003/04 . In 2005/06, the pandemic threat, with associated vaccination recommendations, led to news and opinions that circulated in the medical community and in the general population. This news coverage could have led to an increased demand for the influenza vaccine. In fact, in a study on IV coverage in Germany (2001–2006), the authors found that coverage increased during the 2005/06 season. They suggested that the greater media focus on pandemic influenza was one factor that explained the increased vaccine demand .
In 2009/2010, the declaration of a worldwide influenza pandemic by WHO focused the attention of the media on influenza. Health ministries worldwide, including in Portugal, issued broad guidance to health services that was also reported by the media.
The results of the meta-regression model (Table 5) indicate that in the general population, influenza coverage was significantly greater in two seasons, 2003/2004 (p = 0.032) and 2005/2006 (p = 0.018). The seasonal influenza coverage in the general population during the 2009/2010 season was not significantly greater (p = 0.084). However, an examination of IV coverage differences for these three seasons, according to the age group, revealed that two coverage estimates were significant: the increase in vaccine uptake of the 45–64 segment of the population in the 2005/06 season (p = 0.044) and the increase in IV uptake in the 0–14 group in the 2009/10 season (p = 0.015).
These findings indicate that when accounting for the baseline trend, there was an increase in IV coverage during the 2003/04 and 2005/06 seasons, which suggests that awareness about vaccination could have increased in the general population and in specific age groups.
Although the 12.9% coverage in children was not the highest of all the seasons was still an important increase. Risk perception regarding flu in children may have increased during the 2009/10 season, and pandemic awareness and special recommendations for children to be vaccinated during the pandemic could have affected seasonal vaccine uptake in Portugal in the 2009/10 season in this group.
Risk perception affects vaccine uptake [32, 33]. Although results vary in degree and direction, perceptions about the risk of disease and severity of infection that follow major pandemic threats may affect uptake of seasonal influenza vaccine [33–35]. The results of our study suggest that these events may have had a positive effect on IV uptake in Portugal. More research is needed to understand the factors underlying an individual’s decision to be vaccinated against influenza.
Limitation of the study
ECOS is a sample of families from mainland Portugal, with landline and mobile telephones, who agree to complete periodic health surveys. Residents of Portugal who do not have a landline or mobile telephone were not represented in this study.
Between 1998/1999 and 2010/2011, the ECOS panel sample was renewed three times (2002, 2006, and 2010). Therefore, the estimates of IV coverage were obtained using four different samples that were selected using the same methodology. Using the same sample for more than one consecutive season could lead to biased coverage estimates. Specifically, the application of the questionnaire to the same sample in two consecutive seasons could lead to a greater proportion of individuals who choose to be vaccinated the next season. This change in behavior could artificially increase IV coverage, which would not represent coverage in the general population. There is no evidence of this bias in our study, because in each population group, IV coverage increase was not consistent or systematic for the four periods between changes in the sample population (1998 to 2001, 2002 to 2005, 2006 to 2009, and 2010 to the present).
As previously described, the representativeness of the samples studied in comparison with estimates from the 2001 census of the Portuguese mainland population found age deviations from this reference population. These deviations could be translated into an IV coverage bias in the general population. However, in risk groups for whom vaccination is recommended, particularly the elderly (≥ 65 years), and for whom IV coverage monitoring is more critical for control measures, the age bias presented by our samples was less relevant.
Recall bias may occur when individual recall of information is used to obtain data. However, individuals were vaccinated some months before each survey and this time differed from survey to survey. Additionally, only one individual (>18 years) per household answered questions about vaccination status of household members. Surveying all of the individuals in a household would make the procedure more complex and could lead to a failure of the entire process, which occurred during previous surveys using the ECOS panel .
From 1998/99 to 2010/11, seasonal IV coverage in Portugal varied between 14.2% and 17.5%. No significant increasing trend was observed in the Portuguese general population during this period.
There was a clear, increasing trend in IV coverage in the elderly population (p < 0.001). Coverage increased from 31.3% in 1998/99 to 48.3% in 2010/11. After 2006/07, however, IV coverage in the elderly has remained near 50%, which suggests that there has been a slowdown in the growth trend. Thus, in 2010, the 75% WHO target in this major risk group had not been met. This result indicates that there is a need to improve the influenza vaccination strategy in Portugal to comply with the ambitious coverage goals proposed by WHO.
The major pandemic threats of the last decade had an effect on seasonal influenza vaccination. There was a significant increase in vaccine uptake in the general population in 2003/04 (p = 0.032) and in 2005/06 (p = 0.018). The 2009/10 seasonal vaccine coverage in the general population was not significantly higher when accounting for the baseline trend, but the 12.9% of vaccination occurred in individuals <15 years old. Although not the highest of all the seasons, this result was significant when accounting for vaccination trend in this age group during the past decade.
Nichol KL: Influenza vaccination in the elderly: impact on hospitalisation and mortality. Drugs Aging. 2005, 22 (6): 495-515. 10.2165/00002512-200522060-00004.
Mair M, Grow RW, Mair JS, Radanovich LJ: Universal influenza vaccination: the time to act is now. Biosecur Bioterror. 2006, 4 (1): 20-40. 10.1089/bsp.2006.4.20.
World Health Organisation, Global Influenza Programme: Public health research agenda for influenza: version1. 2009, Geneva, http://apps.who.int/csr/disease/influenza/research_agenda/en/index.html, accessed on January 19, 2013
Centers for Disease Control and Prevention: Prevention and control of seasonal influenza with vaccines: recommendations of the advisory committee on immunization practices (ACIP). MMWR. 2009, 58 (RR- 8): 1-52.
World Health Organization: Global Pandemic Influenza Action Plan to Increase Vaccine Supply: Progress Report 2008. 2009, Geneva, http://www.who.int/vaccine_research/Global_Pandemic_Influenza.pdf, accessed January 20, 2013
Tam D, Lee S, Lee S: Impact of severe acute respiratory syndrome and the perceived avian influenza epidemic on the increased rate of influenza vaccination among nurses in Hong Kong. Infect Control Hosp Epidemiol. 2008, 3 (29): 256-261.
Wilder-Smith A, Ang B: The role of influenza vaccine in healthcare workers in the era of severe acute respiratory syndrome. Ann Acad Med. 2003, 5 (32): 573-575.
Sahly H, Keitel W: Pandemic H5N1 vaccine development: an update. Expert Rev Vaccines. 2008, 7 (2): 241-247. 10.1586/147605220.127.116.11.
Seale H, Heywood AE, McLaws M, Ward KF, Lowbridge CP, Van D, MacIntyre CR: Why do I need it? I am not at risk! public perceptions towards the pandemic (H1N1) 2009 vaccine. BMC Infect Dis. 2010, 10 (99): http://www.biomedcentral.com/content/pdf/1471-2334-10-99.pdf, accessed December 2, 2013
Schwarzinger M, Flicoteaux R, Cortarenoda S, Obadia Y, Moatti J-P: Low acceptability of a/H1N1 pandemic vaccination in French adult population: did public health policy fuel public dissonance?. PLoS One. 2010, 5 (4): http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0010199, accessed December 2,2013
Arda B, Durusoy R, Yamazhan T, Sipahi OR, Taşbakan M, Pullukçu H, Erdem E, Ulusoy S: Did the pandemic have an impact on influenza vaccination attitude? a survey among health care workers. BMC Infect Dis. 2011, 11 (87): http://www.ncbi.nlm.nih.gov/pubmed/21473763, accessed December2, 2013.
World Health Organization: WHO recommends influenza vaccine composition for Northern Hemisphere. 2005, http://www.who.int/mediacentre/news/notes/2005/np05/en/, accessed on June 5, 2008, –2006 influenza season
Ministério da Saúde. Direcção-Geral da Saúde: Gripe: vacinação contra a gripe em 2005/2006. 2005, Lisboa: Circular Informativa Nº: 48/DT. 19/09/05
Ministério da Saúde. Direcção-Geral da Saúde: Gripe: vacinação contra a gripe em 2006/2007. 2006, Lisboa: Circular Informativa Nº: 40/DIR/G. 21/09/06
Ministério da Saúde. Direcção-Geral da Saúde: Vacinação contra a gripe sazonal em 2009/2010. 2009, Lisboa: Circular Informativa Nº: 33/DSPCD
Ministério da Saúde. Direcção‒Geral da Saúde: Campanha de vacinação contra a infecção pelo vírus da gripe pandémica (H1N1) 2009. 2009, Lisboa: Circular normativa N.º: 17A/DSPCD.13/11/09
Contreiras T, Nunes B, Branco MJ: Em casa, pelo telefone, observamos saúde: Descrição e avaliação de uma metodologia. 2003, Instituto Nacional de Saúde Dr. Ricardo Jorge. Lisboa: Observatório Nacional de Saúde
Kennedy C: Evaluating the effects of screening for telephone service in dual frame RDD surveys. Public Opin Q. 2007, 71 (5): 750-771. 10.1093/poq/nfm050.
Brick J: Nonresponse bias in dual frame sample of cell and landline numbers. Public Opin Q. 2006, 70 (5): 780-793. 10.1093/poq/nfl031.
Rao JNK, Scott AJ: On chi-squared tests for multiway contingency tables with cell proportions estimated from survey data. Ann Stat. 1984, 12: 46-60. 10.1214/aos/1176346391.
Rao JNK, Thomas DR: Analysis of categorical response data from complex surveys: an upraise and update. Analysis of Survey Data. Edited by: Chambers R, Skinner C. 2003, New York: John Wiley & Sons
SPSS Inc: Statistical Package for the Social Sciences [computer program]. 2007, Chicago: SPSS, Ver. 16 (SPSS Ver. 16.0)
StataCorp: Stata Statistical Software: Release 12[computer program]. 2011, College Station, TX: StataCorp LP
Vaux S, Cauteren DV, Guthmann JP, Le Strat Y, Vaillant V, Valk H, Lévy-Bruhl D: Influenza vaccination coverage against seasonal and pandemic influenza and their determinants in France: a cross-sectional survey. BMC Public Health. 2011, 11: 30-10.1186/1471-2458-11-30. http://www.biomedcentral.com/1471-2458/11/30, accessed March 13, 2013
Holm MV, Blank PR, Szucs TD: Developments in influenza vaccination coverage in England, Scotland and Wales covering five consecutive seasons from 2001 to 2006. Vaccine. 2007, 25: 7931-7938. 10.1016/j.vaccine.2007.09.022.
Kronemana MW, van Essen GA, Tacken MAJB, Paget WJ, Verheij R: Does a population survey provide reliable influenza vaccine uptake rates among high-risk groups? a case-study of the Netherlands. Vaccine. 2004, 22: 2163-2170. 10.1016/j.vaccine.2003.11.049.
Blank PR, Szucs TD: Seasonal Influenza Vaccination in Europe:. 2006, Switzerland: Institute of Social and Preventive Medicine, University of Zurich, http://www.eswi.org/myUploadData/files/Seasonal%20Influenza%20Vaccination%20in%20Europe.pdf, accessed on July 6, 2008, /2007 Coverage Rate in 11 European Countries
Mereckiene J, Cotter S, Weber JT, Nicoll A, Lévy-Bruhl D, Ferro A, Tridente G, Zanoni G, Berra P, Salmaso S, O’Flanagan D: Low coverage of seasonal influenza vaccination in the elderly in many European countries. Eurosurveillance. 2008, 13: 41-
Blank PR, Schwenkglenks M, Sucks TD: Vaccination coverage rates in eleven European countries during two consecutive influenza seasons. J Infect. 2009, 58: 441-453.
World Health Organization: Influenza Vaccination for the. 2003, http://www.who.int/influenza/vaccines/sars/en/index.html, accessed on June 5, 2010, –2004 Season: Recommendation in the Context of Concern about SARS
Holm HV, Blank PR, Szucs TH: Trends in influenza vaccination coverage rates in Germany over five seasons 2001 to 2006. BMC Infect Dis. 2007, 7: 144-10.1186/1471-2334-7-144.
Brewer NT, Chapman GB, Gibbons FX, Gerard M, McCaul KD, Weinstein ND: Meta-analysis of the relationship between risk perception and health behaviour: the example of vaccination. Health Psychol. 2007, 26: 136-145. http://www.unc.edu/~ntbrewer/pubs/2007,%20brewer,%20chpaman,%20gibbons,%20et%20al.pdf, accessed January 5, 2011
Leppin A, Aro AR: Risk perceptions related to SARS and avian influenza: theoretical foundations of current empirical research. Int J Behav Med. 2009, 16: 7-29. 10.1007/s12529-008-9002-8.
Brandt C, Rabenau HF, Bornmann S, Gottschalk R, Wicker S: The impact of the 2009 influenza A (H1N1) pandemic on attitudes of healthcare workers toward seasonal influenza vaccination 2010/11. Euro Surveill. 2011, 16: http://www.eurosurveillance.org/ViewArticle.aspx?ArticleId=19854, accessed on December 5, 2012
Schwarzinger M, Flicoteaux R, Cortarenoda S, Obadia Y, Moatti JP: Low acceptability of a/H1N1 pandemic vaccination in French adult population: did public health fuel public dissonance?. PLoS One. 2010, 5 (4): e10199-10.1371/journal.pone.0010199. http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0010199, accessed January 5, 2013
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/13/1130/prepub
The authors declare that they have no competing interests.
CP participated in drafting the manuscript and in the statistical analysis. BN participated in the design and coordination of the study, in the statistical analysis, and reviewed the manuscript. MJ reviewed the manuscript and participated in its design and organization. All authors read and approved the final manuscript.