Effectiveness of the trivalent influenza vaccine in Navarre, Spain, 2010–2011: a population-based test-negative case–control study
BMC Public Health volume 13, Article number: 191 (2013)
Some studies have evaluated vaccine effectiveness in preventing outpatient influenza while others have analysed its effectiveness in preventing hospitalizations. This study evaluates the effectiveness of the trivalent influenza vaccine in preventing outpatient illness and hospitalizations from laboratory-confirmed influenza in the 2010–2011 season.
We conducted a nested case–control study in the population covered by the general practitioner sentinel network for influenza surveillance in Navarre, Spain. Patients with influenza-like illness in hospitals and primary health care were swabbed for influenza testing. Influenza vaccination status and other covariates were obtained from health care databases. Using logistic regression, the vaccination status of laboratory-confirmed influenza cases was compared with that of test-negative controls, adjusting for age, sex, comorbidity, outpatient visits in the previous 12 months, health care setting, time between symptom onset and swabbing, period and A(H1N1)pdm09 vaccination. Effectiveness was calculated as (1-odds ratio)x100.
The 303 confirmed influenza cases (88% for A(H1N1)pdm09 influenza) were compared with the 286 influenza test-negative controls. The percentage of persons vaccinated against influenza was 4.3% and 15.7%, respectively (p<0.001). The adjusted estimate of effectiveness was 67% (95% CI: 24%, 86%) for all patients and 64% (95% CI: 8%, 86%) in those with an indication for vaccination (persons age 60 or older or with major chronic conditions). Having received both the 2010–2011 seasonal influenza vaccine and the 2009–2010 pandemic influenza vaccine provided 87% protection (95% CI: 30%, 98%) as compared to those not vaccinated.
The 2010–2011 seasonal influenza vaccine had a moderate protective effect in preventing laboratory-confirmed influenza.
Influenza is an important health problem that can lead to serious complications in persons with risk factors [1, 2]. Annual vaccination is the primary measure for preventing influenza and its complications . Because the influenza vaccine composition is adapted each season to the viruses in circulation, its effectiveness varies . In the absence of clinical trials, observational studies are the main way to evaluate vaccine effectiveness in each season, however, a number of biases affecting comparability between vaccinated and unvaccinated persons must be overcome [5–8]. Studies looking at poorly specified outcomes tend to underestimate the effect of the intervention , whereas those that analyze virologically-confirmed cases reduce this problem [4, 9]. A design that compares confirmed influenza cases with test-negative controls tends to improve the comparability and is easy to carry out, thus this type of study has come to be widely used [4, 9–14]. Several studies have applied this methodology in patients recruited in primary care, which provides an estimate of the effect of the vaccine in preventing mild cases [9–12]. Other studies have analyzed hospitalized patients, which provides an estimate of vaccine effectiveness in preventing serious forms of illness [13, 14].
This study uses a test-negative case–control design nested in a population-based cohort to evaluate the effectiveness of the influenza vaccine in the 2010–2011 season in preventing laboratory-confirmed influenza, including both outpatient and hospitalized patients.
The present study was based on electronic clinical records in the region of Navarre, Spain. The Navarre Ethical Committee for Medical Research approved the study protocol.
The Navarre Health Service provides health care, free at point of service, to 97% of the population of the region. The clinical records have been computerized since 2000, and include those from primary care, hospital admissions and laboratory test results.
In Navarre the trivalent inactivated non-adjuvanted vaccine was recommended and offered free of charge to people aged 60 or over and to those with major chronic conditions. Other people can also be vaccinated if they pay for the vaccine. In the 2010–2011 season the vaccine included strains A/California/07/2009(H1N1)-like, A/Perth/16/2009(H3N2)-like and B/Brisbane/60/2008-like virus . Monovalent influenza A(H1N1)2009 vaccine  had been administered to individuals with major chronic conditions in the 2009–2010 season. Precise instructions for registering each dose were given to all vaccination points .
Influenza surveillance was based on automatic reporting from the electronic medical records of all cases of influenza-like illness (ILI) from all primary health care centers and hospitals. In both settings ILI was considered to be the sudden onset of any general symptom (fever or feverishness, malaise, headache or myalgia) in addition to any respiratory symptom (cough, sore throat or shortness of breath). A sentinel network of 74 primary care physicians and pediatricians were asked to take swabs, after obtaining verbal informed consent, from all their patients diagnosed with ILI whose symptoms had begun preferably less than 5 days previously. An agreed protocol of care for influenza cases was applied in hospitals, which specified early detection and nasopharyngeal swabbing of all hospitalized patients with ILI. Swabs were processed by real-time reverse transcription polymerase chain reaction (RT-PCR) assay in two laboratories in the region, and positive samples were characterized for influenza A (H1 and H3), A(H1N1)pdm09 and B virus. Two positive swabs for each week were sent to the national influenza reference laboratory for genotyping.
Study design and statistical analysis
We carried out a nested case–control study based on electronic clinical records. The study population included all persons over 6 months of age who received medical care from physicians in the sentinel network. Health care workers and institutionalized persons were excluded. The study population included 97,597 persons. The study began the first week in which influenza virus was detected following the first 15 days of the vaccination campaign and ended the week preceding two consecutive weeks in which none of the ILI patients recruited tested positive for influenza. Accordingly, the study covered the period from week 43 of 2010 to week 12 of 2011.
The cases were all patients diagnosed with influenza syndrome in primary care or in hospitals who were confirmed for influenza virus. The controls were patients with influenza syndrome who were negative for influenza virus.
The vaccination status for the trivalent 2010–2011 seasonal influenza vaccine and monovalent A(H1N1)pdm09 influenza vaccine was obtained from the online regional vaccination register . Subjects were considered to be protected 14 days after vaccine administration.
From the electronic health care records we obtained the following baseline characteristics: sex, age, district of residence, major chronic conditions and primary health care visits in the previous 12 months. Logistic regression techniques were used to calculate crude odds ratios (ORs), and ORs adjusted for the mentioned variables, for health care setting, for swabbing within 4 days of symptom onset and for date of visit grouped into 4-week periods. When necessary, exact logistic regression was used.
The effects of the 2010–2011 seasonal vaccine and the monovalent A(H1N1)pdm09 vaccine were evaluated as independent variables in one model, and as a combined variable (unvaccinated, only seasonal vaccine, only pandemic vaccine, or both vaccines) in a different model.
Specific analyses were made under different situations: comparing cases of each type of influenza with negative controls, including only patients in whom influenza vaccination was indicated because they were 60 years of age or older or had some major chronic condition, considering only patients in primary care or only hospitalized patients, and including only swabs taken in the first 4 days after symptom onset. All adjusted analyses included both influenza vaccines, except the analysis of influenza B, since the pandemic vaccine did not include this virus. All relevant covariates were maintained in the models for each specific analysis. Percentages were compared by χ2. Vaccine effectiveness was estimated as (1-OR)x100.
Description of cases and controls
The weekly number of swabbed patients followed the pattern of ILI incidence in the population (Figure 1). During the study period, 589 ILI patients were swabbed, 530 in primary health care and 59 in hospitals. Some 51.4% (303) were confirmed for influenza virus: 267 for influenza A(H1N1)pdm2009, 3 for influenza A(H3N2) and 33 for influenza B. Thirty-one of these strains were characterized in the national influenza reference laboratory: 23 were A/California/07/2009(H1N1), 1 was A/England/142/2010(H1N1), 2 were A/HongKong/2121/2010(H3N2), 1 was B/Bangladesh/3333/2007(Yamagata) and 4 were B/Brisbane/60/2008(Victoria).
Compared with confirmed cases of influenza, test-negative controls had a higher proportion of persons who were age 65 or over, who had consulted a physician five or more times in the last year, who had more than one major chronic condition, who were diagnosed between week 51 of 2010 and 2 of 2011, and who were treated in the hospital. A smaller proportion of cases than controls had been vaccinated against influenza A(H1N1)pdm2009, and this was also true for the 2010–2011 seasonal vaccine. There were no differences between cases and controls by sex, residence or swabbing within 4 days of symptom onset. All patients were swabbed within 8 days of symptom onset (Table 1).
Effectiveness of the 2010–2011 seasonal influenza vaccine
Compared with test-negative controls, a smaller proportion of confirmed influenza cases had received the 2010–2011 seasonal influenza vaccine (OR: 0.24; 95% CI: 0.13; 0.46; p<0.001). In the analysis adjusted for age, sex, major chronic conditions, outpatient visits in the previous year, swabbing within 4 days of symptom onset, health care setting, period and previous monovalent pandemic vaccination, the effectiveness of the seasonal vaccine was 67% (95% CI: 24%, 86%; p=0.009). In the analysis restricted to swabs taken within the first 4 days after symptom onset, the estimate was 65% (95% CI: 16%, 85%; p=0.018).
The effectiveness of the 2010–2011 influenza vaccine against cases of influenza A(H1N1)pdm2009 was 61% (95% CI: 9%, 83%; p=0.030). Using exact logistic regression techniques, influenza vaccine effectiveness against influenza B virus was estimated as 93% (95% CI: 36%, 100%; p=0.017).
In the analysis restricted to persons in whom the vaccine was indicated, the effectiveness was 64% (95% CI: 8%, 86%; p=0.034).
In the analysis that included only patients diagnosed in primary care, vaccine effectiveness rose to 68% (95% CI: 17%, 87%; p=0.019). Estimates of the vaccine effectiveness were similar for people aged less than 50 (73%; 95% CI: -21%, 94%; p=0.086) and those aged 50 or over (69%; 95% CI: 0%, 91%; p=0.050) (Table 2).
Effect of the monovalent A(H1N1)pdm09 vaccine received in the previous season
A smaller proportion of influenza cases than controls had received the pandemic vaccine (2.0% and 9.1%, respectively; p=0.001). However, in the multivariate analyses adjusted for the main covariates and for 2010–2011 seasonal vaccination, the protective effect of the pandemic vaccine was partially diluted and did not reach statistical significance (Table 2).
Table 3 shows the specific effectiveness of both vaccines as a combined variable (unvaccinated, only seasonal vaccine, only pandemic vaccine, or both vaccines). In persons who had not received the pandemic vaccine, the effect of the 2010–2011 seasonal vaccine in preventing confirmed influenza cases was 64% (95% CI: 14%, 85%; p=0.022), whereas having received both vaccines provided 87% (95% CI: 30%, 98%; p=0.017) protection against laboratory-confirmed influenza in the 2010–2011 season. The interaction term between the two vaccines was not statistically significant (p=0.502). Estimates of vaccine effectiveness were similar both in the analysis restricted to cases of influenza A(H1N1)pdm2009 and in the analysis of the target population for vaccination.
The results of this study show a moderate protective effect of the 2010–2011 seasonal influenza vaccine in preventing laboratory-confirmed influenza during the 2010–2011 seasonal period in Navarre, during which there was a good match between the circulating viruses and those included in the vaccine. The vaccine was shown to be effective against the two main viruses circulating in the region during the season: A(H1N1)pdm09 virus and B virus. Unlike other studies, ours included both outpatient and hospital cases systematically recruited in a previously defined population.
The effectiveness we found is similar or slightly higher than that described in other studies made in outpatients in the 2010–2011 season, with small differences that could be explained by the pattern of viruses circulating in each place [10, 11].
The results concerning a possible residual effect of monovalent influenza A(H1N1)pdm09 vaccination in the previous season were not conclusive. As in other studies, a greater protective effect was observed with both vaccines than with seasonal vaccine alone [11, 12], but in our study this difference was not statistically significant. Influenza A(H1N1)pdm09 virus was found in 88% of the laboratory-confirmed influenza cases and was included in both vaccines. Since this was a new virus with which most of the population had had no previous contact, dual vaccination may have helped to achieve a better immune response [19–21]. However, this finding could be due to biases since previous receipt of the pandemic vaccine may be an indicator of health-seeking behaviours.
The seasonal influenza vaccine had a high effectiveness against influenza B. Most characterizations of influenza B viruses were similar to B/Brisbane/60/2008(Victoria), which was the strain included in the seasonal vaccine .
Longer time between symptom onset and swabbing has been associated with reduced sensitivity in virus detection, which could underestimate vaccine effectiveness . We controlled for this effect mainly in the design of our study, since 97% of the swabs were taken within the first 4 days after symptom onset. Moreover, all analyses were adjusted for this variable and the analysis was repeated after eliminating the cases swabbed after the first 4 days, with no relevant changes found in the estimate of vaccine effectiveness.
In Navarre, the vaccine was indicated for all persons aged 60 or over and for persons with major chronic diseases that increase the risk of influenza complications. Restricting the analysis to this population group, the effectiveness of the influenza vaccine was similar, despite the fact that factors such as advanced age or some immunodepression may be more common among people with major chronic conditions, which would explain poor response to the vaccine.
Primary care patients made up the bulk of subjects in our study and, when the analysis was limited to these patients, the effectiveness of the vaccine was maintained. The number of cases treated in hospitals was small, which did not allow us to obtain a statistically significant estimate of the effect of the vaccine in preventing hospitalized cases. Nevertheless, a study conducted in the same region and season to evaluate vaccine effectiveness in preventing hospitalizations with confirmed influenza in a risk population found a 59% vaccine effectiveness .
This case–control analysis included only laboratory-confirmed cases and compared them with test-negative controls recruited in the same health care settings before either patient or physician knew the laboratory result, a fact that provides better comparability between cases and controls and reduces selection bias . This type of design has been used in other studies that have evaluated influenza vaccine effectiveness [10–14]. The case–control study was nested in a population-based cohort for which extensive and reliable databases are available, and which is treated by sentinel physicians trained to detect and swab ILI patients, all of which helps to prevent unmeasured confounding . All the analyses were adjusted for the effect of the most commonly recognized confounding factors.
These results support a moderate protective effect of the 2010–2011 seasonal vaccine and do not rule out a possible low residual effect of the monovalent pandemic vaccine against influenza in the 2010–2011 season. Our findings can be added to those of other studies that highlight the importance of annual immunization of high-risk populations against influenza, complemented with other preventive initiatives such as promotion of basic hygiene measures and avoiding contact with influenza cases.
Glezen WP: Serious morbidity and mortality associated with influenza epidemics. Epidemiol Rev. 1982, 4: 25-44.
Thompson WW, Shay DK, Weintraub E, Brammer L, Bridges CB, Cox NJ, Fukuda K: Influenza-associated hospitalizations in the United States. JAMA. 2004, 292: 1333-1340. 10.1001/jama.292.11.1333.
Nichol KL, Nordin JD, Nelson DB, Mullooly JP, Hak E: Effectiveness of influenza vaccine in the community-dwelling elderly. N Engl J Med. 2007, 357: 1373-1381. 10.1056/NEJMoa070844.
Osterholm MT, Kelley NS, Sommer A, Belongia EA: Efficacy and effectiveness of influenza vaccines: a systematic review and meta-analysis. Lancet Infect Dis. 2012, 12: 36-44. 10.1016/S1473-3099(11)70295-X.
Orenstein WA, Bernier RH, Hinman AR: Assessing vaccine efficacy in the field. Further observations. Epidemiol Rev. 1988, 10: 212-240.
Valenciano M, Kissling E, Ciancio BC, Moren A: Study designs for timely estimation of influenza vaccine effectiveness using European sentinel practitioners networks. Vaccine. 2010, 28: 7381-7388. 10.1016/j.vaccine.2010.09.010.
Jackson LA, Jackson ML, Nelson JC, Neuzil KM, Weiss NS: Evidence of bias in estimates of influenza vaccine effectiveness in seniors. Int J Epidemiol. 2006, 35: 337-344.
Jefferson T, Rivetti A, Rudin M, Pietrantonj A, Demicheli V: Efficacy and effectiveness of influenza vaccines in elderly people: a systematic review. Lancet. 2005, 366: 1165-1174. 10.1016/S0140-6736(05)67339-4.
Orenstein EW, De Serres G, Haber MJ, Shay DK, Bridges CB, Gargiullo P, Orenstein WA: Methodologic issues regarding the use of three observational study designs to assess influenza vaccine effectiveness. Int J Epidemiol. 2007, 36: 623-631. 10.1093/ije/dym021.
Kissling E, Valenciano M, Cohen JM, Oroszi B, Barret AS, Rizzo C, Stefanoff P, Nunes B, Pitigoi D, Larrauri A, Daviaud I, Horvath JK, O'Donnell J, Seyler T, Paradowska-Stankiewicz IA, Pechirra P, Ivanciuc AE, Jiménez-Jorge S, Savulescu C, Ciancio BC, Moren A: I-MOVE Multi-Centre Case Control Study 2010–11: Overall and Stratified Estimates of Influenza Vaccine Effectiveness in Europe. PLoS One. 2011, 6 (11): e27622-10.1371/journal.pone.0027622.
Pebody R, Hardelid P, Fleming D, McMenamin J, Andrews N, Robertson C, Thomas D, Sebastianpillai P, Ellis J, Carman W, Wreghitt T, Zambon M, Watson J: Effectiveness of seasonal 2010/11 and pandemic influenza A(H1N1)2009 vaccines in preventing influenza infection in the United Kingdom: mid-season analysis 2010/11. Euro Surveill. 2011, 16 (6): pii=19791-
Fielding JE, Grant KA, Garcia K, Kelly HA: Effectiveness of seasonal influenza vaccine against pandemic (H1N1) 2009 virus, Australia, 2010. Emerg Infect Dis. 2011, 17: 1181-1187. 10.3201/eid1707.101959.
Puig-Barberà J, Arnedo-Pena A, Pardo-Serrano F, Tirado-Balaguer MD, Pérez Vilar S, Silvestre-Silvestre E, Calvo-Mas C, Safont-Adsuara L, Ruiz-García M: Surveillance and Vaccine Evaluation Group during the autumn 2009 H1N1 pandemic wave in Castellón, Spain: Effectiveness of seasonal 2008–2009, 2009–2010 and pandemic vaccines, to prevent influenza hospitalizations during the autumn 2009 influenza pandemic wave in Castellón, Spain. A test negative, hospital-based, case–control study. Vaccine. 2010, 28: 7460-7467. 10.1016/j.vaccine.2010.09.042.
Castilla J, Martínez-Artola V, Salcedo E, Martínez-Baz I, Cenoz MG, Guevara M, Alvarez N, Irisarri F, Morán J, Barricarte A: Vaccine effectiveness in preventing influenza hospitalizations in Navarre, Spain, 2010–2011: cohort and case–control study. Vaccine. 2012, 30: 195-200. 10.1016/j.vaccine.2011.11.024.
World Health Organization: Recommended virus for influenza vaccines for use in the 2010–2011 northern hemisphere influenza. Wkly Epidemiol Rec. 2010, 85: 81-92.
World Health Organization: Availability of a candidate reassortant vaccine virus for the novel influenza A (H1N1) vaccine development. 2009, Geneva: WHO, http://www.who.int/csr/resources/publications/swineflu/ivr153_20090608_en.pdf,
Instituto de Salud Pública de Navarra: Protocolo de vacunación antigripal 2010–2011. Boletín Informativo nº 59. 2010, http://www.navarra.es/NR/rdonlyres/AECCD760-AB2A-4841-818A-FA53478FD6DC/165169/BOL59INTCampanaGripe.pdf,
Aguilar I, Reyes M, Martinez-Baz I, Guevara M, Albeniz E, Belza M, Castilla J: Use of the vaccination register to evaluate influenza vaccine coverage in seniors in the 2010/11 influenza season, Navarre, Spain. Euro Surveill. 2012, 17 (17): pii: 20154-
Clark TW, Pareek M, Hoschler K, Dillon H, Nicholson KG, Groth N, Stephenson I: Trial of 2009 influenza A (H1N1) monovalent MF59-adjuvanted vaccine. N Engl J Med. 2009, 361: 2424-2435. 10.1056/NEJMoa0907650.
Zhu FC, Wang H, Fang HH, Yang JG, Lin XJ, Liang XF, Zhang XF, Pan HX, Meng FY, Hu YM, Liu WD, Li CG, Li W, Zhang X, Hu JM, Peng WB, Yang BP, Xi P, Wang HQ, Zheng JS: A novel influenza A (H1N1) vaccine in various age groups. N Engl J Med. 2009, 361: 2414-2423. 10.1056/NEJMoa0908535.
Plennevaux E, Sheldon E, Blatter M, Reeves-Haché MK, Denis M: Immune response after a single vaccination against 2009 influenza A H1N1 in USA: a preliminary report of two randomised controlled phase 2 trials. Lancet. 2010, 375: 41-48. 10.1016/S0140-6736(09)62026-2.
Groenwold RH, Hoes AW, Nichol KL, Hak E: Quantifying the potential role of unmeasured confounders: the example of influenza vaccination. Int J Epidemiol. 2008, 37: 1422-1429. 10.1093/ije/dyn173.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/13/191/prepub
The members of the Primary Health Care Sentinel Network of Navarre are as follows: I Abad, J Agreda, P Aldaz, E Álvarez, JJ Arana, I Arceiz, E Arina, MD Artajo, A Arza, K Ayerdi, B Azagra, C Bernués, J Berraondo, C Bolea, A Brugos, S Buil, B Cano, JC Cenoz, F Cia, F Cortés, C Chérrez, B Churío, EM Da Costa, J Díez Espino, M Doiz, FJ Escribano, MJ Esparza, L Fanlo, C Fernández Alfaro, A Fernández Urtasun, B Flamarique, J Gamboa, ML Garcés, E Gembero, A Giner, P González Lorente, N Goñi, J Guillén, MJ Guillorme, JO Guiu, A Gulina del Pueyo, JC Gurbindo, MJ Guruchaga, S Gurucharri, JA Heras, MS Indurain, B Iñigo, SE Juan Belloc, O Lecea, MP León, JJ Longás, A Martínez Díaz, M Monge, M Moreno, U Navarro, FJ Orozco, M Orte, J Palau, F Pérez Afonso, P Pérez Pascual, MA Pous, A Prado, A Puig Arrastia, E Ridruejo, M Ramos, MA Rodríguez González, A Roig, MA Roncal, I Ruiz Puertas, C Sánchez Vázquez, MA Senosiain, J Sola, M Sota, P Uhalte, J Ulibarri, ME Ursua, IA Urtasun, G Varo, MJ Vigata, MT Virto, JM Vizcay, M Zabalza, J Zubicoa, A Mazón, A Navascués, A Petit.
This work was supported by the I-MOVE (Influenza Monitoring Vaccine Effectiveness in Europe) programme funded by the European Centre for Disease Prevention and Control (ECDC), by the Carlos III Institute of Health (GR09/0028 and PS09/01179), and by the Spanish Ministry of Health (EC11-302).
The authors declare that they have no competing interests.
IMB and JC designed the study, data analysis, interpreted the results and wrote the first draft of the article. MG participated in data analysis and interpretation. VMA, GR, MGC, JM, EA, FI, MA collected data and participated in the interpretation of the results. All authors revised and approved the final draft. IMB and JC are equally responsible for this article.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Martínez-Baz, I., Martínez-Artola, V., Reina, G. et al. Effectiveness of the trivalent influenza vaccine in Navarre, Spain, 2010–2011: a population-based test-negative case–control study. BMC Public Health 13, 191 (2013). https://doi.org/10.1186/1471-2458-13-191