First nationwide web-based surveillance system for influenza-like illness in pregnant women: participation and representativeness of the French G-GrippeNet cohort
BMC Public Health volume 16, Article number: 253 (2016)
Pregnancy is a risk factor for severe influenza resulting in increased risks of hospitalisation and death in mothers and their new-borns. Our objective was to assess the representativeness and participation of French women to a new web-based collaborative tool for data collection and monitoring of Influenza Like Illness (ILI) during pregnancy.
During the 2014/2015 influenza season, pregnant women living in metropolitan France were enrolled through a web platform (https://www.grippenet.fr/). Then throughout the season, participants were asked to report, on a weekly basis, if they had experienced symptoms of ILI. Representativeness was assessed by comparing the characteristics of participants to those of the French National Perinatal Survey. For each participant, the participation rate was the number of weekly questionnaires completed, divided by the length of follow-up (in weeks). Predictors of active participation (participation rate >15 %) were assessed by multivariate logistic regression.
A total of 153 women were enrolled. Participants were older (mean age 34 years vs. 29 years) and more highly educated (high school level 89 % versus 52 %) than the general population of pregnant women in France, but the sample did not differ on pregnancy-related characteristics (parity, history of hospitalisation during a previous pregnancy). The median rate of participation was high (78 %, interquartile range: 34–96). Higher educational level and participation to a previous GrippeNet.fr season were associated with active participation.
Despite small sample size and lack of representativeness, the retention rate was high, suggesting that pregnant women are prone to adhere to a longitudinal follow-up of their health status via the Internet.
Some infections are more severe in pregnant women and most may also harm the fetus or the new-born. This is the case for influenza that results in higher risks for hospitalisation and death in pregnant women even in the absence of underlying comorbidities [1–3]. Influenza also increases the risks of miscarriage, low birth weight, and prematurity [4–6].
Seasonal influenza surveillance systems provide essential information to describe the diffusion of the epidemics and monitor the incidence through the season . In France, the surveillance is traditionally based on health care systems, excluding people who do not consult for influenza-like illness (ILI) [8, 9]. New technologies and widening of the Internet coverage have opened the way to real-time collaborative data collection and led to the development of innovative approaches for disease surveillance [10, 11]. In 2011, a nationwide surveillance system for ILI, GrippeNet.fr was introduced in France. It is based on the online participation of volunteers from the general population and allows us to gather data on incidence of ILI in the community, and on vaccination coverage, vaccine effectiveness and health-care usage [12, 13]. The participation steadily increased from the first season to reach 6632 participants in 2014/2015.
In pregnant women and women who plan a pregnancy, several web-based studies have already been undertaken, mainly focusing on pre-conception risk factors for adverse pregnancy outcomes [14–18]. Regarding influenza, only one annual transversal web-based survey is conducted each year since 2010/2011 in the USA to assess vaccination coverage among pregnant women [19, 20]. No specific real-time surveillance of ILI in pregnant women is conducted, to our knowledge, and the incidence of the disease is not well documented in this population.
The G-GrippeNet (Grossesse-GrippeNet in French, Pregnancy-GrippeNet) project aimed to describe the epidemiology of seasonal influenza during the influenza season among pregnant women in France. Objectives of the present study were to report data on representativeness of the cohort and factors associated with participation for the opening season 2014/2015.
The G-GrippeNet project, dedicated to pregnant women, hereafter referred to as GGNET, was integrated into the national GrippeNet.fr web-based annual campaign conducted between November 19th 2014 and April 14th 2015. As described previously , GrippeNet.fr (https://www.grippenet.fr/) is an online surveillance project integrated to the European project Influenzanet [21, 22]. Participants are volunteers passively recruited (after communication actions on television, radio, newspapers and others (Influenzanet), poster, and leaflets) in the general population. They register, through their e-mail address, directly on the GrippeNet.fr website. After inclusion, participants are invited to fill in a first questionnaire dealing with general background information. Then, they are invited to self-report on a weekly basis on their health status, reporting easily identifiable symptoms of influenza or stating the absence of symptoms.
Participants to GGNET had to: 1) be pregnant (regardless of the trimester) 2) be resident in mainland France; 3) read French language; 4) have active email address and Internet access.
Women enrolled were followed throughout the influenza season and asked weekly whether or not they experienced any influenza-like illness. ILI was defined as the combination of the three following criteria: (i) the sudden onset of symptoms, (ii) at least one of the following signs: fever or chills or headache or myalgia or asthenia and (iii) at least one of the following respiratory symptoms: cough, sore throat, shortness of breath (dyspnea) .
The intake questionnaire covered age, household size and composition, location of home and workplace, education level, occupation, vaccination status for the previous and present influenza season, the presence of a chronic disease that may lead to more severe influenza case (i.e. chronic respiratory or cardiac diseases, diabetes, and immunosuppression) . Specific questions designed for pregnant women, added to the questionnaire, included pregnancy related factors such as gravidity, parity, estimated date of delivery, history of hospitalisation during a previous pregnancy. Participants were reminded weekly, via an email newsletter, to report through a brief weekly questionnaire (WQ) whether or not they experienced any ILI symptoms since the last seven days. All questionnaires were self-administered. In addition, every month, participants received newsletters on prevention and treatment of infectious diseases during pregnancy, which were used to maintain a communication channel with each participant as a motivation purpose during the season.
Recruitment of participants
We promoted the project through articles published on web sites dedicated to pregnant women and young mothers’ health. Two national clinical research networks (iREIVAC and GO-CIC), including 30 maternity centres, were also solicited by the investigators. Among them, 10 agreed to participate and promoted the study by displaying advertising posters in their waiting rooms. These 10 maternity centres accounted for 4 % of the total number of delivery per year in the country. No incentives were offered for participation in the study. Consent to participation to the study was obtained through an online form.
Coverage was calculated by dividing the number of participants to GGNET by the average number of pregnant women in France over the study period. The latter was based on national statistics , and calculated by summing the number of ingoing pregnancies at the beginning of the study to the number of new pregnancies occurring during the study period. Variables were analysed using Fisher’s exact test or Wilcoxon rank-sum test as appropriate.
To assess the representativeness of our cohort we compared the socio-demographical characteristics of participants of our cohort to those retrieved from the 2010 French National Perinatal Survey . The National Perinatal Surveys are conducted routinely in France and all births occurring during a given week in all maternity units in France are included. Women are interviewed between delivery and discharge about their socio-demographic characteristics, prenatal care and health behaviour. Data on health and obstetric care are collected from medical records. The sample is representative of all births at a national level .
To evaluate the participation to the study, two indicators: participation rate and percentage of “active participants” were calculated and compared to those of other (non-pregnant) participants to the general GrippeNet.fr cohort. For each participant, the participation rate was the number of WQ completed, divided by the length of follow-up (in weeks). The follow-up started at inclusion (registration on the platform) and ended at delivery. Participants were considered as “active participants” if their participation rate was above 15 % (definition used in previous GrippeNet.fr and Influenzanet studies [12, 22, 25]). Indicators of participation were estimated in our sample and compared to those calculated among non-pregnant participants to the general cohort of GrippeNet.fr. Factors associated with active participation within the GGNET cohort were assessed using a multivariate logistic regression model. We first tested all sociodemographics and pregnancy-related variables in univariate analyses. Second, we entered explicative variables with a p-value <0.20 in a multivariate model. We then used a backward stepwise selection procedure (removal criteria: p > 0.05) to built the final model. Finally, the variable « participation to a previous season of GrippeNet.fr”, which was a known factor of higher active participation in literature [12, 26], was added to the model as an adjustment variable. The results of both analyses are presented.
Statistical analysis was performed using R software (version 3.2) .
Privacy and ethical approval
Data were anonymous and participants were free to withdraw from the study at any time. This study was conducted in agreement with French regulations on privacy, data collection and treatment and was approved by the Comité consultatif sur le traitement de l’information en matière de recherche (CCTIRS, Advisory committee on information processing for research, authorisation 11.565) and by the Commission Nationale de l’Informatique et des Libertés (CNIL, French Data Protection Authority, authorisation DR-2012–024).
Over the study period - November 19th 2014 and April 14th 2015–153 women were enrolled among 780 000 eligible (coverage: 20 individuals per 100,000 pregnant women). Participation was widespread in the country, with participants coming from 53 out of 96 mainland French departments. Overall, mean age was 34 years (standard deviation, SD 4.3). One hundred thirty five (88 %) had a university degree and 111 (74 %) were employed at the time of the study. Forty (27 %), 48 (32 %) and 61 (41 %) women were respectively in their first, second and third trimester of pregnancy. Nulliparity concerned 73 participants (48 %). Thirty-eight participants (25 %) gave birth during the influenza period. (Table 1)
Compared to the general population of French pregnant women, participants of the GGNET cohort were older (mean age 34.0 years (SD 4.3) vs. 29.7 years (SD 5.3)), more highly educated, more frequently employed and less frequently smokers (Table 1). On the other hand, no difference was found on Body Mass Index (BMI), parity or history of hospitalisation during a previous pregnancy.
During the study period, 152 pregnant women filled in at least one WQ, and a total of 1363 WQ were completed. The mean time of follow-up was 9.0 weeks (SD 6.6). The median rate of participation was 78 % (Inter Quartile Range IQR, 34–96) and 128 (84 %) participants were considered as ‘active participants’.
Compared to the other participants of GrippeNet.fr, the median rate of participation in pregnant participants to GGNET did not differ (78 % (IQR, 34–96) vs. 87 % (IQR, 45–96) respectively, p-value 0.37). Likewise, the percentage of active participants did not differ between the two cohorts (84 % vs. 84 %, GGNET vs. GrippeNet.fr, respectively, p-value 0.92). (Table 2)
Educational level and occupation were selected for the first step of the multivariate analysis of predictors of active participation. Participation to a previous GrippeNet.fr season was then included in the second step of the procedure. At the end of the model selection procedure, although not significant in the multivariate model, higher educational level and previous participation tended to be associated with an active participation (Odds Ratio, OR 2.52, IC95% 0.70–8.11 and OR 2.93, IC95% 0.90–13.27, respectively). (Table 3)
GGNET is the first nationwide web-based influenza surveillance system specifically targeting pregnant women. For the first season in 2014/2015, 153 pregnant women were enrolled. Participants were distributed in more than half of French departments, differently from previous birth-cohorts approaches that were mainly local . However, the sample was small (reaching a coverage of 20/100 000) and non-representative. Pregnant women of our cohort were older, with a higher degree of education and more frequently employed than the general population of pregnant women in France. Active participation was high and similar to that observed in participants of the general GrippeNet.fr cohort.
Only a few web-based studies have been conducted so far in the pregnant population. Most of them were large transversal studies assessing women behaviour or effects of interventions [16, 18, 28–30]. To our knowledge, no web-based survey has offered a longitudinal follow-up on a weekly basis. The strengths of our study are: a wide geographical distribution of participants at a national scale, and a high active participation rate. The latter being probably related to the simplicity of follow-up (taking only few minutes per week with weekly automatic email reminders).
Main limitations are the small sample size and the non-representativeness of the sample. Despite our efforts, we calculated that our sample represented only 0.02 % of French women who were pregnant during the study period. Our communication campaign was based on both online (web sites dedicated to pregnant women and young mothers’ health) and offline methods (advertising posters displayed in waiting rooms of large maternity centres). Among women who agreed to participate, half reported to have heard about the study via the Internet and only 15 % through health care workers. This suggests that the Web and associated online media (e.g. mobile phone app) are of crucial importance to assemble a large cohort and ensure high participation for the next influenza seasons. Moreover, previous work has shown that in France, contrary to what observed in other Influenzanet countries, participants recruited through online communication have a higher follow-up participation . The lack of representativeness of our sample, likely induced by the non-representative nature of the Internet population, thus translating into coverage biases, and the self-selection of participants, also called the ‘volunteer effect’ (i.e. those who choose to volunteer for studies may differ in lifestyle and health from those who decline)  was similarly observed for the entire Grippenet.fr cohort in comparison to the general population. In previous GrippeNet.fr seasons, other authors reported a large underrepresentation of the youngest and oldest age classes in the participants compared to the French population [12, 25]. These findings were also reported in web-based birth cohorts . This underlines that the next communication campaigns should preferentially target younger pregnant women. Again, the use of new, Internet-based communication channels is likely to have the largest impact in this population.
In this study, the active participation rate was high and factors that we found associated with active participation in multivariate analysis are in line with previous research that has shown that different factors can influence participation rate. Socio-demographic factors, such as low educational level or unemployment, as well as unhealthy life style factors (smoking, alcohol consumption) are typically related to increased risk of non-response and attrition in epidemiological studies [32, 33]. This was also observed in a large study on the European Influenzanet cohort . Longitudinal studies are important in public health research for identifying risk factors related to negative health outcomes. However, a major concern in such studies is that the longer the follow-up period, the higher are the chances for dropout. In our study, active participation of pregnant women was similar to that observed in participants of the general GrippeNet.fr cohort.
Social medias and widening of the Internet coverage have opened the way to real-time collaborative data collection and led to the development of innovative approaches for disease surveillance. This longitudinal web-based surveillance study proved feasible in pregnant women and will bring original data on the epidemiology of influenza in this population. It will be helpful to promote vaccination in this population.
We report the results of the first prospective cohort study aiming to describe influenza epidemic in pregnant women. Despite the small sample size and lack of representativeness on certain demographic variables, the active participation rate was high, suggesting that pregnant women are prone to adhere to a longitudinal follow-up of their health status via the Internet. In multivariate analysis, higher educational level and previous participation tended to be associated with an active participation. To reach younger participants with mixed educational level, it also seems crucial, besides traditional channels, to encourage enrolment via online social media sites and apps.
Dodds L, McNeil SA, Fell DB, Allen VM, Coombs A, Scott J, et al. Impact of influenza exposure on rates of hospital admissions and physician visits because of respiratory illness among pregnant women. CMAJ. 2007;176:463–8.
Irving WL, James DK, Stephenson T, Laing P, Jameson C, Oxford JS, et al. Influenza virus infection in the second and third trimesters of pregnancy: a clinical and seroepidemiological study. BJOG Int J Obstet Gynaecol. 2000;107:1282–9.
Neuzil KM, Reed GW, Mitchel EF, Simonsen L, Griffin MR. Impact of influenza on acute cardiopulmonary hospitalizations in pregnant women. Am J Epidemiol. 1998;148:1094–102.
HARRIS JW. Influenza occurring in pregnant women: a statistical study of thirteen hundred and fifty cases. J Am Med Assoc. 1919;72:978–80.
Griffith GW, Adelstein AM, Lambert PM, Weatherall JA. C. Influenza and Infant Mortality. BMJ. 1972;3:553–6.
Pierce M, Kurinczuk JJ, Spark P, Brocklehurst P, Knight M, UKOSS. Perinatal outcomes after maternal 2009/H1N1 infection: national cohort study. BMJ. 2011;342:d3214.
WHO | World Health Organization [Internet]. WHO [cité 2015 mai 5]; Available from: http://www.who.int/influenza/surveillance_monitoring/en/. Accessed 5 May 2015.
Valleron AJ, Bouvet E, Garnerin P, Ménarès J, Heard I, Letrait S, et al. A computer network for the surveillance of communicable diseases: the French experiment. Am J Public Health. 1986;76:1289–92.
French GPs Sentinelles network > France > The Sentinelles network [Internet]. [cité 2015 août 12]; Available from: https://websenti.u707.jussieu.fr/sentiweb/?page=presentation. Accessed 12 Aug 2015.
van Gelder MMHJ, Bretveld RW, Roeleveld N. Web-based questionnaires: the future in epidemiology? Am J Epidemiol. 2010;172:1292–8.
Eysenbach G. Infodemiology and infoveillance: framework for an emerging Set of public health informatics methods to analyze search, communication and publication behavior on the internet. J Med Internet Res. 2009;11, e11.
Debin M, Turbelin C, Blanchon T, Bonmarin I, Falchi A, Hanslik T, et al. Evaluating the feasibility and Participants’ representativeness of an online nationwide surveillance system for influenza in France. PLoS ONE. 2013;8:e73675.
Debin M, Colizza V, Blanchon T, Hanslik T, Turbelin C, Falchi A. Effectiveness of 2012–2013 influenza vaccine against influenza-like illness in general population: Estimation in a French web-based cohort. Hum. Vaccines Immunother. [Internet] 2014 [cité 2014 mai 8];10. Available from: http://www.landesbioscience.com/journals/vaccines/article/27439/. Accessed 8 May 2015.
Pandolfi E, Agricola E, Gonfiantini MV, Gesualdo F, Romano M, Carloni E, et al. Women participating in a web-based preconception study have a high prevalence of risk factors for adverse pregnancy outcomes. BMC Pregnancy Childbirth. 2014;14:169.
Allais G, Rolando S, De Lorenzo C, Manzoni GC, Messina P, Benedetto C, et al. Migraine and pregnancy: an internet survey. Neurol Sci Off J Ital Neurol Soc Ital Soc Clin Neurophysiol. 2013;34 Suppl 1:S93–9.
Evans WD, Wallace Bihm J, Szekely D, Nielsen P, Murray E, Abroms L, et al. Initial Outcomes From a 4-Week Follow-Up Study of the Text4baby Program in the Military Women’s Population: Randomized Controlled Trial. J. Med. Internet Res. [Internet] 2014 [cité 2015 mai 15];16. Available from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4051747/. Accessed 15 May 2015.
Firestone R, Cheng S, Pearce N, Douwes J, Merletti F, Pizzi C, et al. Internet-based birth-cohort studies: is this the future for epidemiology? JMIR Res Protoc. 2015;4, e71.
Richiardi L, Baussano I, Vizzini L, Douwes J, Pearce N, Merletti F. Feasibility of recruiting a birth cohort through the Internet: the experience of the NINFEA cohort. Eur J Epidemiol. 2007;22:831–7.
Ding H, Black CL, Ball S, Donahue S, Izrael D, Williams WW, et al. Influenza vaccination coverage among pregnant women--United States, 2013–14 influenza season. MMWR Morb Mortal Wkly Rep. 2014;63:816–21.
Centers for Disease Control and Prevention (CDC). Influenza vaccination coverage among pregnant women--United States, 2012–13 influenza season. MMWR Morb Mortal Wkly Rep. 2013;62:787–92.
Influenzanet: Home [Internet]. [cité 2015 mai 5]; Available from: https://www.influenzanet.eu/. Accessed 5 May 2015.
Paolotti D, Carnahan A, Colizza V, Eames K, Edmunds J, Gomes G, et al. Web-based participatory surveillance of infectious diseases: the Influenzanet participatory surveillance experience. Clin Microbiol Infect Off Publ Eur Soc Clin Microbiol Infect Dis. 2014;20:17–21.
Cantarelli P, Debin M, Turbelin C, Poletto C, Blanchon T, Falchi A, et al. The representativeness of a European multi-center network for influenza-like-illness participatory surveillance. BMC Public Health. 2014;14:984.
Insee - Population - En 2013, 811 510 bébés sont nés en France - Plus de 800 000 bébés par an depuis 2005 [Internet]. [cité 2015 août 31]; Available from: http://www.insee.fr/fr/themes/document.asp?ref_id=if9. Accessed 31 Aug 2015.
Blondel B, Lelong N, Kermarrec M, Goffinet F. National Coordination Group of the National Perinatal Surveys. Trends in perinatal health in France from 1995 to 2010. Results from the French National Perinatal Surveys. J Gynécologie Obstétrique Biol Reprod. 2012;41:e1–15.
Bajardi P, Vespignani A, Funk S, Eames KT, Edmunds WJ, Turbelin C, et al. Determinants of follow-Up participation in the internet-based European influenza surveillance platform influenzanet. J Med Internet Res. 2014;16, e78.
R: The R Project for Statistical Computing [Internet]. [cité 2015 oct 5]; Available from: https://www.r-project.org/. Accessed 5 Oct 2015.
Lupattelli A, Spigset O, Twigg MJ, Zagorodnikova K, Mårdby AC, Moretti ME, et al. Medication use in pregnancy: a cross-sectional, multinational web-based study. BMJ Open. 2014;4, e004365.
Adolfsson A, Linden K, Sparud-Lundin C, Larsson P-G, Berg M. A web-based support for pregnant women and new mothers with type 1 diabetes mellitus in Sweden (MODIAB-Web): study protocol for a randomized controlled trial. Trials. 2014;15:513.
Herbec A, Brown J, Tombor I, Michie S, West R. Pilot randomized controlled trial of an internet-based smoking cessation intervention for pregnant smokers (‘MumsQuit’). Drug Alcohol Depend. 2014;140:130–6.
Bajardi P, Paolotti D, Vespignani A, Eames K, Funk S, Edmunds WJ, et al. Association between recruitment methods and attrition in internet-based studies. PLoS ONE. 2014;9, e114925.
Nilsen RM, Vollset SE, Gjessing HK, Skjærven R, Melve KK, Schreuder P, et al. Self-selection and bias in a large prospective pregnancy cohort in Norway. Paediatr Perinat Epidemiol. 2009;23:597–608.
Van Loon AJM, Tijhuis M, Picavet HSJ, Surtees PG, Ormel J. Survey non-response in the Netherlands: effects on prevalence estimates and associations. Ann Epidemiol. 2003;13:105–10.
We are very grateful to the following people and institutions who made significant contributions to the running of the study: Armelle Telang from the National Network of Site Management Organization in Obstetrics and Gynecology (GO-CIC), Nezha Lenzi and Mohammed Rahoui from the Innovative Clinical Research Network in Vaccinology (I-REIVAC), Véronique Tessier from the DHU Risks in Pregnancy and Albane Tresse from the Premup foundation.
This work was supported by the French National Research Agency (HARMSFLU, grant number ANR-12-MONU-0018), a grant from the Société de Pathologie Infectieuse de Langue Française (SPILF) and a postgraduate studentship award from the Agence Regionale de Santé Île-de-France.
The authors declare that they have no competing interest.
All authors contributed to the design and implementation of the study; PL, CG, CT and SK analysed the data, PL and SK wrote the first draft; and all authors reviewed and edited the manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Loubet, P., Guerrisi, C., Turbelin, C. et al. First nationwide web-based surveillance system for influenza-like illness in pregnant women: participation and representativeness of the French G-GrippeNet cohort. BMC Public Health 16, 253 (2016). https://doi.org/10.1186/s12889-016-2899-y
- Web-based study