Side-by-side comparison of parent vs. technician-collected respiratory swabs in low-income, multilingual, urban communities in the United States
BMC Public Health volume 22, Article number: 103 (2022)
Home-based swabbing has not been widely used. The objective of this analysis was to compare respiratory swabs collected by mothers of 7–12-year-olds living in low-income, multilingual communities in the United States with technician collected swabs.
Retrospective data analysis of respiratory samples collected at home by mothers compared to technicians. Anterior nasal and throat specimens collected using flocked swabs were combined in dry tubes. Test was done using TaqMan array cards for viral and bacterial pathogens. Cycle threshold (Ct) values of ribonuclease P (RNP) gene were used to assess specimen quality. Ct < 40 was interpreted as a positive result. Concordance of pathogen yield from mother versus technician collected swabs were analyzed using Cohen’s Kappa coefficients. Correlation analysis, paired t-test, and Wilcoxon signed-rank test for paired samples were used for RNP Ct values.
We enrolled 36 households in Cincinnati (African American) and 44 (predominately Chinese or Latino) in Boston. In Cincinnati, eight of 32 (25%) mothers did not finish high school, and 11 (34%) had finished high school only. In Boston, 13 of 44 (30%) mothers had less than a high school diploma, 23 (52%) had finished high school only. Mother versus technician paired swabs (n = 62) had similar pathogen yield (paired t-test and Wilcoxon signed rank test p-values = 0.62 and 0.63, respectively; 95% confidence interval of the difference between the two measurements = − 0.45–0.75). Median Ct value for RNP was 22.6 (interquartile range, IQR = 2.04) for mother-collected and 22.4 (IQR = 2.39) for technician-collected swabs (p = 0.62). Agreement on pathogen yield between samples collected by mothers vs. technicians was higher for viruses than for bacterial pathogens, with high concordance for rhinovirus/enterovirus, human metapneumovirus, and adenovirus (Cohen’s kappa coefficients ≥80%, p < 0.0001). For bacterial pathogens, concordance was lower to moderate, except for Chlamydia pneumoniae, for which kappa coefficient indicated perfect agreement.
Mothers with a range of education levels from low-income communities were able to swab their children equally well as technicians. Home-swabbing using dry tubes, and less invasive collection procedures, could enhance respiratory disease surveillance.
Specimens collected from the upper-respiratory tract can be used to help guide patient management and infection control measures and are widely used as a surveillance tool to monitor circulation of respiratory pathogens [1,2,3]. Home-based swabbing to collect respiratory samples has not been widely used but could support control measures to reduce transmission levels in the community such as isolation of cases, mask wearing and interventions like contact tracing, and to enhance patient access to testing, reducing the pressure on healthcare systems during public health crises [4, 5]. During the 2009 influenza pandemic, for example, England was able to better ascertain disease incidence in communities by relying on self-swabbing and shipment of samples to reference laboratories . With the COVID-19 pandemic, some recent studies have explored the reliability of home-based swabbing, specimen quality, and strategies related to choices in specimen types and transport media [7,8,9,10]. Nonetheless, performance data of home-based swabbing among underserved communities are limited, especially in areas where lack of health insurance and language barriers might reduce access to community health facilities, accentuating inequities in morbidity . In our study of home-based swabbing among low-income populations in two U.S. cities, we asked mothers to collect respiratory swabs from their children and compared those with swabs collected by technicians.
This retrospective data analysis was drawn from the Green Housing Study, which was designed to explore health outcomes among families with children ages 7–12 years with asthma who lived in low-income federal government-subsidized housing. The study focused on two low-income communities—one in Cincinnati, Ohio, which was entirely African American, and the other in Boston, Massachusetts, which was predominantly Chinese and Latino. One child per household was selected for this study [12, 13].
We asked mothers to collect nasal and throat swabs from their child when the child experienced an episode of acute respiratory illness (ARI). ARI was defined as the presence of three or more of the following symptoms for > 24 h: fever, stuffy/runny nose, cough, sore throat, body aches, or fatigue, or whenever the child was thought to have a cold or “the flu”.
We gave each mother a sample collection kit with storage and handling instructions (See Supplementary for instruction leaflet). To ensure that the mother understood the procedure, the study coordinator offered to help swab the child during the enrollment visit. Mothers were told to contact the study coordinator for specimen pickup as soon as they swabbed their child. We analyzed the ability of mothers to collect swabs from their child by comparing pathogen yield and quality of specimens with those obtained by trained technicians.
Participating mothers were advised to collect respiratory specimens within 24–36 h of their child’s symptom onset. We asked parents to store samples in their refrigerator until pickup by the technician as close in time as possible to when the mother swabbed the child (but not ≥5 days after symptom onset). During the pickup visit, the technician also collected nasal and throat swabs from the child using the same instructions provided to the mothers. Specimens were collected using a pair of flocked swabs. One swab was placed into each nostril and a second one was used to swab the posterior pharynx. Nasal and throat swabs were combined in a dry tube. A set of controls was introduced mid-study, we asked mothers and technicians to swab asymptomatic children on pre-defined days. All swabs were transported on ice to the reference laboratory and stored at − 70 °C until testing at the Division of Viral Diseases laboratory, Centers for Disease Control and Prevention (CDC), Atlanta, GA. Samples were analyzed in batches within the study period (2011–2013).
Specimens were tested using TaqMan array cards, a microfluidic, 384-well real-time PCR platform capable of rapid, simultaneous testing of multiple clinical specimens for a variety of respiratory pathogens (including viruses and bacteria), plus controls . The cards also feature a human specimen control assay that detects the ribonuclease P (RNP) gene we used as a proxy for the quality of samples collected by mothers vs. technicians. Cycle threshold (Ct) values are inversely related to the copy number of human or viral RNA; Ct < 40 was interpreted as a positive result.
We assessed concordance and discordance of detectable pathogens from mother-collected nasal and throat swabs compared with those collected by technicians using Cohen’s Kappa coefficients . We applied Landis and Koch guidelines for interpretation of kappa values where 0.41 to 0.60 indicates moderate agreement, 0.61 to 0.80 indicates substantial agreement, and 0.81 to 1.0 almost perfect agreement) . Boxplots were created and Pearson’s correlation coefficients calculated to compare RNP Ct values from mother-collected vs. technician-collected samples. Parametric paired t-tests and non-parametric Wilcoxon signed-rank test due to non-normal distribution and the small sample size were used to examine statistically significant differences between the two measurements. We also examined concordance of pathogen detection and quality of specimen comparing mother-collected vs. technician-collected swabs stratified by whether the child was swabbed while symptomatic or as asymptomatic (i.e., part of the set of controls). Bland-Altman plots were performed to also show degree of agreement between the RNP Ct values of the paired samples comparing mother vs. technician collected specimens and to contrast findings with that from correlation coefficient .
Bilingual technicians in Cantonese and Mandarin or fluent in Spanish explained the study procedures to the participants. The technicians obtained informed consent from mothers and assent from children. The study was approved by Institutional Review Boards of CDC and the Harvard T.H. Chan School of Public Health.
During 2011–2013, we enrolled 80 households in the study: 36 in Cincinnati and 44 in Boston. All 36 Cincinnati households identified their children as Black or African American. Among the 44 mothers in households in Boston, 37 (84%) were born outside the U.S. mainland. These included 27 (61%) born in China, with Cantonese or Mandarin as their spoken language, and 12 (26%) reported their children were of Hispanic/Latino ethnicity. In Cincinnati, eight of 32 (25%) mothers did not finish high school, 11 (34%) had finished high school only, and 13 (41%) had enrolled in college. In Boston, 13 of 44 (30%) mothers had less than a high school diploma, 23 (52%) had finished high school only, and eight had enrolled in college. Among mothers in Cincinnati, 19 of 32 (59%) reported smoking cigarettes, compared with one of 43 (2%) in Boston (Table 1).
In both cities, mothers reported similar rates (approximately 36%) of a child having at least one episode of asthma attack in the previous 3 months from time of enrollment. During that period, seven of 13 (54%) children in Cincinnati visited an emergency department for asthma attack, compared with five of 13 (28%) in Boston. Among the children in Cincinnati, 19 of 33 (58%) had received influenza vaccinations, as had 31 of 37 (84%) of the children in Boston (Table 1).
A total of 190 swabs were collected from December 2011 through November 2013. Those included 62 mother-technician pairs of nasal and throat swabs (n = 124 swabs) collected from symptomatic (n = 44 swabs) and asymptomatic (n = 80 swabs) children. The other 66 swabs were collected only by mothers, either from asymptomatic children during the enrollment visit (n = 40) or when their child was ill, but a technician was not able to collect a paired sample on time (n = 26). Of the 62 paired samples, we had complete date of collection for 53 pairs. The median difference in days between parental vs. technician swabbing was 1 day (range: 0–5 days).
Agreement on pathogen yield between samples collected by mothers vs. technicians was higher for viruses than for bacterial pathogens, with high concordance for rhinovirus/enterovirus, human metapneumovirus, and adenovirus (Cohen’s kappa coefficients ≥80%, p < 0.0001). For bacterial pathogens, concordance was lower to moderate, except for Chlamydia pneumoniae, for which kappa coefficients indicated perfect agreement (Table 2). Similar results were observed when the analysis was performed separately for asymptomatic and symptomatic children using paired swabs (data not shown).
The median Ct values for RNP were 22.6 (IQR: 2.04) for the 62 mother-collected swabs and 22.4 (IQR: 2.39) for the paired technician-collected swabs (Fig. 1, panel A). A paired t-test showed no significant difference in RNP value for the 62 swab pairs (mean of the differences = 0.15; paired t-test and Wilcoxon signed rank test p-values = 0.62 and 0.63, respectively; 95% confidence interval [CI] of the difference between the two measurements was-0.45–0.75). The RNP values between the two were significantly correlated (r = 0.31; p = 0.01). When paired swabs were stratified by asymptomatic and symptomatic status (Fig. 1 – panel B and C), RNP values were still not significantly different between those collected by mothers vs. technicians (asymptomatic p = 0.95 [mean difference = − 0.02; 95% CI = -0.75–0.71]; symptomatic p = 0.39 [mean difference = 0.46; 95% CI = -0.64–1.57]). Non-parametric Wilcoxon signed-rank test p-values (0.92 for the asymptomatic and 0.59 for the symptomatic) were similar to those of the parametric paired t-test. The median Ct value for RNP from swabs collected by mothers (n = 66), not paired with technician-collected swabs, was 22.1 (IQR: 2.1). A Bland-Altman plot of the difference between the RNP values obtained from mother vs. technician collected samples against their mean was done, also considering asymptomatic and symptomatic pairs, validated the findings from correlation coefficient. See Supplementary Figure for plots.
With simple instructions and less invasive specimen collection procedures (i.e., anterior nasal swabs combined with oral swabs instead of nasopharyngeal swabs), mothers with predominately low education levels from low-income communities were able to swab their children equally as well as trained technicians. Moreover, the use of a dry tube, with no viral transport media, did not affect the viability of the specimens. RNP human specimen control Ct values and the yield of pathogens were comparable between samples collected by mothers and technicians. Our study demonstrates the utility of home-swabbing to ascertain disease among communities with less access to health facilities to improve overall understanding of respiratory disease patterns.
We demonstrate strong proficiency in home-based swab sample collection among mothers with lower levels of education and language barriers. An earlier pilot study focused primarily on an immigrant Latino population in New York City and reported good results for self-swabbing proficiency . A similar study in Australia showed the yield of viral detections from parent-collected nasal and throat swabs from children to be comparable to healthcare worker-collected swabs. However, in contrast with mothers in our study, participating parents in that study had a higher education level, and most were healthcare professionals themselves .
Although nasal swabs might be less sensitive in detecting some viruses when compared with nasopharyngeal swabs or aspirates, the ease of anterior nasal collection procedures allows for self-collection and home-based collection of specimens . Combining nasal and throat swabs improves pathogen yield and is less invasive, and therefore, more tolerable [10, 21]. Molecular methods based on reverse transcription-polymerase chain reaction are becoming increasingly available for identification of respiratory etiologies as part of routine care and surveillance activities. Because these tests are more sensitive than culture or antigen tests for many of the circulating pathogens , less invasive specimen collection with comparable yields becomes acceptable. Multipathogen molecular platforms like the one used in our study, detecting various respiratory pathogens simultaneously, can vary in sensitivity and specificity, which ultimately would need to be assessed when interpreting pathogen yield [14, 23,24,25]. However, our finding that mothers can collect respiratory specimens given simple instructions corroborates the use of home-swabbing in the context of public health response and surveillance initiatives.
To make samples easier to handle, we used dry tubes. This did not affect the quality of the samples collected by mothers and technicians, as measured by RNP Ct values, which were 22 for both groups. We showed that respiratory swab specimens transported in dry tubes are stable up to 5 days if kept refrigerated (~ 4 °C). A recent SARS-COV-2 study validated the use of dry polyester and foam surrogate swabs by demonstrating that samples were stable through 72 h when refrigerated or after exposure to high temperature (simulating transport without cold chain) . For other respiratory viruses, previous studies have confirmed good recovery of viral RNA from dry cotton or flocked swabs after storage for up to 2 weeks at room temperature . Influenza virus detection rates from dry swabs stored for up to 5 days at room temperature in the same study were higher than those from paired samples collected in viral transport media and assayed by cell culture and immunofluorescence . To improve monitoring of circulating respiratory viruses of public health importance, dry swabs should be considered for respiratory disease surveillance in areas with limited cold-chain access. Using dry swabs might also offset transport media shortages in times of high demand for respiratory testing (e.g., epidemics) and might be less costly than transport media, which tend to have limited shelf lives.
For this study, we were not able to confirm whether the yield of pathogens detected in samples stored in dry tubes would be the same as that stored in transport media because both groups used dry tubes for collection. Additionally, discussion of pathogen yields is only relative as standard curves were not used to perform absolute quantitation. Dry storage might not be adequate for influenza surveillance as performed by some national influenza centers that need to isolate viruses for vaccine composition. We also were not able to explain the higher concordance between mothers and technicians in virus detection compared with bacterial pathogen detection. Perhaps, in the absence of an active infection, different timing of swabbing in the same site could yield slightly different results for a low titer target. This is something to further explore in studies of bacterial colonization of the upper respiratory tract.
The ability to use home-based anterior nasal and oral swabbing, combined with storage and shipment of dry clinical specimens for virus testing, could significantly improve respiratory disease surveillance in remote or resource-limited settings, and could reduce the demand on the healthcare system in times of public health crisis. Further validation of this approach at large scale should be considered, and discussions on the relevance of this approach to improve respiratory pathogen surveillance in the U.S. are warranted.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Chadha M, Hirve S, Bancej C, et al. Human respiratory syncytial virus and influenza seasonality patterns-early findings from the WHO global respiratory syncytial virus surveillance. Influenza Other Respir Viruses. 2020;14(6):638–46. https://doi.org/10.1111/irv.12726.
Li L, Wang H, Liu A, et al. Comparison of 11 respiratory pathogens among hospitalized children before and during the COVID-19 epidemic in Shenzhen, China. Virol J. 2021;18(1):202. Published 2021 Oct 9. https://doi.org/10.1186/s12985-021-01669-y.
Centers for Disease Control and Prevention. The National Respiratory and Enteric Virus Surveillance System (NREVSS) 2021, assessed November 22, 2021, https://www.cdc.gov/surveillance/nrevss/index.html.
Krumholz HM. Where have all the heart attacks gone? Except for treating Covid-19, many hospitals seem to be eerily quiet. New York Times 2020, April 6. Available at: https://www.nytimes.com/2020/04/06/well/live/coronavirus-doctors-hospitals-emergency-care-heart-attack-stroke.html. Accessed 2 May 2021.
Sykes DL, Faruqi S, Holdsworth L, Crooks MG. Impact of COVID-19 on COPD and asthma admissions, and the pandemic from a patient's perspective. ERJ Open Res. 2021;7(1):00822–2020. Published 2021 Feb 8. https://doi.org/10.1183/23120541.00822-2020.
Elliot AJ, Powers C, Thornton A, et al. Monitoring the emergence of community transmission of influenza A/H1N1 2009 in England: a cross sectional opportunistic survey of self sampled telephone callers to NHS Direct. BMJ. 2009;339:b3403. Published 2009 Aug 27. https://doi.org/10.1136/bmj.b3403.
Parikh BA, Wallace MA, McCune BT, Burnham CD, Anderson NW. The Effects of "Dry Swab" Incubation on SARS-CoV-2 Molecular Testing [published online ahead of print, 2021 Feb 25]. J Appl Lab Med. 2021;jfab010. https://doi.org/10.1093/jalm/jfab010.
Padgett LR, Kennington LA, Ahls CL, et al. Polyester nasal swabs collected in a dry tube are a robust and inexpensive, minimal self-collection kit for SARS-CoV-2 testing. PLoS One. 2021;16(4):e0245423. Published 2021 Apr 14. https://doi.org/10.1371/journal.pone.0245423.
Wehrhahn MC, Robson J, Brown S, et al. Self-collection: an appropriate alternative during the SARS-CoV-2 pandemic. J Clin Virol. 2020;128:104417. https://doi.org/10.1016/j.jcv.2020.104417.
Kandel CE, Young M, Serbanescu MA, et al. Detection of severe acute respiratory coronavirus virus 2 (SARS-CoV-2) in outpatients: a multicenter comparison of self-collected saline gargle, oral swab, and combined oral-anterior nasal swab to a provider collected nasopharyngeal swab [published online ahead of print, 2021 Jan 13]. Infect Control Hosp Epidemiol. 2021:1–5. https://doi.org/10.1017/ice.2021.2.
Wang ML, Behrman P, Dulin A, et al. Addressing inequities in COVID-19 morbidity and mortality: research and policy recommendations. Transl Behav Med. 2020;10(3):516–9. https://doi.org/10.1093/tbm/ibaa055.
Coombs KC, Chew GL, Schaffer C, et al. Indoor air quality in green-renovated vs. non-green low-income homes of children living in a temperate region of US (Ohio). Sci Total Environ. 2016;554-555:178–85. https://doi.org/10.1016/j.scitotenv.2016.02.136.
Perovich LJ, Ohayon JL, Cousins EM, et al. Reporting to parents on children's exposures to asthma triggers in low-income and public housing, an interview-based case study of ethics, environmental literacy, individual action, and public health benefits. Environ Health. 2018;17(1):48. Published 2018 May 21. https://doi.org/10.1186/s12940-018-0395-9.
Weinberg GA, Schnabel KC, Erdman DD, et al. Field evaluation of TaqMan Array card (TAC) for the simultaneous detection of multiple respiratory viruses in children with acute respiratory infection. J Clin Virol. 2013;57(3):254–60. https://doi.org/10.1016/j.jcv.2013.03.016.
McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb). 2012;22(3):276–82.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.
Altman DG, Bland JM. Measurement in medicine: the analysis of method comparison studies. Statistician. 1983;32:307–17.
Vargas CY, Wang L, Castellanos de Belliard Y, et al. Pilot study of participant-collected nasal swabs for acute respiratory infections in a low-income, urban population. Clin Epidemiol. 2016;8:1–5. Published 2016 Jan 6. https://doi.org/10.2147/CLEP.S95847.
Lambert SB, Whiley DM, O’Neill NT, et al. Comparing nose-throat swabs and nasopharyngeal aspirates collected from children with symptoms for respiratory virus identification using real-time polymerase chain reaction. Pediatrics. 2008;122(3):e615–20. https://doi.org/10.1542/peds.2008-0691.
Ricci S, Lodi L, Citera F, et al. How home anterior self-collected nasal swab simplifies SARS-CoV-2 testing: new surveillance horizons in public health and beyond. Virol J. 2021;18(1):59. Published 2021 Mar 20. https://doi.org/10.1186/s12985-021-01533-z.
Kim C, Ahmed JA, Eidex RB, et al. Comparison of nasopharyngeal and oropharyngeal swabs for the diagnosis of eight respiratory viruses by real-time reverse transcription-PCR assays. PLoS One. 2011;6(6):e21610. https://doi.org/10.1371/journal.pone.0021610.
Sakthivel SK, Whitaker B, Lu X, et al. Comparison of fast-track diagnostics respiratory pathogens multiplex real-time RT-PCR assay with in-house singleplex assays for comprehensive detection of human respiratory viruses. J Virol Methods. 2012;185(2):259–66. https://doi.org/10.1016/j.jviromet.2012.07.010.
Salez N, Vabret A, Leruez-Ville M, et al. Evaluation of Four Commercial Multiplex Molecular Tests for the Diagnosis of Acute Respiratory Infections. PLoS One. 2015;10(6):e0130378. Published 2015 Jun 24. https://doi.org/10.1371/journal.pone.0130378.
Liu K, Jing H, Chen Y, et al. Evaluation of TaqMan Array card (TAC) for the detection of 28 respiratory pathogens. BMC Infect Dis. 2020;20(1):820. Published 2020 Nov 10. https://doi.org/10.1186/s12879-020-05562-x.
Diaz MH, Waller JL, Theodore MJ, et al. Development and implementation of multiplex TaqMan Array cards for specimen testing at child health and mortality prevention surveillance site laboratories. Clin Infect Dis. 2019;69(Suppl 4):S311–21. https://doi.org/10.1093/cid/ciz571.
Moore C, Corden S, Sinha J, Jones R. Dry cotton or flocked respiratory swabs as a simple collection technique for the molecular detection of respiratory viruses using real-time NASBA. J Virol Methods. 2008;153(2):84–9. https://doi.org/10.1016/j.jviromet.2008.08.001.
We thank the families who allowed us into their homes and all the participating children. In addition, we thank Dr. Alicia Fry and Dr. Dean Erdman who assisted with training for the technicians on swab collection. Finally, we are grateful to the technicians and study site investigators in Cincinnati and Boston who made this study possible, especially Dr. Tiina Reponen and Dr. Gary Adamkiewicz, respectively.
Conflict of interest
The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.
The Green Housing Study was funded by internal CDC funds and through an interagency agreement from the U.S. Department of Housing and Urban Development (#I-PHI-01062). The U.S. Department of Housing and Urban Development did not participate in the analysis, interpretation of results or writing of the manuscript.
Ethics approval and consent to participate
Bilingual technicians in Cantonese and Mandarin or fluent in Spanish explained the study procedures to the participants. The technicians obtained consent from mothers and assent from children. The study was approved by CDC’s Institutional Review Board and the Harvard T.H. Chan School of Public Health. All methods were carried out in accordance with relevant guidelines and regulations.
Consent for publication
None of the authors have a conflict of interest to declare. This analysis has not been presented elsewhere. After completion of this study, Dr. S. Chaves left the CDC in 2019 and currently works for Sanofi Pasteur, Lyon, France.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Chaves, S.S., Park, JH., Prill, M.M. et al. Side-by-side comparison of parent vs. technician-collected respiratory swabs in low-income, multilingual, urban communities in the United States. BMC Public Health 22, 103 (2022). https://doi.org/10.1186/s12889-022-12523-3