Evaluation of Abbott BinaxNOW Rapid Antigen Test for SARS-CoV-2 Infection at Two Community-Based Testing Sites — Pima County, Arizona, November 3–17, 2020
Weekly / January 22, 2021 / 70(3);100–105
On January 19, 2021, this report was posted online as an MMWR Early Release.
Please note: This report has been corrected. An erratum has been published.
Jessica L. Prince-Guerra, PhD1; Olivia Almendares, MSPH1; Leisha D. Nolen, MD, PhD1; Jayleen K. L. Gunn, PhD1; Ariella P. Dale, PhD1,2,3; Sean A. Buono, PhD1; Molly Deutsch-Feldman, PhD1,3; Suganthi Suppiah, PhD1; LiJuan Hao, MD1; Yan Zeng, MS1; Valerie A. Stevens1; Kristen Knipe, MS1; Justine Pompey, PhD1; Christine Atherstone, PhD1,3; David P. Bui, PhD1,3; Tracy Powell, PhD1; Azaibi Tamin, PhD1; Jennifer L. Harcourt, PhD1; Patricia L. Shewmaker, PhD1; Magdalena Medrzycki, PhD1; Phili Wong, MS1; Shilpi Jain, PhD1; Alexandra Tejada-Strop, MS1; Shannon Rogers, MS1; Brian Emery1; Houping Wang, PhD1; Marla Petway, MPH1; Caitlin Bohannon, PhD1; Jennifer M. Folster, PhD1; Adam MacNeil, PhD1; Reynolds Salerno, PhD1; Wendi Kuhnert-Tallman, PhD1; Jacqueline E. Tate, PhD1; Natalie J. Thornburg, PhD1; Hannah L. Kirking, MD1; Khalilullah Sheiban, MD4; Julie Kudrna, MPA4; Theresa Cullen, MD4; Kenneth K. Komatsu, MPH2; Julie M. Villanueva, PhD1; Dale A. Rose, PhD1; John C. Neatherlin, MPH1; Mark Anderson, MD1; Paul A. Rota, PhD1; Margaret A. Honein, PhD1; William A. Bower, MD1 (View author affiliations)
View suggested citationSummary
What is already known about this topic?
The BinaxNOW rapid antigen test received Emergency Use Authorization by the Food and Drug Administration for testing specimens from symptomatic persons; performance among asymptomatic persons is not well characterized.
What is added by this report?
Sensitivity of the BinaxNOW antigen test, compared with polymerase chain reaction testing, was lower when used to test specimens from asymptomatic (35.8%) than from symptomatic (64.2%) persons, but specificity was high. Sensitivity was higher for culture-positive specimens (92.6% and 78.6% for those from symptomatic and asymptomatic persons, respectively); however, some antigen test-negative specimens had culturable virus.
What are the implications for public health practice?
The high specificity and rapid BinaxNOW antigen test turnaround time facilitate earlier isolation of infectious persons. Antigen tests can be an important tool in an overall community testing strategy to reduce transmission.
Rapid antigen tests, such as the Abbott BinaxNOW COVID-19 Ag Card (BinaxNOW), offer results more rapidly (approximately 15–30 minutes) and at a lower cost than do highly sensitive nucleic acid amplification tests (NAATs) (1). Rapid antigen tests have received Food and Drug Administration (FDA) Emergency Use Authorization (EUA) for use in symptomatic persons (2), but data are lacking on test performance in asymptomatic persons to inform expanded screening testing to rapidly identify and isolate infected persons (3). To evaluate the performance of the BinaxNOW rapid antigen test, it was used along with real-time reverse transcription–polymerase chain reaction (RT-PCR) testing to analyze 3,419 paired specimens collected from persons aged ≥10 years at two community testing sites in Pima County, Arizona, during November 3–17, 2020. Viral culture was performed on 274 of 303 residual real-time RT-PCR specimens with positive results by either test (29 were not available for culture). Compared with real-time RT-PCR testing, the BinaxNOW antigen test had a sensitivity of 64.2% for specimens from symptomatic persons and 35.8% for specimens from asymptomatic persons, with near 100% specificity in specimens from both groups. Virus was cultured from 96 of 274 (35.0%) specimens, including 85 (57.8%) of 147 with concordant antigen and real-time RT-PCR positive results, 11 (8.9%) of 124 with false-negative antigen test results, and none of three with false-positive antigen test results. Among specimens positive for viral culture, sensitivity was 92.6% for symptomatic and 78.6% for asymptomatic individuals. When the pretest probability for receiving positive test results for SARS-CoV-2 is elevated (e.g., in symptomatic persons or in persons with a known COVID-19 exposure), a negative antigen test result should be confirmed by NAAT (1). Despite a lower sensitivity to detect infection, rapid antigen tests can be an important tool for screening because of their quick turnaround time, lower costs and resource needs, high specificity, and high positive predictive value (PPV) in settings of high pretest probability. The faster turnaround time of the antigen test can help limit transmission by more rapidly identifying infectious persons for isolation, particularly when used as a component of serial testing strategies.
Paired upper respiratory swabs were collected at the same timepoint from persons aged ≥10 years receiving testing for SARS-CoV-2, the virus that causes coronavirus disease 2019 (COVID-19), at two Pima County Health Department community testing sites during November 3–17 (site A) and November 8–16 (site B). The sites offered SARS-CoV-2 testing to anyone in the community who wanted testing. A questionnaire capturing demographic information and current and past–14-day symptoms was administered to all participants. At both sites, a health care professional first collected a bilateral anterior nasal swab, using a swab provided in the BinaxNOW kit, immediately followed by a bilateral nasopharyngeal (NP) swab for real-time RT-PCR testing. Anterior nasal swabs were immediately tested on-site using the BinaxNOW antigen test according to the manufacturer’s instructions (4). NP swabs were stored in phosphate buffered saline at 39°F (4°C) and analyzed within 24–48 hours by real-time RT-PCR using either the CDC 2019-nCoV Real-Time RT-PCR Diagnostic Panel for detection of SARS-CoV-2 (5) (2,582 swabs) or the Fosun COVID-19 RT-PCR Detection Kit (6) (837 swabs). Viral culture*,† was attempted on 274 of 303 residual real-time RT-PCR specimens if either the real-time RT-PCR or BinaxNOW antigen test result was positive (the remaining 29 were not available for viral culture). Results from real-time RT-PCR and the BinaxNOW antigen test were compared to evaluate sensitivity, specificity, negative predictive value (NPV), and PPV. Statistical analyses were performed using SAS (version 9.4; SAS Institute). Cycle threshold (Ct) values from real-time RT-PCR were compared using a Mann-Whitney U Test; 95% confidence intervals (CIs) were calculated using the exact binomial method. The investigation protocol was reviewed by CDC and determined to be nonresearch and was conducted consistent with applicable federal law and CDC policy.§
Paired upper respiratory swabs were collected from 3,419 persons, including 1,458 (42.6%) from site A and 1,961 (57.4%) from site B (Table 1). Participants ranged in age from 10 to 95 years (median = 41 years) with 236 (6.9%) aged 10–17 years, 1,885 (55.1%) aged 18–49 years, 743 (21.7%) aged 50–64 years, and 555 (16.2%) aged ≥65 years. Approximately one third (31.4%) of participants identified as Hispanic or Latino, and three quarters (75.1%) identified as White.
At the time of testing, 827 (24.2%) participants reported at least one COVID-19–compatible sign or symptom,¶ and 2,592 (75.8%) were asymptomatic. Among symptomatic participants, 113 (13.7%) received a positive BinaxNOW antigen test result, and 176 (21.3%) received a positive real-time RT-PCR test result. Among asymptomatic participants, 48 (1.9%) received a positive BinaxNOW antigen test result, and 123 (4.7%) received a positive real-time RT-PCR test result.
Testing among symptomatic participants indicated the following for the BinaxNOW antigen test (with real-time RT-PCR as the standard): sensitivity, 64.2%; specificity, 100%; PPV, 100%; and NPV, 91.2% (Table 2); among asymptomatic persons, sensitivity was 35.8%; specificity, 99.8%; PPV, 91.7%; and NPV, 96.9%. For participants who were within 7 days of symptom onset, the BinaxNOW antigen test sensitivity was 71.1% (95% CI = 63.0%–78.4%), specificity was 100% (95% CI = 99.3%–100%), PPV was 100% (95% CI = 96.4%–100%), and NPV was 92.7% (95% CI = 90.2%–94.7%). Using real-time RT-PCR as the standard, four false-positive BinaxNOW antigen test results occurred, all among specimens from asymptomatic participants. Among 299 real-time RT-PCR positive results, 142 (47.5%) were false-negative BinaxNOW antigen test results (63 in specimens from symptomatic persons and 79 in specimens from asymptomatic persons).
Virus was recovered from 96 (35.0%) of 274 analyzed specimens that were positive by either test, including 85 (57.8%) of 147 with concordant positive results and 11 (8.9%) of 124 with false-negative BinaxNOW antigen test results. Virus was not recovered from any of the three available specimens with false-positive BinaxNOW antigen test results. Among the 224 specimens undergoing viral culture that were analyzed with the CDC 2019-nCoV Real-Time RT-PCR Diagnostic Panel for detection of SARS-CoV-2, median Ct values** were significantly higher for specimens with false-negative BinaxNOW antigen test results, indicating lower viral RNA levels than in those with concordant positive results (33.9 versus 22.0 in specimens from symptomatic persons [p<0.001] and 33.9 versus 22.5 in specimens from asymptomatic persons [p<0.001]) (Figure). Median Ct values for SARS-CoV-2 culture-positive specimens (22.1) were significantly lower than were those for culture-negative specimens (32.8) (p<0.001), indicating higher levels of viral RNA in culture-positive specimens. Among specimens with positive viral culture, the sensitivity of the BinaxNOW antigen test compared with real-time RT-PCR in specimens from symptomatic participants was 92.6% (95% CI = 83.7%–97.6%) and in those from asymptomatic participants was 78.6% (95% CI = 59.1%–91.7%).
Discussion
In this evaluation, using real-time RT-PCR as the standard, the sensitivity of the BinaxNOW antigen test was lower among specimens from asymptomatic persons (35.8%) than among specimens from symptomatic persons (64.2%). Specificity (99.8%–100%) was high in specimens from both asymptomatic and symptomatic groups. The prevalence of having SARS-CoV-2 real-time RT-PCR positive test results in this population was moderate (8.7% overall; 4.7% for asymptomatic participants); administering the test in a lower prevalence setting will likely result in a lower PPV.†† Among 11 participants with antigen-negative, real-time RT-PCR–positive specimens with positive viral culture, five were symptomatic and six asymptomatic. Some antigen-negative, real-time RT-PCR–positive specimens possibly could represent noninfectious viral particles, but some might also represent infectious virus not detected by the antigen test. In a clinical context, real-time RT-PCR provides the most sensitive assay to detect infection. Viral culture, although more biologically relevant than real-time RT-PCR, is still an artificial system and is subject to limitations. Numerous biological (e.g., individual antibody status and specific sequence of the virus) and environmental (e.g., storage conditions and number of freeze-thaw cycles) variables can affect the sensitivity and outcome of viral culture. Despite the limitations of interpreting culture-negative specimens, a positive viral culture is strong evidence for the presence of infectious virus. The performance of the BinaxNOW antigen test compared with real-time RT-PCR was better for those specimens with positive viral culture than for all specimens, with a sensitivity of 92.6% for specimens from symptomatic persons and 78.6% for those from asymptomatic persons. The results of the current evaluation differ from those of an evaluation of the BinaxNOW antigen test in a community screening setting in San Francisco (7), which found a BinaxNOW antigen test overall sensitivity of 89.0% among specimens from all 3,302 participants, regardless of the Ct value of the real-time RT-PCR–positive specimens.
The findings in this investigation are subject to at least five limitations. First, anterior nasal swabs were used for BinaxNOW antigen testing, but NP swabs were used for real-time RT-PCR testing, which might have contributed to increased detection for the real-time RT-PCR assay (8). Second, participants might have inadvertently reported common nonspecific symptoms as COVID-19–compatible symptoms. Third, this investigation evaluated the BinaxNOW antigen test, and results presented here cannot be generalized to other FDA-authorized SARS-CoV-2 antigen tests. Fourth, the BinaxNOW antigen test characteristics might be different depending on whether an individual had previously tested positive. Finally, many factors might limit the ability to culture virus from a specimen, and the inability to detect culturable virus should not be interpreted to mean that a person is not infectious.
Public health departments are implementing various strategies to reduce or prevent SARS-CoV-2 transmission, including expanded screening testing for asymptomatic persons (3). Because estimates suggest that over 50% of transmission occurs from persons who are presymptomatic or asymptomatic (9), expanded screening testing, potentially in serial fashion for reducing transmission in specific venues (e.g., institutions of higher education, schools, and congregate housing settings), is essential to interrupting transmission (3).
Rapid antigen tests can be an important tool for screening because of their quick turnaround time, lower requirement for resources, high specificity, and high PPV in settings of high pretest probability (e.g., providing testing to symptomatic persons, to persons with a known COVID-19 exposure, or where community transmission is high). Importantly, the faster time from testing to results reporting can speed isolation of infectious persons and will be particularly important in communities with high levels of transmission.
Although the sensitivity of the BinaxNOW antigen test to detect infection was lower compared with real-time RT-PCR, it was relatively high among specimens with positive viral culture, which might reflect better performance for detecting infection in a person with infectious virus present. Community testing strategies focused on preventing transmission using antigen testing should consider serial testing (e.g., in kindergarten through grade 12 schools, institutions of higher education, or congregate housing settings), which might improve test sensitivity in start highlightdetectingend highlight infection (10). When the pretest probability for receiving positive SARS-CoV-2 test results is elevated (e.g. for symptomatic persons or for persons with a known COVID-19 exposure) a negative antigen test result should be confirmed by NAAT. Asymptomatic persons who receive a positive BinaxNOW antigen test result in a setting with a high risk for adverse consequences resulting from false-positive results (e.g. in long-term care facilities) should also receive confirmatory testing by NAAT (1).
Despite their reduced sensitivity to detect infection compared with real-time RT-PCR, antigen tests might be particularly useful when real-time RT-PCR tests are not readily available or have prolonged turnaround times. Persons who know their positive test result within 15–30 minutes can isolate sooner, and contact tracing can be initiated sooner and be more effective than if a test result is returned days later. Serial antigen testing can improve detection, but consideration should be given to the logistical and personnel resources needed. All persons receiving negative test results (NAAT or antigen) should be counseled that wearing a mask, avoiding close contact with persons outside their household, and washing hands frequently remain critical to preventing the spread of COVID-19.§§
Acknowledgments
Kristen Garcia, Wenli Zhou, Morgan Ross, Lyndsay Wagner, Katherine Collins, Shelby Legendre, Christopher Johnson, Paradigm Laboratories, Tucson, Arizona; Spencer Graves, Pima County Health Department, Tuscon, Arizona; Anastasia Litvintseva, Dennis A. Bagarozzi, Jr., David James Petway, Jr., CDC.
Corresponding author: Jessica L. Prince-Guerra, yov0@cdc.gov.
1CDC COVID-19 Response Team; 2Arizona Department of Health Services; 3Epidemic Intelligence Service, CDC; 4Pima County Health Department, Tucson, Arizona.
All authors have completed and submitted the International Committee of Medical Journal Editors form for disclosure of potential conflicts of interest. No potential conflicts of interest were disclosed.
* Specimens were used to perform a limiting-dilution inoculation of Vero CCL-81 cells, and cultures showing evidence of cytopathic effect were tested by real-time RT-PCR for the presence of SARS-CoV-2 RNA. Viral recovery was defined as any culture in which the first passage had an N1 Ct value at least two Ct values lower than the corresponding clinical specimen.
† https://www.biorxiv.org/content/10.1101/2020.03.02.972935v1.
§ 45 C.F.R. part 46.102(l)(2), 21 C.F.R. part 56; 42 U.S.C. Sect. 241(d); 5 U.S.C. Sect. 552a; 44 U.S.C. Sect. 3501 et seq.
¶ Participants were asked whether they had each sign or symptom from a list based on Council for State and Territorial Epidemiologists clinical criteria for COVID-19 that included fever, cough, shortness of breath, fatigue, sore throat, headache, muscle aches, chills, nasal congestion, difficulty breathing, diarrhea, nausea, vomiting, abdominal pain, rigors, loss of taste, and loss of smell. https://cdn.ymaws.com/www.cste.org/resource/resmgr/ps/positionstatement2020/Interim-20-ID-02_COVID-19.pdf.
** Ct values from the N1 viral nucleocapsid protein gene region from real-time RT-PCR were compared only for specimens that were analyzed with the CDC 2019-nCoV Real-Time RT-PCR Diagnostic Panel for detection of SARS-CoV-2. Lower Ct values represent higher levels of viral RNA in the specimen and higher Ct values represent lower levels of viral RNA.
†† https://www.cdc.gov/coronavirus/2019-ncov/lab/faqs.html#Interpreting-Results-of-Diagnostic-Tests.
§§ https://www.cdc.gov/coronavirus/2019-ncov/prevent-getting-sick/prevention.html.
References
- CDC. Coronavirus Disease 2019 (COVID-19): interim guidance for rapid antigen testing for SARS-CoV-2. Atlanta, GA: US Department of Health and Human Services, CDC; 2020. https://www.cdc.gov/coronavirus/2019-ncov/lab/resources/antigen-tests-guidelines.html
- Food and Drug Administration. In vitro diagnostics EUAs. Silver Spring, MD: US Department of Health and Human Services, Food and Drug Administration; 2020. https://www.fda.gov/medical-devices/coronavirus-disease-2019-covid-19-emergency-use-authorizations-medical-devices/vitro-diagnostics-euas
- CDC. COVID-19: CDC guidance for expanded screening testing to reduce silent spread of SARS-CoV-2. Atlanta, GA: US Department of Health and Human Services; 2020. https://www.cdc.gov/coronavirus/2019-ncov/php/open-america/expanded-screening-testing.html
- Abbott. BinaxNOW COVID-19 Ag card (PN 195–000)—instructions for use. Abbott Park, IL: Abbott; 2020. https://www.fda.gov/media/141570/download
- Lu X, Wang L, Sakthivel SK, et al. US CDC real-time reverse transcription PCR panel for detection of severe acute respiratory syndrome coronavirus 2. Emerg Infect Dis 2020;26:1654–65. CrossRef PubMed
- Pharma F. Instruction for use: Fosun COVID-19 RT-PCR detection kit. Princeton, NJ: Fosun Pharma; 2020. https://www.fda.gov/media/137120/download
- Pilarowski G, Marquez C, Rubio L, et al. Field performance and public health response using the BinaxNOW TM Rapid SARS-CoV-2 antigen detection assay during community-based testing. Clin Infect Dis 2020. Epub December 26, 2020. CrossRef PubMed
- Pinninti S, Trieu C, Pati SK, et al. Comparing nasopharyngeal and mid-turbinate nasal swab testing for the identification of SARS-CoV-2. Clin Infect Dis 2020. Epub June 29, 2020. CrossRef PubMed
- Moghadas SM, Fitzpatrick MC, Sah P, et al. The implications of silent transmission for the control of COVID-19 outbreaks. Proc Natl Acad Sci U S A 2020;117:17513–5. CrossRef PubMed
- Paltiel AD, Zheng A, Walensky RP. Assessment of SARS-CoV-2 screening strategies to permit the safe reopening of college campuses in the United States. JAMA Netw Open 2020;3:e2016818. CrossRef PubMed
FIGURE. Abbott BinaxNOW COVID-19 Ag Card Point of Care Diagnostic Test (antigen test) results, N1 cycle threshold (Ct) values,* and viral culture results† among A) symptomatic (N = 136)§ and B) asymptomatic (N = 88)¶ participants receiving positive SARS-CoV-2 real-time reverse transcription–polymerase chain reaction (RT-PCR) test results at two community-based testing sites — Pima County, Arizona, November 2020
* Only those specimens that were analyzed using the CDC 2019-nCoV Real-Time RT-PCR Diagnostic Panel for detection of SARS-CoV-2 and that were analyzed using viral culture are included in the graph.
† Twenty specimens with Ct values <18 had positive antigen and real-time RT-PCR results but were culture negative. The culture showed evidence of cytopathic effects and had presence of SARS-CoV-2 RNA as detected by real-time RT-PCR in the first passage culture, but viral recovery was not two Ct values lower than the corresponding clinical specimen Ct.
§ Antigen test results: 88 positive and 48 negative; median Ct values indicated with black line: 22.0 for antigen-positive specimens and 33.9 for antigen-negative specimens.
¶ Antigen test results: 37 positive and 51 negative; median Ct values indicated with black line: 22.5 for antigen-positive specimens and 33.9 for antigen-negative specimens.
Suggested citation for this article: Prince-Guerra JL, Almendares O, Nolen LD, et al. Evaluation of Abbott BinaxNOW Rapid Antigen Test for SARS-CoV-2 Infection at Two Community-Based Testing Sites — Pima County, Arizona, November 3–17, 2020. MMWR Morb Mortal Wkly Rep 2021;70:100–105. DOI: http://dx.doi.org/10.15585/mmwr.mm7003e3.
MMWR and Morbidity and Mortality Weekly Report are service marks of the U.S. Department of Health and Human Services.
Use of trade names and commercial sources is for identification only and does not imply endorsement by the U.S. Department of
Health and Human Services.
References to non-CDC sites on the Internet are
provided as a service to MMWR readers and do not constitute or imply
endorsement of these organizations or their programs by CDC or the U.S.
Department of Health and Human Services. CDC is not responsible for the content
of pages found at these sites. URL addresses listed in MMWR were current as of
the date of publication.
All HTML versions of MMWR articles are generated from final proofs through an automated process. This conversion might result in character translation or format errors in the HTML version. Users are referred to the electronic PDF version (https://www.cdc.gov/mmwr) and/or the original MMWR paper copy for printable versions of official text, figures, and tables.
Questions or messages regarding errors in formatting should be addressed to mmwrq@cdc.gov.