Andreas K. Lindner, Olga Nikolai, Franka Kausch, Mia Wintel, Franziska Hommes, Maximilian Gertler, Lisa J. Krüger, Mary Gaeddert, Frank Tobian, Federica Lainati, Lisa Köppel, Joachim Seybold, Victor M. Corman, Christian Drosten, Jörg Hofmann, Jilian A. Sacks, Frank P. Mockenhaupt, Claudia M. Denkinger
European Respiratory Journal 2020; DOI: 10.1183/13993003.03961-2020
To the editor
A number of antigen-detecting rapid diagnostic tests (Ag-RDTs) for SARS-CoV-2 are now commercially available and can result in rapid decisions on patient care, isolation and contact tracing at the point-of-care. Two Ag-RDTs using nasopharyngeal (NP) swab samples meet WHO targets and are now approved through the WHO Emergency Use Listing procedure.
NP swab samples are frequently perceived as uncomfortable by patients and must be collected by trained healthcare personnel with protective equipment. A more complex sampling technique could also result in an incorrect performance in the clinical reality with a possible consequence on test sensitivity. Evidence supports the use of alternative sampling methods for RT-PCR, including anterior nasal (AN) swabs collected by patients and some tests have received regulatory approval with AN samples. Considering the ease-of-use of Ag-RDTs, a reliable simple sampling method would not only allow self-sampling, but may also pave the way for self-testing.
The primary objective of this prospective diagnostic accuracy study was a head-to-head comparison (positive and negative percent agreement) of a supervised, self-collected AN swab sample with a health care worker (professional)-collected NP swab sample, using a WHO-listed SARS-CoV-2 Ag-RDT against the reference standard RT-PCR collected from a NP/oropharyngeal (OP) swab. The secondary objective was to assess sensitivity and specificity for different sampling techniques with Ag-RDT. The study was continued until at least 30 positive NP swab samples according to Ag-RDT were obtained, as it was requested by the WHO to approve a novel sample type. This manufacturer-independent study was conducted in partnership with the Foundation of Innovative New Diagnostics (FIND), the WHO collaborating centre for COVID-19 diagnostics.
The study protocol was approved by the ethical review committee at Heidelberg University Hospital for the study site in Berlin (registration number S-180/2020). The study took place at the ambulatory SARS-CoV-2 testing facility of Charité University Hospital (Charité-Universitätsmedizin Berlin, Germany) from 23 September to 14 October 2020. The study enrolled adults at high risk for SARS-CoV-2 infection according to clinical suspicion. Participants were excluded if either of the swabs for the Ag-RDT or the RT-PCR reference standard could not be collected.
Participants underwent first an instructed, self-collected bilateral AN swab for the Ag-RDT. Verbal instruction was given to insert the swab horizontally 2–3 cm into the nostril and rotate it for 15 s against the nasal walls on each side. Deviations from the instructed technique were recorded. Subsequently, a combined OP/NP swab (eSwab from Copan with 1mL Amies medium) as per institutional recommendations for RT-PCR, and a separate NP swab for the Ag-RDT were taken from different sides of the nose. The samples for the Ag-RDTs were collected using the swab provided by the manufacturer within the test kit.
The Ag-RDT evaluated in this study was the STANDARD Q COVID-19 Ag Test (sd Biosensor, Inc. Gyeonggi-do, Korea; henceforth called STANDARD Q), which is also being distributed by Roche. The test uses the lateral flow assay principle in a cassette-based format with a visual read-out after 15–30 min. The manufacturer's instructions for use were followed. The Ag-RDTs were performed directly after sampling (within 60 min) at point-of-care by study physicians. The Ag-RDT results were interpreted by two operators, each blinded to the result of the other. The second reader was also blinded to the second Ag-RDT results of individual patients. The visual read out of the Ag-RDT test band was categorised on a semi-quantitative scale as negative, weak positive, positive and strong positive.
The Roche Cobas SARS-CoV-2 assay (Pleasanton, CA United States) or the SARS-CoV-2 E-gene assay from TibMolbiol (Berlin, Germany) were performed for RT-PCR according to routine procedures at the central laboratory. Viral RNA concentrations were calculated using assay specific CT-values, based on external calibrations curves. Staff performing the Ag-RDTs were blinded to results of RT-PCR tests and vice versa.
Of 303 patients invited, 289 (95.4%) consented to participate. Two patients were excluded as both swabs for the Ag-RDT could not be obtained. The average age of participants was 34.7 years (Standard Deviation [sd] 11.0) with 42.9% female and 19.0% having comorbidities. On the day of testing, 97.6% of participants had one or more symptoms consistent with COVID-19. Duration of symptoms at the time of presentation on average was 4.4 days (sd 2.7). Among the 289 participants, 39 (13.5%) tested positive for SARS-CoV-2 by RT-PCR (table 1).
TABLEÂ 1
Antigen-detecting RDT results with a supervised self-collected anterior nasal (AN) swab and with a professional-collected nasopharyngeal (NP) swab in RT-PCR positive patients from combined oro-/nasopharyngeal swab
No invalid tests were observed on either AN or NP samples. Two patients were detected by NP but not by AN sampling. No patient was detected by AN sampling only. The positive percent agreement was 90.6% (CI 75.8–96.8; including 2 false positive results with AN and 1 with NP). The negative percent agreement was 99.2% (CI 97.2–99.8). Inter-rater reliability was near perfect with kappa of 0.98 for AN and 1.0 for NP samples. The semi-quantitative read-out was more often higher for the NP samples (9 higher on NP, 4 higher on AN). Of the two patients detected by NP but not by AN sampling, one patient collected the AN swab only with gentle rotation, the second presented 10 days post symptom onset with a low viral load (table 1).
The STANDARD Q Ag-RDT with AN sampling showed a sensitivity of 74.4% (29/39 PCR positives detected; CI 58.9–85.4) and specificity of 99.2% (CI 97.1–99.8) compared to RT-PCR. The sensitivity with NP sampling was 79.5% (31/39 PCR positives detected; CI 64.5–89.2) and specificity was 99.6% (CI 97.8–100). In patients with high viral load (>7.0 log10 RNA SARS-CoV2/swab), the sensitivity of the Ag-RDT with AN sampling was 95.7% (22/23 PCR positives detected; CI 79.0–99.8) and 100% (23/23 PCR positives detected; CI 85.7–100) with NP sampling. In contrast, the Ag-RDT frequently did not detect patients with lower viral load or with symptoms >7 days (table 1). For most patients, the application of the flexible swab (meant for NP swab collection) in the anterior nose appeared unpleasant due to a tickling sensation and led to frequent sneezing.
The strengths of the study are the rigorous methods, including standardised sampling, two independent blinded readers and an additional semi-quantitative assessment of Ag-RDT results. The cohort was representative, judging from the comparable sensitivity observed in the recent independent validation study of STANDARD Q (sensitivity 76.6%; CI 62.8–86.4). The study is limited as it was performed in a single centre. Also, the NP swab was usually rotated against the nasopharyngeal wall for less time than recommended by the manufacturer, which may have a negative impact on the sensitivity of the Ag-RDT with NP sampling, but also reflects the difficulty of collection of this sample type.
In conclusion, this study demonstrates that supervised self-sampling from the anterior nose is a reliable alternative to professional nasopharyngeal sampling with STANDARD Q. The data will contribute to WHO recommendations for use of this test. Considering the ease-of-use of Ag-RDTs, self-sampling and potentially patient self-testing at home may be a future use case. If such testing could be repeated frequently and immediately ahead of situations when transmissions are likely to occur, self-testing with Ag-RDTs may have a significant impact on the pandemic. Further implementation studies on optimised self-sampling techniques and swabs (e.g. less flexible sponge swab) and the correct performance/interpretation of the test by patients themselves, are urgently needed to drive self-testing to scale.
Acknowledgements
Heike Rössig, Chiara Manon Rohardt, Claudia Hülso, Elisabeth Linzbach, Susen Burock, Katja von dem Busche, Stephanie Padberg, Melanie Bothmann, Zümrüt Tuncer, Stefanie Lunow, Beate Zimmer, Astrid Barrera Pesek, Sabrina Pein, Nicole Buchholz, Verena Haack, Oliver Deckwart.
Footnotes
-
Data availability:Â Available data; - De-identified data that underlie the results in this paper - Study protocol- Analysis code Until 5 years after publication Available to: researchers who provide a sound proposal and all study sites agree to sharing the data Proposals should be directed towards the corresponding author
-
Author contributions: AKL, LJK, FL and CMD designed the study and developed standard operating procedures. AKL and ON implemented the study design, enrolled patients, performed laboratory work and led the writing of the manuscript. FPM and JS coordinated and supervised the study site. FK, MW, FH enrolled patients. MGe coordinated the testing facility. MGa, LK and FT led the data analysis. VC, JH and CD were responsible for PCR testing and contributed to the interpretation of the data. JAS supported the study design setup and the interpretation of the data. CMD was the principle investigator of the study. All authors have reviewed the manuscript.
-
Support statement: The study was supported by FIND, Heidelberg University Hospital and Charité University Hospital internal funds, as well as a grant of the Ministry of Science, Research and the Arts of Baden-Württemberg, Germany. FIND provided input on the study design, and data analysis in collaboration with the rest of the study team. Ministry of Science, Research and the Arts of Baden-Württemberg, Germany; FIND; Charité Universitätsmedizin Berlin; DOI: http://dx.doi.org/10.13039/501100002839; Grant: internal funds; Heidelberg University Hospital; Grant: internal funds.
-
Conflict of interest: Dr. Lindner has nothing to disclose.
-
Conflict of interest: Mrs. Nikolai has nothing to disclose.
-
Conflict of interest: Mrs. Kausch has nothing to disclose.
-
Conflict of interest: Mrs. Wintel has nothing to disclose.
-
Conflict of interest: Dr. Hommes has nothing to disclose.
-
Conflict of interest: Dr. Gertler has nothing to disclose.
-
Conflict of interest: Dr. Gaeddert has nothing to disclose.
-
Conflict of interest: Mr. Tobian has nothing to disclose.
-
Conflict of interest: Dr. Lainati has nothing to disclose.
-
Conflict of interest: Lisa Köppel has nothing to disclose.
-
Conflict of interest: Dr. Seybold has nothing to disclose.
-
Conflict of interest: Dr. Corman has nothing to disclose.
-
Conflict of interest: Dr. Drosten has nothing to disclose.
-
Conflict of interest: Dr. Hofmann has nothing to disclose.
-
Conflict of interest: Dr. Sacks reports grants from UK Department of International Development (DFID, recently replaced by FCMO), grants from World Health Organization (WHO), grants from Unitaid, during the conduct of the study.
-
Conflict of interest: Dr. Mockenhaupt has nothing to disclose.
-
Conflict of interest: Dr. Denkinger reports grants from Foundation of Innovative Diagnostics, grants from Ministry of Science, Research and Culture, State of Baden Wuerttemberg, Germany, during the conduct of the study.
-
Conflict of interest: Lisa J. Krüger has nothing to disclose.
- Received October 26, 2020.
- Accepted November 24, 2020.
- Copyright ©ERS 2020
