Charges against this life science company executive include healthcare fraud as well as the first COVID-19 related securities fraud
In the first securities fraud prosecution involving clinical laboratory COVID-19 testing, the US federal Department of Justice (DOJ) charged the president of a Sunnyvale, Calif., life sciences biotechnology company with participating in a scheme to mislead investors and also to commit healthcare fraud, stated a DOJ press release.
The DOJ charged Mark Schena, PhD, president of Arrayit Corporation, with one count of securities fraud and one count of conspiracy to commit healthcare fraud related to submissions of more than $69 million in claims for allegedly unnecessary medical laboratory allergy and COVID-19 tests, the Associated Press (AP) reported.
“The defendant allegedly defrauded Medicare through illegal kickbacks and bribes, and then turned to exploiting the pandemic by fraudulently promoting an unproven COVID-19 test to the market,” said Brian Benczkowski, DOJ Assistant Attorney General, Criminal Division, in the DOJ press release.
According to the Washington Post, Arrayit allegedly bundled its finger-stick allergy test with the COVID-19 test kit.
Authorities Question Bundling of Tests, Claims
An affidavit in support of the criminal complaint stated that Arrayit was promoting “‘microarray technology’ for allergy and COVID-19 testing that allows for laboratory testing on a finger prick drop of blood that is placed on a paper card and sent by mail to Arrayit’s laboratory.”
The government’s investigation actually goes back two years to a time when Arrayit allegedly submitted or caused submission of $5.9 million in Medicare lab test claims and $63 million in lab test claims to private insurers through bribes and kickbacks, MedTech Dive reported.
The company’s clinical laboratory test for COVID-19 failed to receive US Food and Drug Administration Emergency Use Authorization (EUA), because it did not have the level of specificity and sensitivity required, MedTech Dive noted.
“Schena offered an Arrayit COVID-19 test in order to obtain Medicare beneficiary information that then was used to submit false and fraudulent claims for an unrelated and far more expensive allergy test for 120 allergens,” the DOJ complaint stated, adding, “Schena and others transmitted false and fraudulent e-mail communications and marketing materials about the Arrayit COVID-19 test and purported need to bundle the COVID-19 test with Arrayit’s allergy test, while never disclosing there were substantial questions about the accuracy of Arrayit’s COVID-19 test.”
Highlights of DOJ Charges
According to the DOJ press release:
Schena and others from 2018 through February allegedly “paid kickbacks and bribes” to recruiters and doctors to run a medical laboratory test for allergy screening (with 120 allergens) on patients “regardless of medical necessity and then make numerous misrepresentations to potential investors.”
News releases and social media promoted partnerships with companies and government agencies that either “did not exist” or were minor.
As the pandemic heated up, Arrayit representatives “made false claims concerning Arrayit’s ability to provide accurate, fast, reliable and cheap COVID-19 tests in compliance with state and federal regulations,” prosecutors said.
According to the DOJ’s complaint, Schena told investigators developing a test for COVID-19 was “like a pastry chef” who switches from selling “strawberry pies” to selling “rhubarb and strawberry pies.”
DOJ Prioritizing Coronavirus Fraud
US Attorney General William Barr earlier this year called for prioritization of investigation and prosecution of coronavirus fraud schemes, noted a DOJ statement, which pointed out that these types of fraud schemes leverage COVID-19 testing information generated by healthcare providers to fraudulently bill Medicare for other tests and procedures.
In April, Dark Daily’s sister publication, The Dark Report (TDR), covered one such kickback scheme in Georgia the DOJ was investigating. In that case, a Georgia man allegedly participated in a fraudulent kickback scheme in which clinical laboratory companies paid him on a per-test basis for referring cancer genetic, coronavirus, and respiratory pathogen panel tests to labs, TDR noted.
Clearly, the DOJ is stepping up its investigation into COVID-19 test fraud. Thus, medical laboratory leaders and pathologists should remain vigilant, as they are likely to observe more enforcement activity as the pandemic persists.
Two national studies find pathologists bill out-of-network more frequently than other hospital-based specialties, and one study links that behavior to insurer reimbursement rates
Surprise bills for out-of-network services continue to be an important issue for healthcare consumers. Now comes a recently-released report from the Health Care Cost Institute (HCCI) claiming that pathologists are the specialists that most often bill for out-of-network hospital charges.
The HCCI study examined the prevalence and frequency of out-of-network billing among six specialties. The sample used for the report included 13.8 million healthcare visits to over 35 thousand hospital-based healthcare providers that occurred in 2017. The types of visits examined for the report were:
emergency medicine,
pathology,
radiology,
anesthesiology,
behavioral health, and
cardiovascular services.
The researchers calculated the percentage of out-of-network claims for both inpatient and outpatient visits to each type of the six specialties.
The study found that, overall, less than half of the specialties billed out-of-network for services obtained at in-network facilities. Providers with at least one out-of-network claim associated with an in-network outpatient visit ranged from 15% for behavioral health to 49% for emergency medicine.
Pathologists’ Out-of-Network Billing
Among the pathologists surveyed, HCCI found 33% had at least one out-of-network claim for an in-network outpatient visit. Providers with at least one out-of-network claim associated with an in-network inpatient visit ranged from 18% for cardiovascular services to 44% for both emergency and pathology services.
HCCI researchers also examined how often individual providers in the six specialties billed out-of-network at least one time and found that the majority billed out of network less than 10% of the time. However, this varied among the specialties with 36% of pathologists who billed out-of-network for inpatient visits, and 20% of pathologists who billed out-of-network for outpatient visits, did so more than 90% of the time.
Pathologists Top List of Out-of-Network Specialists in Previous HCCI report
Last November, HCCI released a similar report that examined the commonality of out-of-network billing for the same six specialties plus surgical services that took place in 2017. Based on their collected data, they also estimated the amount of surprise bills that patients could expect to receive for those services.
That report found that nationally:
16.5% of visits with emergency room services had an out-of-network claim from an emergency medicine specialist.
12.9% of visits with lab/pathology services had an out-of-network claim from a pathologist.
8.3% of visits with anesthesiology services had an out-of-network claim from an anesthesiologist.
6.7% of visits with behavioral health services had an out-of-network claim from a behavioral health provider.
4.2% of visits with radiology services had an out-of-network claim from a radiologist.
2.1% of visits with surgical services had an out-of-network claim from a surgeon.
2.0% of visits with cardiovascular services had an out-of-network claim from a cardiovascular specialist.
Surgical Services the Most Expensive Out-of-Network Bill
This study also found broad variation in charges between types of services and healthcare settings. The researchers determined that the potential surprise bills for surgical visits due to out-of-network claims were of the greatest magnitude. HCCI estimated that the average potential surprise bill associated with an inpatient surgery was $22,248, while the potential surprise bill associated with an outpatient surgery was $8,493.
Out-of-Network Surprise Billing Varies Widely Depending on Location
The data was further broken down by state. For pathology services, the percentage of visits with out-of-network services in 2017 ranged from 0.3% in Minnesota to 75.3% in Kansas. HCCI researchers estimated the potential surprise bill for out-of-network pathology claims for inpatient services ranged from $14 in Louisiana to $167 in Delaware. The estimated surprise bill for out-of-network outpatient pathology services ranged from $23 in Louisiana to $218 in Wyoming.
Pathologists Also Top Out-of-Network Biller in Yale University Study
A Yale University study into surprise billing released in December and published in the journal Health Affairs found similar results, Modern Healthcare reported. This study examined surprise out-of-network bills incurred by patients who sought care at in-network hospitals for four types of specialists that are not chosen by patients:
pathologists,
anesthesiologists,
radiologists, and
assistant surgeons.
For the Yale study, the researchers examined employer-sponsored insurance claims from a major commercial insurer for healthcare visits that occurred at in-network hospitals in 2015. They found that 12.3% of cases involving a pathologist were billed out-of-network, which was the highest percentage of the four specialties analyzed. By contrast, 11.8% of anesthesiologists, 11.3% of assistant surgeons, and 5.6% of radiologists billed out-of-network for their services.
The Yale study also found that “the ability of these four specialties to send patients out-of-network bills allowed them to negotiate high in-network payments from insurers, which leads to higher insurance premiums for individuals.”
The Yale study researchers determined that were these specialists unable to bill out-of-network, the particular healthcare plan would save 3.4% of their expenditures or about $40 billion per year, Modern Healthcare reported.
Surprise bills for out-of-network services burden both patients and providers. Insurers want beneficiaries to have access to hospitals and services, but providers in many specialties do not want to contract with those insurers due to low reimbursements.
This disconnect results in providers staying out-of-network and patients receiving surprise bills for out-of-network services even though the hospital was in-network. And pathologists are at the top of the list.
Anatomic pathologists across the country will want to track how government and private payers respond to these findings by amending coverage and reimbursement guidelines in ways that may be unfavorable to the pathology profession.
One medical testing company was led by a convicted felon, another was accused of delays and unreliable results
Like many states, Florida has worked hard to quickly ramp up diagnostic testing for SARS-CoV-2, the coronavirus that causes the COVID-19 illness. For the most part this has been a good thing. However, local media in that state reported problems with two no-bid contracts for clinical laboratory testing, including one with a Dallas-based company whose founder pleaded guilty last year to two felonies involving insurance fraud.
In a press conference announcing the two deals, Florida Governor Ron DeSantis said, “We have two contracts in place with two new labs that will increase our lab capacity by 18,000 samples per day.” He added that he expected a 24- to 48-hour turnaround.
“That’s a lot better than we’ve been getting from Quest and LabCorp,” he said. “These labs will be primarily where we send our samples that we collect in the long-term-care and assisted-living facilities and at the community-based walk-up sites.”
The announcement followed DeSantis’ March 9 emergency decree, which allowed state agencies to award contracts to companies without undergoing formal bidding processes, reported Florida Bulldog, an independent non-profit news site.
In his announcement, DeSantis did not identify the companies that had received the lab test contracts. However, Florida Bulldog reported that those companies were:
Indur Services, a Dallas-based health-coaching company, and
Southwest Regional PCR, a CAP-accredited lab in Lubbock, Texas, that does business as MicroGenDX Laboratory (MicroGen Diagnostics, LLC).
The Indur contract—initially valued at $11.3 million—included $10.2 million for 140,000 COVID-19 RT-qPCR test kits, plus additional payment for supplies, Florida Bulldog reported based on information from the state contract database. Later, the contract was reduced to $2.2 million solely for supplies.
The MicroGenDX contract—valued at $11 million—called for 8,000 tests per day for 14 days at a cost of $99 per test, Florida Bulldog reported. That contract was later cancelled due to concerns about reliability and processing speed.
Indur’s Legal Troubles
Indur is a self-described “health and wellness lifestyle and products company” founded in 2017 by Brandt Beal, according to Business Insider. In 2019, Beal pleaded guilty to two felonies involving insurance fraud in Texas and was given 10 years’ probation in each case, Florida Bulldog reported. He also was required to pay restitution. He pleaded guilty to a separate charge of felony theft in 2017 and was sentenced to nine years’ probation.
In an interview with Florida Bulldog, Beal claimed that “the man who pleaded guilty to those charges is actually his cousin with the same name.” However, Beal “would not provide requested contact information for his cousin,” the Florida Bulldog reported, which posted photos demonstrating that the Indur founder and the person who pleaded guilty to the felonies were the same individual.
The amended contract, valued at $2.2 million, called for Indur to deliver swabs and vials. “To date, everything that’s been ordered they’ve delivered on,” said Jared Moskowitz, Director of the Florida Division of Emergency Management department.
Testing Delays Snag MicroGen Diagnostics
The state cancelled its contract with MicroGenDX on May 15, Florida Bulldog reported.
“As with any lab, we do our due diligence to ensure the company will be able to provide reliable services before sending any samples,” said Jason Mahon, Communications Director at the Florida Division of Emergency Management. “Upon further interaction with this vendor, the Division determined that the state could not be 100% confident in the results that would come from this vendor, or with the processing speed, which is critical for COVID-19 testing.”
This came as AdventHealth, a non-profit health system based in Altamonte Springs, Fla., was having its own difficulties with MicroGenDX.
On May 16, AdventHealth announced that it had terminated a COVID-19 testing contract with an unnamed third-party lab, claiming that the provider was “unable to fulfill its obligation.” Multiple media outlets later revealed MicroGenDX as the third-party lab, and USA Today reported that the FDA had launched an investigation.
“This issue impacts more than 25,000 people throughout Central Florida,” stated an AdventHealth press release. “This situation has created unacceptable delays and we do not have confidence in the reliability of the tests.” AdventHealth said it would contact affected individuals about the need for retesting.
However, MicroGenDX CEO Rick Martin refuted the health system’s claims. “You can go after me because I didn’t meet your capacity and I couldn’t deliver on your drive-through testing because of things that I couldn’t control, but don’t attack the reliability of my test,” he told the Orlando Sentinel.
According to MicroGenDX, the company received an emergency use authorization (EUA) from the FDA on April 23 for an internally-developed RT-PCR test that can be performed on nasal swabs or sputum samples, noted a press release. The tests are run in the company’s lab facility in Lubbock, Texas.
One factor in the dispute was the handling of patient samples, USA Today reported. Martin told reporters that representatives from AdventHealth had visited the lab and observed samples that were stored at room temperature. “[Martin] maintains the samples were still valid and that the delays were due to AdventHealth not providing proper patient data and the lab running out of plastic parts used in its equipment,” noted USA Today.
Mahon told Florida Bulldog that the state did not send samples to MicroGenDX for processing. And the Florida Bulldog reported that Martin said his lab was so “hammered with huge volumes of samples” that he would have turned down any requests, adding that Martin “stood by the reliability and accuracy of his firm’s testing and said he looks forward to a day of vindication after federal inspectors conduct any inquiries.”
Collectively, these news stories scratch the surface of a bigger situation involving COVID-19 laboratory testing. The fact that Congress authorized billions of dollars to fund COVID-19 testing was noticed by some individuals who saw the funding as an opportunity to “make a quick buck” if they could get contracts to provide COVID-19 testing—whether they owned a CLIA-certified complex laboratory or not.
Thus, it’s no surprise that more companies are bidding on COVID-19 testing contracts. What remains unknown is how many of those companies are actively soliciting COVID-19 testing contracts throughout the United States.
Given this situation, and the facts recounted above, it is reasonable to ask an obvious question: Why did Florida state officials not do a more rigorous check into the credentials of the clinical laboratory entities they were preparing to award no-competitive-bid contracts to for COVID-19 testing?
University of Alberta researchers developed CIDER-Seq tool and protocols for the study, which they have made freely available to all scientists
Here’s another promising new technology which, given more research into effectiveness and safety, may soon lead to improved clinical laboratory cancer diagnostics. Oncology research scientists have focused much attention on understanding the role of extrachromosomal circular DNA (eccDNA) in human cancer. Now, a new gene sequencing method may help expand their knowledge about that and other circular DNA found in the genomes of bacteria, viruses, and other cells.
University of Alberta (UA) researchers have invented a new way for sequencing circular DNA, according to a recent study published in the journal Nature Protocols. As with any new technological method, this new tool—called CIDER-Seq—will need to be time-tested, but it does hold promise for providing valuable insights into the role these “mysterious loops” play not only in human disease, but in agricultural viruses as well.
A New Tool for Understanding DNA
DNA is considered “circular” when it has a closed loop with no ends. It differs from “linear” DNA chromosomes found in human cell nuclei. Circular DNA include:
According to the UA study, circular DNA enrichment sequencing (CIDER-Seq) “is a technique to enrich and accurately sequence circular DNA without the need for polymerase chain reaction amplification, cloning, and computational sequence assembly.”
CIDER-Seq uses DNA sequencing technology from Pacific Biosciences, Inc. (PacBio) of Menlo Park, Calif. PacBio (NASDAQ:PACB) is an American biotechnology company founded in 2004 that develops and manufactures gene sequencing systems.
Understanding Circular DNA in Any Human or Plant Cell, Including Cancer
Because many viruses that infect crops have circular DNA, Mehta believes the new tool may be particularly helpful to agricultural scientists. His team of researchers, he noted in the UA news release, used an earlier version of CIDER-Seq to study crop plants in Kenya which were genetically engineered to resist circular DNA viruses.
“Our key advance is that, through our method, scientists can finally gain an unbiased, high-resolution understanding of circular DNA in any type of cell. With our invention of CIDER-Seq, we can start to begin to understand the function of these mysterious circular DNAs in human and plant cells,” Mehta said.
However, this technological advance may be equally welcomed by researchers investigating the role of eccDNA in human cancer. Though both healthy and diseased cells may contain circular DNA, the New York Times noted that the “mysterious loops” are “surprisingly common in cancer cells and play a bigger role in many types of cancers than was previously recognized.” The article goes on to state that until now there have not been effective methods for sequencing circular DNA.
In Clinical Chemistry, a panel of eccDNA experts discussed the critical role circular DNA plays in cancer, referred to as extrachromosomal DNA (ecDNA). “Importantly, in cancer cells, ecDNAs seem to be more transcriptionally active than their chromosomal counterparts and have been suspected to confer growth and survival advantage to cancer cells,” the article states.
According to the New York Times, scientists first discovered the existence of circular DNA in the 1960s when “little clumps of DNA” were detected alongside chromosomes. Today, researchers believe circular DNA is more common in the human genome than first realized and could be linked to a variety of conditions and diseases, not solely to cancer.
CIDER-Seq Research May Lead to New Clinical Laboratory Biomarkers
Birgitte Regenberg, PhD, Associate Professor in Ecology and Evolution at the University of Copenhagen, pioneered methods for detecting circular DNA. She told the New York Times, “I think we’re just opening our eyes up.”
Though she says the research has been “cancer-centered,” Regenberg maintains the role circular DNA plays in human biology may prove to be much broader.
“It’s like when a horse has blinders: The blinders focus the science, but they also prevent some things from being understood,” she said.
Clinical laboratory leaders should keep an eye on the use of CIDER-Seq technology. It may lead to the development of new biomarkers for cancer and other diseases.
Australian government heralded April purchase of 10 million clinical laboratory diagnostics tests from BGI, but most of the nation’s states and territories say kits are unneeded or unable to be used by their health departments
While the United States and other nations attempt to bring the COVID-19 outbreak under control, many countries have turned to China to offset shortages of clinical laboratory SARS-CoV-2 test kits needed to diagnose the coronavirus. This did not work out well for the United Kingdom and Spain, each which purchased large volumes of COVID-19 test kits from Chinese companies in April.
Now comes news that Australia spent roughly $130 million US ($200 million AUD) in late April for COVID-19 RT-PCR tests from BGI Genomics. However, those kits are mainly going unused as Australian state governments say they are unneeded or incompatible with existing testing equipment.
This is the latest example of the problems plaguing governments worldwide as they scramble to boost SARS-CoV-2 testing capacity during the evolving pandemic.
The new problem is that COVID-19 testing capacity has increased so much it now exceeds demand for testing. This is true for portions of Australia and in some states in the US.
Demand for Testing in Australia Far Lower than Expected
With a population of roughly 25 million, Australia has a smaller population than Texas, which in 2020 stood at about 28 million. According to the Johns Hopkins COVID-19 Dashboard, Australia had 7,139 confirmed cases of COVID-19 as of May 27 and 103 deaths.
Australian billionaire Andrew “Twiggy” Forrest, former CEO of Fortescue Metals Group, orchestrated the purchase of 10 million COVID-19 RT-PCR testing kits for Australia from BGI. He did so through his philanthropic organization, the Minderoo Foundation, with the understanding that the purchase cost would be refunded by the Australian government.
On April 28, the Australian government heralded Forrest’s purchase as a commercial coup, because it occurred in the midst of sparring between the two countries over China’s handling of the coronavirus outbreak and fierce international competition for COVID-19 diagnostic testing kits.
Forrest credited his personal relationship with BGI for his ability to secure the kits for Australia. “Chairman Wang [Jian] and BGI kept to their word and resisted that very clear temptation of a businessman to make a much bigger profit and maintain the integrity of my relationship, and I’m very grateful for that,” Forrest told ABC News.
However, less than a month later, The Guardian Australia reported the taxpayer-funded coronavirus testing kits Forrest brought to Australia were not being used. Instead, the test kits have been added to the country’s strategic reserve. Three of five Australian states and both territories—Queensland, New South Wales, Western Australia, the Northern Territory, and the Australian Capital Territory—all told the newspaper they were not using the BGI tests. Only Victoria reported it was using the BGI tests.
“PathWest, Western Australia’s leading pathology laboratory, is not using the BGI-manufactured COVID-19 PCR testing kits,” the Western Australia Department of Health told The Guardian. “PathWest has capacity and sufficient reagent to provide testing throughout the state without the need to use these tests.”
“Queensland Health does not use the BGI COVID-19 test or its operating platform,” a spokeswoman told The Guardian. “Queensland already has ample testing capacity, illustrated by the world leading figures of 137,000 COVID-19 tests since January.”
According to ABC News, Minderoo also purchased 11 testing machines, which were installed around the country. Six Chinese experts flew to Australia to help oversee the testing machines’ installation.
Testing Capacity Also Exceeds Demand in US
Increased COVID-19 testing capacity has been considered a cornerstone to fully lifting stay-at-home orders and reopening businesses, schools, and entertainment venues. But Australia is not alone in ramping up testing capacity only to have public demand not keep pace. The Washington Post reported in mid-May that in at least a dozen states COVID-19 testing capacity exceeded the number of patients lining up for testing.
Utah Department of Health spokesperson Tom Hudachko is among those questioning why people aren’t getting tested in his state, which has a 9,000-test capacity, but was conducting only 3,500 tests a day.
“Well, that’s the million-dollar question,” Hudachko told the Washington Post. “It could be simply that people don’t want to be tested. It could be that people feel like they don’t need to be tested. It could be that people are so mildly symptomatic that they’re just not concerned that having a positive lab result would actually change their course in any meaningful way.”
Meanwhile, Australia’s federal government has the interesting problem of having purchased $130 million (US) of COVID-19 test kits from a Chinese company—test kits that most of the nation’s states and territories have yet to use. Could this be a sign that many clinical laboratory scientists in Australia have their doubts about the accuracy and reliability of these Chinese-manufactured COVID-19 tests?
In the absence of a “gold standard,” researchers are finding a high frequency of false negatives among SARS-CoV-2 RT-PCR tests
Serology tests designed to detect antibodies to the SARS-CoV-2 coronavirus that causes the COVID-19 illness have been dogged by well-publicized questions about accuracy. However, researchers also are raising concerns about the accuracy of molecular diagnostics which claim to detect the actual presence of the coronavirus itself.
“Diagnostic tests, typically involving a nasopharyngeal swab, can be inaccurate in two ways,” said Steven Woloshin, MD, MS, in a news release announcing a new report that “examines challenges and implications of false-negative COVID-19 tests.” Woloshin is an internist, a professor at Dartmouth Institute, and co-director of the Geisel School of Medicine at Dartmouth.
“A false-positive result mistakenly labels a person infected, with consequences including unnecessary quarantine and contact tracing,” he stated in the news release. “False-negative results are far more consequential, because infected persons who might be asymptomatic may not be isolated and can infect others.”
Woloshin led a team of Dartmouth researchers who analyzed two studies from Wuhan, China, and a literature review by researchers in Europe and South America that indicated diagnostic tests for COVID-19 are frequently generating false negatives. The team published their results in the June 5 New England Journal of Medicine (NEJM).
For example, one research team in Wuhan collected samples from 213 hospitalized COVID-19 patients and found that an approved RT-PCR test produced false negatives in 11% of sputum samples, 27% of nasal samples, and 40% of throat samples. Their research was published on the medRxiv preprint server and has not been peer-reviewed.
The literature review Woloshin’s team studied was also published on medRxiv, titled, “False-Negative Results of Initial Rt-PCR Assays for COVID-19: A Systematic Review.” It indicated that the rate of false negatives could be as high as 29%. The authors of the review looked at five studies that had enrolled a total of 957 patients. “The collected evidence has several limitations, including risk of bias issues, high heterogeneity, and concerns about its applicability,” they wrote. “Nonetheless, our findings reinforce the need for repeated testing in patients with suspicion of SARS-Cov-2 infection.”
Another literature review, published in the Annals of Internal Medicine, titled, “Variation in False-Negative Rate of Reverse Transcriptase Polymerase Chain Reaction–Based SARS-CoV-2 Tests by Time Since Exposure,” estimated the probability of false negatives in RT-PCR tests at varying intervals from the time of exposure and symptom onset. For example, the authors found that the median false-negative rate was 38% if a test was performed on the day of symptom onset, versus 20% three days after onset. Their analysis was based on seven studies, five of which were peer-reviewed, with a total of 1330 test samples.
Doctors also are seeing anecdotal evidence of false negatives. For example, clinicians at UC San Diego Health medical center treated a patient with obvious symptoms of COVID-19, but two tests performed on throat samples were negative. However, a third test, using a sample from a bronchial wash, identified the virus, reported Medscape.
Sensitivity and Specificity of COVID-19 Clinical Laboratory Tests
The key measures of test accuracy are sensitivity, which refers to the ability to detect the presence of the virus, and specificity, the ability to determine that the targeted pathogen is not present. “So, a sensitive test is less likely to provide a false-negative result and a specific test is less likely to provide a false-positive result,” wrote Kirsten Meek, PhD, medical writer and editor, in an article for ARUP Laboratories.
“Analytic” sensitivity and specificity “represent the accuracy of a test under ideal conditions in which specimens have been collected from patients with either high viral loads or a complete absence of exposure,” she wrote. However, “sensitivity and specificity under real-world conditions, in which patients are more variable and specimen collection may not be ideal, can often be lower than reported numbers.”
In a statement defending its ID Now molecular point-of-care test, which came under scrutiny during a study of COVID-19 molecular tests by NYU Langone Health, Northwell Health, and Cleveland Clinic, according to MedTech Dive, Abbott Laboratories blamed improper sample collection and handling for highly-publicized false negatives produced by its rapid test. An FDA issued alert about the test on May 14 noted that Abbott had agreed to conduct post-market studies to identify the cause of the false negatives and suggest remedial actions.
Issues with Emergency Use Authorizations
In their NEJM analysis, Woloshin et al point to issues with the FDA’s process for issuing Emergency Use Authorizations (EUAs). For example, they noted variations in how manufacturers are conducting clinical evaluations to determine test performance. “The FDA prefers the use of ‘natural clinical specimens’ but has permitted the use of ‘contrived specimens’ produced by adding viral RNA or inactivated virus to leftover clinical material,” they wrote.
When evaluating clinical performance, manufacturers ordinarily conduct an index test of patients and compare the results with reference-standard test, according to the Dartmouth researchers. For people showing symptoms, the reference standard should be a clinical diagnosis performed by an independent adjudication panel. However, they wrote, “it is unclear whether the sensitivity of any FDA-authorized commercial test has been assessed in this way.” Additionally, a reference standard for determining sensitivity in asymptomatic people “is an unsolved problem that needs urgent attention to increase confidence in test results for contact-tracing or screening purposes.”
Continued adherence to current measures, such as physical distancing and surface disinfection.
Development of highly sensitive and specific tests or combinations of tests to minimize the risk of false-negative results and ongoing transmission based on a false sense of security.
Improved RT-PCR tests and serological assays.
Development and communication of clear risk-stratified protocols for management of negative COVID-19 test results.
“These protocols must evolve as diagnostic test, transmission, and outcome statistics become more available,” they wrote.
Meanwhile, clinical laboratories remain somewhat on their own at selecting which COVID-19 molecular and serology tests they want to purchase and run in their labs. Complicating such decisions is the fact that many of the nation’s most reputable in vitro diagnostics manufacturers cannot produce enough of their COVID-19 tests to meet demand.
Consequently, when looking to purchase tests for SARS-CoV-2, smaller medical laboratory organizations find themselves evaluating COVID-19 kits developed by little-known or even brand-new companies.