Taft Foley, III, says he got the idea for the mobile lab after waiting on a COVID-19 testing line that went ‘around the entire building’
In a remarkable example of ingenuity and observation, Texas high school student Taft Foley, III, is bringing COVID-19 testing to underserved patients, wherever they may be. He launched a medical lab company, then developed a mobile clinical laboratory which performs rapid antigen tests that can detect the presence of antigen in about 15 minutes.
Foley—who recently became an EMT after graduating from the Texas EMS Academy—designed his mobile medical lab to use Quidel Sofia SARS Antigen FIA tests (nasal swabs). Results are sent to patients by text or e-mail. Foley also works with CLIA-certified Baylor Genetics Laboratories on COVID-19 (SARS-CoV-2) RT-PCR molecular testing, which gives his customers results in 24 to 48 hours, Forbes reported.
Foley, who is 18-years-old and an Eagle Scout, said he got the idea to launch the mobile COVID-19 testing business after he went for a coronavirus test and had to wait on a line that “wrapped around the entire building,” ABC13 reported. “I said to myself, ‘There needs to be a better way,’” Foley told ABC13.
Forbes reported that Texas Mobile Medical Labs allocates a portion of test fees paid ($100 to $150/test) to help provide tests to the homeless and others who need them, such as veterans and senior citizens.
“The (majority of) tests have been done at businesses who appreciate our mobile capabilities. We arrive and test all employees onsite and have their results back in 15 minutes,” Foley told Forbes.
Other States with Mobile COVID-19 Testing
Texas is not the only state where savvy entrepreneurs like Foley and health agencies are offering mobile COVID-19 testing.
In May, Florida Gov. Ron DeSantis announced Statlab Mobile, a COVID-19 mobile laboratory out of Miami that tests people in skilled nursing and long-term care facilities and other areas of the Sunshine State.
“We believe this will be a game-changer (in long-term care),” DeSantis told the Miami Herald.
“The idea was to bring help to those who are vulnerable, those who can’t otherwise get the kind of medical information they would otherwise love to have,” Bryan Wilson, Statlab Chief Executive Officer, told Patch, which noted the tests are free.
Mobile COVID Testing in Other States
Mobile medical laboratories are being deployed to help handle surges of COVID-19 cases in Massachusetts, New Jersey, and Arizona, as well.
In Massachusetts, testing vans operated by American Family Care (AFC), an urgent care provider, started heading out in November to schools and businesses state-wide with a goal to test at least 100 to 150 people daily for COVID-19, according to The Reminder.
The vans are staffed by medical providers who test people with Abbott’s BinaxNOW COVID-19 Ag Card, AFC told The Reminder. The rapid antigen test offers results in 15 minutes.
In September, Dark Daily reported that the US federal Department of Health and Human Services (HHS) awarded a $760 million contract to Abbott for 150 million rapid antigen tests to aid in detection of COVID-19 as workplaces and schools reopen.
“We’ve had several companies who would like to schedule their employees to be tested on a regular basis. But they also want to be able to make sure that if there is a potential contamination within their businesses, they have a resource to utilize to make sure they can test people right away,” Jim Brennan, Owner/CEO of Medvest, LLC, AFC urgent care’s parent company, told The Reminder.
And in Phoenix, a COVID-19 mobile medical van provides testing to underserved communities. The City of Phoenix, along with staff from the Vincere Cancer Center, use Quidel’s Sofia SARS Antigen FIA test at public and private locations and at family services centers, AZ Central reported.
Clearly, mobile COVID-19 testing labs are here to stay. They serve seniors and vulnerable populations challenged to access clinical laboratory testing at traditional locations and at COVID-19 drive-through sites. And on larger scales, mobile medical laboratories have become key resources to address coronavirus case surges and to conveniently test people at businesses and schools to help identify symptomatic individuals who should be quarantined.
Clinical laboratory managers may be impressed by how quickly mobile testing companies and entrepreneurs form partnerships with public health agencies toward making COVID-19 tests available to all at places where people live and work.
At hospitals where results of molecular COVID-19 testing can take up to several days to return, this new method for identifying potentially infected patients could improve triage
Frustrated by shortages of essential COVID-19 tests and supplies—as well by lengthy coronavirus test turn-around times—researchers at Weill Cornell Medicine have created an Artificial Intelligence (AI) algorithm that can use routine clinical laboratory test data to determine if a patient is infected with SARS-CoV-2, the coronavirus that causes the COVID-19 disease.
This is an important development because the turn-around-time (TAT) for common lab tests is generally much shorter than COVID-19 molecular diagnostics—such as real-time reverse transcription polymerase chain reaction (RT-PCR), currently the most popular coronavirus test—and certainly serological (antibody) diagnostics, which require an infection incubation time of as much as 10-14 days before testing.
Some RT-PCR diagnostic tests for COVID-19, which detect viral RNA on nasopharyngeal swab specimens, can take up to several days to return depending on the test and on the lab’s location. But routine medical laboratory tests generally return much sooner, often within minutes or hours, making this a potential game-changer for triaging infected patients.
Machine Learning Brings AI to COVID-19 Diagnostics
Advances in the use of AI in healthcare have led to the development of machine-learning algorithms that are being utilized as diagnostic tools for anatomic pathology, radiology, and for specific complex diseases, such as cancer. The Weill Cornell scientists wanted to see if alternative lab test results could be used by an algorithmic model to identify people infected with the SARS-CoV-2 coronavirus.
To perform the research, the team incorporated patients’ age, sex, and race, into a machine learning model that was based on results from 27 routine lab tests chosen from a total of 685 different tests ordered for the patients. The study included 3,356 patients who were tested for SARS-CoV-2 at New York-Presbyterian Hospital/Weill Cornell Medical Center between March 11 and April 29 of this year. The patients ranged in ages from 18 to 101 with the mean age being 56.4 years. Of those patients, 1,402 were RT-PCR positive and the remaining 1,954 were RT-PCR negative.
Using a machine-learning technique known as a gradient-boosting decision tree, the algorithm identified SARS-CoV-2 infections with 76% sensitivity and 81% specificity. When looking at only emergency department (ED) patients, the model performed even better with 80% sensitivity and 83% specificity. ED patients comprised just over half (54%) of the patients used for the study.
Weill Cornell Medicine Algorithm Could Lower False Negative Test Results
The algorithm also correctly identified patients who originally tested negative for COVID-19, but who tested positive for the coronavirus upon retesting within two days. According to the researchers, these results indicated their model could potentially decrease the amount of incorrect test results.
“We are thinking that those potentially false negative patients may demonstrate a different routine lab test profile that might be more similar to those that test positive,” Fei Wang, PhD, Assistant Professor of Healthcare Policy and Research at Weill Cornell Medicine and the study’s senior author, told Modern Healthcare. “So, it offers us a chance to capture those patients who are false negatives.”
The researchers validated their model by comparing the results with patients seen at New York Presbyterian Hospital/Lower Manhattan Hospital during the same time period. Among those patients, 496 were RT-PCR positive and 968 were negative and the algorithmic model performed with 74% specificity and 76% sensitivity.
preliminarily identify high-risk SARS-CoV-2 infected patients before RT-PCR results are available,
risk stratify patients in the ED,
select patients who need relatively urgent retesting if initial RT-PCR results are negative,
help isolate infected patients earlier, and
assist in the identification of SARS-CoV-2 infected patients in areas where RT-PCR testing is unavailable due to financial or supply constraints.
Early Results of Study Promising, But More Research is Needed
Wang noted that more research is needed on the algorithm and that he and his colleagues are currently working on ways to improve the model. They are hoping to test it with different conditions and geographies.
“Our model in the paper was built on data from when New York was at its COVID peak,” he told Modern Healthcare. “At that time, we were not doing wide PCR testing, and the patients who were getting tested were pretty sick.”
At the time of the study, the positivity rate for COVID-19 at New York-Presbyterian Hospital was in the 40% to 50% range. That was substantially higher than the current positivity rate, which is in the 2% to 3% range, Modern Healthcare reported.
“This model we built in a population in New York in a certain time period, so we can’t guarantee that it will work well universally,” Wang told Modern Healthcare.
It’s exciting to think that advances in software algorithms may one day make it possible to combine routine clinical laboratory testing and create diagnostics that identify diseases in ways the individual tests were not originally designed to do.
This study is an example that researchers in AI and informatics are working to bring new tools and diagnostic capabilities to clinical laboratories. Also, this is a demonstration of how a patient’s results from multiple other types of lab tests can by analyzed using AI and similar analytical algorithms to diagnose a health condition unrelated to the original reasons for performing those tests.
If this can be demonstrated with other diseases and health conditions, it would open up one more way that pathologists and clinical laboratory scientists can contribute to more accurate diagnoses and improved selection of the most appropriate therapies for individual patients.
The CDC and US Navy study reveals common symptoms and suggests best protective measures to prevent spread in enclosed environments that clinical labs and pathology groups could use to protect their staff members
Results from a study conducted by the US Navy and the federal Centers for Disease Control and Prevention (CDC) of sailors onboard the USS Theodore Roosevelt during the recent COVID-19 outbreak aboard the ship may be useful for pathologists and clinical laboratory managers. The study also provides public health and infectious disease specialists with an opportunity to learn more about how the SARS-CoV-2 coronavirus spreads in enclosed environments.
The aircraft carrier garnered headlines in April due to a widespread outbreak of the coronavirus among its crew. The investigators asked crewmembers to complete a questionnaire and provide samples for a serological antibody test and molecular diagnostics test, reported the Navy’s Bureau of Medicine and Surgery (BUMED). The goal was to learn more about the disease and how it spreads in high-density environments. The COVID-19 tests were conducted April 20-24 while the ship was docked in Guam.
“This study paints a picture of current and prior SARS-CoV-2 infection among young adults living in close quarters,” said the study’s lead author Dan Payne, PhD, an epidemiologist at the CDC, in the BUMED statement. “This data will contribute to understanding COVID-19 in the US military, as well as among young adults in other close communal environments.”
Participation in the study was voluntary. At the time of testing, a total of 1,417 service members were still on the ship or at the base in Guam, the researchers wrote in their study. Among them, 383 crewmembers agreed to complete the survey and provide a blood sample for an enzyme-linked immunosorbent assay (ELISA) antibody test. Out of that group, 267 also provided nasal swab samples for a reverse transcription polymerase chain reaction (RT-PCR) molecular diagnostic test.
The questionnaire sought information about sailors’ demographic factors, health history, symptoms, and preventive behaviors, such as mask wearing and physical distancing. Crewmembers who tested positive for reactive antibodies received an additional test to detect presence of neutralizing antibodies that inhibit the virus.
The median age of participants was 30 years. About 75% were male. Only 28 (7.3%) reported comorbidities such as a history of asthma, diabetes, hypertension, or immunosuppression, which are considered risk factors for developing serious cases of the COVID-19 disease.
Key findings of the CDC/Navy’s study:
228 participants (59.7%) tested positive for reactive antibodies. Of those, 135 (59.2%) tested positive for neutralizing antibodies.
235 participants had previously tested positive in a SARS-CoV-2 diagnostic test. Of those, 212 (90.2%) tested positive for reactive antibodies.
A total of 238 participants had a previous or current SARS-CoV-2 infection. Of these, 18.5% reported no symptoms.
Of the 194 sailors who reported symptoms, 115 (59.3%) sought medical care, and two were hospitalized.
The most frequently reported symptoms were headache (66.5%), loss of taste or smell or both (61.3%); myalgia (56.2%); runny nose (55.7%); and fatigue (55.2%).
The most effective preventive measures were avoidance of common areas, increased physical distancing, and use of face coverings.
“What we saw was that most of the infections were actually mild, in addition to those that were asymptomatic,” Payne told reporters after the study was published, reported CNN. “And this is perhaps different from studies of older Americans, or maybe even those who were hospitalized already, and certainly much different from those with underlying health conditions.”
But with the high number of asymptomatic cases, “symptom-based surveillance might not detect all infections,” noted the researchers, who cautioned that “the analysis was conducted on a convenience sample of persons who might have had a higher likelihood of exposure, and all information was based on self-report, raising the possibility of selection and recall biases.”
In January, the crew of the Roosevelt totaled about 4,800 sailors, reported Defense One. However, after docking in Guam, many sailors were moved to hotel rooms for quarantine. As of May 5, at least 1,156 crewmembers had tested positive for infection, Stars and Stripes reported, and one had died.
Impact of COVID-19 on the USS Theodore Roosevelt’s Crew
As of April 6, 172 crew members had tested positive for COVID-19, including the ship’s captain Brett Crozier. At that time, 61% of the crew had received clinical laboratory testing and 1,999 sailors had been moved off the ship into quarantine, reported Defense One. By the next day, 270 sailors tested positive, a 57% increase from the previous day.
By April 14, 589 crew members were diagnosed positive for COVID-19. With 92% of the crew tested, 3,922 were found to be negative for the infection. Nevertheless, 4,024 sailors—nearly 83% of the crew—were moved into isolation quarters off-ship to prevent spread of the coronavirus.
In their study, the Navy/CDC researchers concluded: “In this convenience sample of young, healthy US service members experiencing close contact aboard an aircraft carrier, those with previous or current SARS-CoV-2 infection experienced mild illness overall, and nearly 20% were asymptomatic. Approximately one third of participants reported fever, myalgia, and chills and had higher odds of SARS-CoV-2 infection than did persons who reported cough and shortness of breath. Participants reporting anosmia (loss of sense of smell) or ageusia (loss of sense of taste) had 10 times the odds of having infection, compared with those who did not.
“In this sample of intensely exposed subjects, assessed at a single point in time, results demonstrated that antibodies developed and that, at the time of specimen collection, many of these were neutralizing antibodies. … This is a promising indicator of immunity, and in several participants, neutralizing antibodies were still detectable >40 days after symptom onset. Ongoing studies assessing the humoral antibody response over time will aid the interpretation of serologic results in an outbreak investigation such as this.
“These results provide new indications of symptomatology of SARS-CoV-2 infections and serologic responses among a cohort of young US adults living in a congregate environment and contribute to a better understanding of COVID-19 epidemiology in the US military. The findings reinforce the importance of nonpharmaceutical interventions such as wearing a face covering, avoiding common areas, and observing social distancing to lower risk for infection in similar congregate living settings.”
Not all the specific lessons learned from this COVID-19 outbreak aboard a US Navy vessel will be applicable to clinical laboratories and anatomic pathology groups. Nevertheless, it is probable that the data gleaned from the CDC/Navy study aboard the USS Theodore Roosevelt will someday mean civilian Americans can count on improved responses to disease outbreaks from the nation’s testing laboratories.
In the absence of a “gold standard,” researchers are finding a high frequency of false negatives among SARS-CoV-2 RT-PCR tests
Serology tests designed to detect antibodies to the SARS-CoV-2 coronavirus that causes the COVID-19 illness have been dogged by well-publicized questions about accuracy. However, researchers also are raising concerns about the accuracy of molecular diagnostics which claim to detect the actual presence of the coronavirus itself.
“Diagnostic tests, typically involving a nasopharyngeal swab, can be inaccurate in two ways,” said Steven Woloshin, MD, MS, in a news release announcing a new report that “examines challenges and implications of false-negative COVID-19 tests.” Woloshin is an internist, a professor at Dartmouth Institute, and co-director of the Geisel School of Medicine at Dartmouth.
“A false-positive result mistakenly labels a person infected, with consequences including unnecessary quarantine and contact tracing,” he stated in the news release. “False-negative results are far more consequential, because infected persons who might be asymptomatic may not be isolated and can infect others.”
Woloshin led a team of Dartmouth researchers who analyzed two studies from Wuhan, China, and a literature review by researchers in Europe and South America that indicated diagnostic tests for COVID-19 are frequently generating false negatives. The team published their results in the June 5 New England Journal of Medicine (NEJM).
For example, one research team in Wuhan collected samples from 213 hospitalized COVID-19 patients and found that an approved RT-PCR test produced false negatives in 11% of sputum samples, 27% of nasal samples, and 40% of throat samples. Their research was published on the medRxiv preprint server and has not been peer-reviewed.
The literature review Woloshin’s team studied was also published on medRxiv, titled, “False-Negative Results of Initial Rt-PCR Assays for COVID-19: A Systematic Review.” It indicated that the rate of false negatives could be as high as 29%. The authors of the review looked at five studies that had enrolled a total of 957 patients. “The collected evidence has several limitations, including risk of bias issues, high heterogeneity, and concerns about its applicability,” they wrote. “Nonetheless, our findings reinforce the need for repeated testing in patients with suspicion of SARS-Cov-2 infection.”
Another literature review, published in the Annals of Internal Medicine, titled, “Variation in False-Negative Rate of Reverse Transcriptase Polymerase Chain Reaction–Based SARS-CoV-2 Tests by Time Since Exposure,” estimated the probability of false negatives in RT-PCR tests at varying intervals from the time of exposure and symptom onset. For example, the authors found that the median false-negative rate was 38% if a test was performed on the day of symptom onset, versus 20% three days after onset. Their analysis was based on seven studies, five of which were peer-reviewed, with a total of 1330 test samples.
Doctors also are seeing anecdotal evidence of false negatives. For example, clinicians at UC San Diego Health medical center treated a patient with obvious symptoms of COVID-19, but two tests performed on throat samples were negative. However, a third test, using a sample from a bronchial wash, identified the virus, reported Medscape.
Sensitivity and Specificity of COVID-19 Clinical Laboratory Tests
The key measures of test accuracy are sensitivity, which refers to the ability to detect the presence of the virus, and specificity, the ability to determine that the targeted pathogen is not present. “So, a sensitive test is less likely to provide a false-negative result and a specific test is less likely to provide a false-positive result,” wrote Kirsten Meek, PhD, medical writer and editor, in an article for ARUP Laboratories.
“Analytic” sensitivity and specificity “represent the accuracy of a test under ideal conditions in which specimens have been collected from patients with either high viral loads or a complete absence of exposure,” she wrote. However, “sensitivity and specificity under real-world conditions, in which patients are more variable and specimen collection may not be ideal, can often be lower than reported numbers.”
In a statement defending its ID Now molecular point-of-care test, which came under scrutiny during a study of COVID-19 molecular tests by NYU Langone Health, Northwell Health, and Cleveland Clinic, according to MedTech Dive, Abbott Laboratories blamed improper sample collection and handling for highly-publicized false negatives produced by its rapid test. An FDA issued alert about the test on May 14 noted that Abbott had agreed to conduct post-market studies to identify the cause of the false negatives and suggest remedial actions.
Issues with Emergency Use Authorizations
In their NEJM analysis, Woloshin et al point to issues with the FDA’s process for issuing Emergency Use Authorizations (EUAs). For example, they noted variations in how manufacturers are conducting clinical evaluations to determine test performance. “The FDA prefers the use of ‘natural clinical specimens’ but has permitted the use of ‘contrived specimens’ produced by adding viral RNA or inactivated virus to leftover clinical material,” they wrote.
When evaluating clinical performance, manufacturers ordinarily conduct an index test of patients and compare the results with reference-standard test, according to the Dartmouth researchers. For people showing symptoms, the reference standard should be a clinical diagnosis performed by an independent adjudication panel. However, they wrote, “it is unclear whether the sensitivity of any FDA-authorized commercial test has been assessed in this way.” Additionally, a reference standard for determining sensitivity in asymptomatic people “is an unsolved problem that needs urgent attention to increase confidence in test results for contact-tracing or screening purposes.”
Continued adherence to current measures, such as physical distancing and surface disinfection.
Development of highly sensitive and specific tests or combinations of tests to minimize the risk of false-negative results and ongoing transmission based on a false sense of security.
Improved RT-PCR tests and serological assays.
Development and communication of clear risk-stratified protocols for management of negative COVID-19 test results.
“These protocols must evolve as diagnostic test, transmission, and outcome statistics become more available,” they wrote.
Meanwhile, clinical laboratories remain somewhat on their own at selecting which COVID-19 molecular and serology tests they want to purchase and run in their labs. Complicating such decisions is the fact that many of the nation’s most reputable in vitro diagnostics manufacturers cannot produce enough of their COVID-19 tests to meet demand.
Consequently, when looking to purchase tests for SARS-CoV-2, smaller medical laboratory organizations find themselves evaluating COVID-19 kits developed by little-known or even brand-new companies.
Though experts say an antigen test is not as accurate as PCR tests, its low cost, ease of use, and widespread availability make it a boon for clinical labs performing COVID-19 testing
As former FDA commissioner Scott Gottlieb, MD, explained on Face the Nation, “this kind of technology is a real game changer … it’s a very rapid test that could be used in a doctor’s office. Doctors now have about forty thousand of these Sofia machines already installed in their offices … you do a simple nasal swab and the test itself scans for the antigens that the virus produces.
“The test is about 85% sensitive. So, let’s say a hundred people come into a doctor’s office who have COVID-19, eighty-five of them are going to be able to be tested positive with this test very quickly. It’s a cheap test. It’ll probably be about five dollars a test and you can get a result within five minutes … you’re getting a very fast result and you can start to take action immediately.
“The company itself said that they’re going to be able to produce about two hundred thousand of these tests starting right away. But in several weeks, they’ll be able to produce up to 1.5 million a week. So, this dramatically expands our testing capacity as long as doctors are able to run these tests in their offices.”
Other LDTs That Have Received EUAs
Here’s a look at other laboratory-developed tests from major manufacturers that have received emergency-use authorizations from the FDA:
This test is designed for use with Abbott’s m2000 RealTime system, which is installed in about 200 US medical laboratories, the company says. It can run up to 470 patient samples in 24 hours. As of a May 11 statement, the company said it had shipped more than two million tests in the US.
This test is designed for use with Abbott’s Alinity m system, which the company describes as its “most advanced laboratory molecular instrument,” with the ability to run up to 1,080 tests in 24 hours, according to a press release.
This is a rapid test designed for use with the ID Now system, a compact portable instrument for point-of-care settings such as urgent care clinics. As of May 11, Abbott said it had shipped more than 1.7 million tests in the US, and that it planned to increase manufacturing capacity to two million tests per month.
However, the test has encountered some stumbling blocks. On May 14, the FDA issued an alert stating that the ID Now COVID-19 test could produce inaccurate negative results. This came after researchers at NYU Langone Health, Northwell Health, and Cleveland Clinic reported problems with the test, according to MedTech Dive. Abbott issued a statement suggesting that the problems were due to improper sample collection and handling, however, the FDA said that Abbott had agreed to conduct post-market studies to identify the cause of the false negatives and suggest remedial actions.
This is a qualitative test designed to detect the presence of IgG antibodies following a SARS-CoV-2 infection. The FDA authorized use of the assay on Abbott’s Architect i2000SR system in April, and then followed up with a May 11 EUA for its use on the Alinity i system. In a statement, Abbott said it planned to ship 30 million tests globally starting in May.
In a March statement, the FDA touted this as the first point-of-care COVID-19 test to receive an EUA. The company estimates the detection time as approximately 45 minutes. It is designed for use with Cepheid’s GeneXpert Dx diagnostic software and GeneXpert Infinity systems, which have nearly 5,000 US installations, according to a Cepheid statement.
This test runs on Hologic’s Panther system, which, according to a Hologic press release, can provide results in about three hours and run more than 1,000 tests per day. The company claims that more than 1,000 Panther systems are installed in US labs, and that it expects to produce an average of one million tests per week.
Ortho’s antibody test is designed for use with its VITROS XT 7600, 3600, 5600, and ECi/ECiQ immunodiagnostic systems, which, the company says are installed in more than 1,000 US labs. The Total Reagent Pack is a qualitative test that detects the presence of all antibodies against SARS-CoV-2.
On April 24, Ortho announced it had received another FDA EUA, this one for its Anti-SARS-CoV-2 IgG test, which detects the presence of IgG antibodies. In a statement, the company said it expects to produce “several million” IgG tests per month.
This test is designed for use with Roche’s cobas 6800 and 8800 systems. The 6800 can process up to 384 results in an eight-hour shift, Roche says, compared with 1,056 results for the 8800 model. The company says results are available in about 3.5 hours. In a statement, Roche said it planned to ship 400,000 tests per week.
Roche describes this as a qualitative antibody test that can be used on cobas e series immunoassay analyzers. Testing time is 18 minutes. As of May 19, the test was live at more than 20 US labs, “with plans in the next several weeks to increase to more than 200 commercial and hospital lab sites with the ability to perform millions of tests per week,” the company stated in a press release.
It’s likely the FDA will continue to issue emergency-use authorizations as the agency receives more applications from IVD manufacturers.