Automated method shows predictive power for COVID-19 in-hospital mortality

Depending on many factors, including concurrent medications, patient histories, and comorbidities, the effectiveness of medical treatments can vary from patient to patient in coronavirus disease 2019 (COVID-19). Due to this, a wide variety of statistical tools have been established to robustly estimate heterogeneous treatment effects (HTE) and individualized treatment effects (ITE) as functions of patient features. However, it requires a large number of pairwise tests to test multiple treatments for heterogeneous effects.

Study: Automated Interpretable Discovery of Heterogeneous Treatment Effectiveness: A Covid-19 Case Study. Image Credit: Corona Borealis Studio/ Shutterstock

In a research paper posted to the medRxiv* server, researchers from the Massachusetts Institute of Technology (MIT), NYU Langone Health and Microsoft Research focussed on the S-learner strategy of estimating the conditional average treatment effect (CATE). This strategy uses a single model that models mortality risk as a function of treatment and patient risk factors, allowing for the comparison of mortality risk with and without the treatment for different patient risk factors.

The authors validated the proposed method on the MIMIC-IV dataset to test its recovery of HTEs. This method was then applied to a dataset containing over three thousand hospitalized COVID-19 patients, and evidence was found of HTEs which were largely predicted by indicators of inflammation and thrombosis risk. Furthermore, patients who benefited most from inflammation treatments were those with few indicators of thrombosis risk, while those who benefited the most from thrombosis treatments were those with few indicators of inflammation risk.

The study

The baseline mortality risks associated with comorbidities and pre-admission outpatient medications are depicted in Figure 1. The effects observed of comorbidities and outpatient medications coincide with mechanisms of mortality related to inflammation and/or thrombosis. Valve replacement is the most protective association, for which the typical treatment is long-term anti-coagulants. The most harmful association are hypertension, heart failure, and myocardial infarction.

From laboratory tests conducted, it was observed that the most significant effect is for neutrophil/lymphocyte ratio, which is used to measure inflammation and to indicate the severity of COVID-19. The likelihood of death I also increased by the presence of procalcitonin and c-reactive protein. Serum calcium levels were also noteworthy, as no elevation in levels is related to increased risk, and levels of creatinine, which indicate a step-function drop in risk at 4 mg/dL, a common threshold for dialysis decisions. Also shown in the laboratory results was that hematocrit displays opposite effects when estimated in isolation or following correction for other factors.

The HTEs of six treatments were assessed in this study (heparin, non-steroidal anti-inflammatories [NSAIDs], hydroxychloroquine, azithromycin, zinc replacement, and glucocorticoids). All of these treatments display diminished effectiveness with increasing patient age, which is associated with severe outcomes related to COVID-19.

The HTEs of three of these treatments are associated with neutrophil/lymphocyte ratio, which is a marker of inflammation and severe COVID-19. With an increase in neutrophil/lymphocyte rate, the statistical benefit of heparin, azithromycin, and NSAIDs decreases, while there is no significant heterogeneity shown with the effectiveness of hydroxychloroquine, zinc, or glucocorticoids.

When glucocorticoids were used in combination with azithromycin, there was a decrease in benefit observed. With patients with a history of alcoholism, NSAIDs showed an increase in benefit. Diminished benefits were seen with zinc replacement in patients with congestive heart failure, which would be expected if any protective effects of zinc were due to mediation of thromboses because platelet aggregation inhibitors and anticoagulants are routinely prescribed to patients with this condition.

Implications

The authors in this paper proposed a method to substantiate the varying effectiveness of different medical treatments by training adaptive models, exploring the benefits of personalized treatments, and sharing statistical power between many treatments. This method was applied to mortality risk models of COVID-19 patients, and it revealed two pathways of mortality: inflammation and thrombosis.

*Important notice

medRxiv publishes preliminary scientific reports that are not peer-reviewed and, therefore, should not be regarded as conclusive, guide clinical practice/health-related behavior, or treated as established information.

Written by

Colin Lightfoot

Colin graduated from the University of Chester with a B.Sc. in Biomedical Science in 2020. Since completing his undergraduate degree, he worked for NHS England as an Associate Practitioner, responsible for testing inpatients for COVID-19 on admission.