2 In Silico studies support the efficacy of lactoferrin [Cutone, Miotto].

5 In Vitro studies support the efficacy of lactoferrin [Cutone, Mirabelli, Ostrov, Piacentini, Salaris].

Preclinical research is an important part of the development of treatments, however results may be very different in clinical trials. Preclinical results are not used in this paper.

Figure 3 shows a visual overview of the results, with details in Table 1 and Table 2. Figure 4, 5, 6, 7, and 8 show forest plots for a random effects meta-analysis of all studies with pooled effects, mortality results, hospitalization, recovery, and viral clearance.

To avoid bias in the selection of studies, we analyze all non-retracted studies. Here we show the results after excluding studies with major issues likely to alter results, non-standard studies, and studies where very minimal detail is currently available. Our bias evaluation is based on analysis of each study and identifying when there is a significant chance that limitations will substantially change the outcome of the study. We believe this can be more valuable than checklist-based approaches such as Cochrane GRADE, which may underemphasize serious issues not captured in the checklists, overemphasize issues unlikely to alter outcomes in specific cases (for example, lack of blinding for an objective mortality outcome, or certain specifics of randomization with a very large effect size), or be easily influenced by potential bias. However, they can also be very high quality.

The studies excluded are as below. Figure 9 shows a forest plot for random effects meta-analysis of all studies after exclusions.

[Rosa], excessive unadjusted differences between groups. Excluded results: no recovery.

[Shousha], confounding by indication, unadjusted results and treatment used selectively per official protocol, unadjusted results with no group details.

Heterogeneity in COVID-19 studies arises from many factors including:

Treatment delay.

The time between infection or the onset of symptoms and treatment may critically affect how well a treatment works. For example an antiviral may be very effective when used early but may not be effective in late stage disease, and may even be harmful. Oseltamivir, for example, is generally only considered effective for influenza when used within 0-36 or 0-48 hours [McLean, Treanor]. Figure 11 shows a mixed-effects meta-regression for efficacy as a function of treatment delay in COVID-19 studies from 47 treatments, showing that efficacy declines rapidly with treatment delay. Early treatment is critical for COVID-19.

Patient demographics.

Details of the patient population including age and comorbidities may critically affect how well a treatment works. For example, many COVID-19 studies with relatively young low-comorbidity patients show all patients recovering quickly with or without treatment. In such cases, there is little room for an effective treatment to improve results (as in [López-Medina]).

Effect measured.

Efficacy may differ significantly depending on the effect measured, for example a treatment may be very effective at reducing mortality, but less effective at minimizing cases or hospitalization. Or a treatment may have no effect on viral clearance while still being effective at reducing mortality.

Variants.

There are many different variants of SARS-CoV-2 and efficacy may depend critically on the distribution of variants encountered by the patients in a study. For example, the Gamma variant shows significantly different characteristics [Faria, Karita, Nonaka, Zavascki]. Different mechanisms of action may be more or less effective depending on variants, for example the viral entry process for the omicron variant has moved towards TMPRSS2-independent fusion, suggesting that TMPRSS2 inhibitors may be less effective [Peacock, Willett].

Regimen.

Effectiveness may depend strongly on the dosage and treatment regimen.

Other treatments.

The use of other treatments may significantly affect outcomes, including anything from supplements, other medications, or other kinds of treatment such as prone positioning.

Medication quality.

The quality of medications may vary significantly between manufacturers and production batches, which may significantly affect efficacy and safety. [Williams] analyze ivermectin from 11 different sources, showing highly variable antiparasitic efficacy across different manufacturers. [Xu] analyze a treatment from two different manufacturers, showing 9 different impurities, with significantly different concentrations for each manufacturer. Non-prescription supplements may show very wide variations in quality [Crawford, Crighton].

Meta analysis.

The distribution of studies will alter the outcome of a meta analysis. Consider a simplified example where everything is equal except for the treatment delay, and effectiveness decreases to zero or below with increasing delay. If there are many studies using very late treatment, the outcome may be negative, even though the treatment may be very effective when used earlier.

In general, by combining heterogeneous studies, as all meta analyses do, we run the risk of obscuring an effect by including studies where the treatment is less effective, not effective, or harmful.

When including studies where a treatment is less effective we expect the estimated effect size to be lower than that for the optimal case. We do not a priori expect that pooling all studies will create a positive result for an effective treatment. Looking at all studies is valuable for providing an overview of all research, important to avoid cherry-picking, and informative when a positive result is found despite combining less-optimal situations. However, the resulting estimate does not apply to specific cases such as early treatment in high-risk populations. While we present pooled results for all studies, we also present individual outcome and treatment time analyses, which are more relevant for specific use cases.

Publication bias.

Publishing is often biased towards positive results, however evidence suggests that there may be a negative bias for inexpensive treatments for COVID-19. Both negative and positive results are very important for COVID-19, media in many countries prioritizes negative results for inexpensive treatments (inverting the typical incentive for scientists that value media recognition), and there are many reports of difficulty publishing positive results [Boulware, Meeus, Meneguesso]. For lactoferrin, there is currently not enough data to evaluate publication bias with high confidence.

One method to evaluate bias is to compare prospective vs. retrospective studies. Prospective studies are more likely to be published regardless of the result, while retrospective studies are more likely to exhibit bias. For example, researchers may perform preliminary analysis with minimal effort and the results may influence their decision to continue. Retrospective studies also provide more opportunities for the specifics of data extraction and adjustments to influence results.

The median effect size for retrospective studies is 77% improvement, compared to 36% for prospective studies, suggesting a potential bias towards publishing results showing higher efficacy. Figure 12 shows a scatter plot of results for prospective and retrospective studies.

Funnel plot analysis.

Funnel plots have traditionally been used for analyzing publication bias. This is invalid for COVID-19 acute treatment trials — the underlying assumptions are invalid, which we can demonstrate with a simple example. Consider a set of hypothetical perfect trials with no bias. Figure 13 plot A shows a funnel plot for a simulation of 80 perfect trials, with random group sizes, and each patient's outcome randomly sampled (10% control event probability, and a 30% effect size for treatment). Analysis shows no asymmetry (p > 0.05). In plot B, we add a single typical variation in COVID-19 treatment trials — treatment delay. Consider that efficacy varies from 90% for treatment within 24 hours, reducing to 10% when treatment is delayed 3 days. In plot B, each trial's treatment delay is randomly selected. Analysis now shows highly significant asymmetry, p < 0.0001, with six variants of Egger's test all showing p < 0.05 [Egger, Harbord, Macaskill, Moreno, Peters, Rothstein, Rücker, Stanley]. Note that these tests fail even though treatment delay is uniformly distributed. In reality treatment delay is more complex — each trial has a different distribution of delays across patients, and the distribution across trials may be biased (e.g., late treatment trials may be more common). Similarly, many other variations in trials may produce asymmetry, including dose, administration, duration of treatment, differences in SOC, comorbidities, age, variants, and bias in design, implementation, analysis, and reporting.

Conflicts of interest.

Pharmaceutical drug trials often have conflicts of interest whereby sponsors or trial staff have a financial interest in the outcome being positive. Lactoferrin for COVID-19 lacks this because it is an inexpensive and widely available supplement. In contrast, most COVID-19 lactoferrin trials have been run by physicians on the front lines with the primary goal of finding the best methods to save human lives and minimize the collateral damage caused by COVID-19. While pharmaceutical companies are careful to run trials under optimal conditions (for example, restricting patients to those most likely to benefit, only including patients that can be treated soon after onset when necessary, and ensuring accurate dosing), not all lactoferrin trials represent the optimal conditions for efficacy.

Early/late vs. mild/moderate/severe.

Some analyses classify treatment based on early/late administration (as we do here), while others distinguish between mild/moderate/severe cases. We note that viral load does not indicate degree of symptoms — for example patients may have a high viral load while being asymptomatic. With regard to treatments that have antiviral properties, timing of treatment is critical — late administration may be less helpful regardless of severity.

Lactoferrin is an effective treatment for COVID-19. Statistically significant improvement is seen for viral clearance. 2 studies from 2 independent teams (both from the same country) show statistically significant improvements in isolation (1 for the most serious outcome). Meta analysis using the most serious outcome reported shows 48% [30‑62%] improvement. Results are worse for Randomized Controlled Trials and similar after exclusions. Early treatment is more effective than late treatment.

Currently there is limited data, with only 786 patients in trials to date.

Algahtani

[Algahtani] RCT 54 hospitalized patients in Egypt, showing no significant differences in recovery with lactoferrin treatment. 200mg lactoferrin orally once daily (group 1) or 200mg lactoferrin orally twice daily (group 2).

Submit Corrections or Updates.

Campione

[Campione] Small prospective study in Italy with 32 lactoferrin patients, 32 SOC, and 28 patients with no treatment, showing significantly faster viral clearance and improved recovery with treatment. Oral and intranasal lactoferrin.

Submit Corrections or Updates.

Rosa

[Rosa] Retrospective survey based study in Italy with 82 patients treated with lactoferrin, and 39 control patients, showing significantly faster viral clearance with treatment. There was no significant difference in recovery time overall, however the treatment group had significantly more moderate condition patients (39% versus 8%), and improved recovery was seen with treatment as age increased. Median dose for asymptomatic patients was 400mg/day, for paucisymptomatic patients 600mg/day, and for moderate condition patients 1000mg three times a day.

Submit Corrections or Updates.

Shousha

[Shousha] Retrospective 547 hospitalized COVID+ patients in Egypt, showing lower mortality with lactoferrin treatment (without statistical significance).

Submit Corrections or Updates.

We performed ongoing searches of PubMed, medRxiv, ClinicalTrials.gov, The Cochrane Library, Google Scholar, Collabovid, Research Square, ScienceDirect, Oxford University Press, the reference lists of other studies and meta-analyses, and submissions to the site c19early.com. Search terms were lactoferrin, filtered for papers containing the terms COVID-19 or SARS-CoV-2. Automated searches are performed every few hours with notification of new matches. All studies regarding the use of lactoferrin for COVID-19 that report a comparison with a control group are included in the main analysis. Sensitivity analysis is performed, excluding studies with major issues, epidemiological studies, and studies with minimal available information. This is a living analysis and is updated regularly.

We extracted effect sizes and associated data from all studies. If studies report multiple kinds of effects then the most serious outcome is used in pooled analysis, while other outcomes are included in the outcome specific analyses. For example, if effects for mortality and cases are both reported, the effect for mortality is used, this may be different to the effect that a study focused on. If symptomatic results are reported at multiple times, we used the latest time, for example if mortality results are provided at 14 days and 28 days, the results at 28 days are used. Mortality alone is preferred over combined outcomes. Outcomes with zero events in both arms were not used (the next most serious outcome is used — no studies were excluded). For example, in low-risk populations with no mortality, a reduction in mortality with treatment is not possible, however a reduction in hospitalization, for example, is still valuable. Clinical outcome is considered more important than PCR testing status. When basically all patients recover in both treatment and control groups, preference for viral clearance and recovery is given to results mid-recovery where available (after most or all patients have recovered there is no room for an effective treatment to do better). If only individual symptom data is available, the most serious symptom has priority, for example difficulty breathing or low SpO₂ is more important than cough. When results provide an odds ratio, we computed the relative risk when possible, or converted to a relative risk according to [Zhang]. Reported confidence intervals and p-values were used when available, using adjusted values when provided. If multiple types of adjustments are reported including propensity score matching (PSM), the PSM results are used. Adjusted primary outcome results have preference over unadjusted results for a more serious outcome when the adjustments significantly alter results. When needed, conversion between reported p-values and confidence intervals followed [Altman, Altman (B)], and Fisher's exact test was used to calculate p-values for event data. If continuity correction for zero values is required, we use the reciprocal of the opposite arm with the sum of the correction factors equal to 1 [Sweeting]. Results are expressed with RR < 1.0 favoring treatment, and using the risk of a negative outcome when applicable (for example, the risk of death rather than the risk of survival). If studies only report relative continuous values such as relative times, the ratio of the time for the treatment group versus the time for the control group is used. Calculations are done in Python (3.10.6) with scipy (1.9.1), pythonmeta (1.26), numpy (1.23.2), statsmodels (0.13.2), and plotly (5.10.0).

Forest plots are computed using PythonMeta [Deng] with the DerSimonian and Laird random effects model (the fixed effect assumption is not plausible in this case) and inverse variance weighting. Mixed-effects meta-regression results are computed with R (4.1.2) using the metafor (3.0-2) and rms (6.2-0) packages, and using the most serious sufficiently powered outcome.

We received no funding, this research is done in our spare time. We have no affiliations with any pharmaceutical companies or political parties.

We have classified studies as early treatment if most patients are not already at a severe stage at the time of treatment (for example based on oxygen status or lung involvement), and treatment started within 5 days of the onset of symptoms. If studies contain a mix of early treatment and late treatment patients, we consider the treatment time of patients contributing most to the events (for example, consider a study where most patients are treated early but late treatment patients are included, and all mortality events were observed with late treatment patients). We note that a shorter time may be preferable. Antivirals are typically only considered effective when used within a shorter timeframe, for example 0-36 or 0-48 hours for oseltamivir, with longer delays not being effective [McLean, Treanor].

Early treatment

Effect extraction follows pre-specified rules as detailed above and gives priority to more serious outcomes. For pooled analyses, the first (most serious) outcome is used, which may differ from the effect a paper focuses on. Other outcomes are used in outcome specific analyses.

Late treatment

Effect extraction follows pre-specified rules as detailed above and gives priority to more serious outcomes. For pooled analyses, the first (most serious) outcome is used, which may differ from the effect a paper focuses on. Other outcomes are used in outcome specific analyses.

Supplementary Data