What can we learn from the Delhi seroprevalence study and a single proportion that was reported?

A list of contributors to this piece is provided at the end of this report. For detailed analytic formulation and code, please click here for the technical preprint [direct download link, please check downloads folder].

Almost one in four people in Delhi had been infected by the novel coronavirus by July 10 according to a serological survey conducted by the National Centre for Disease Control (NCDC) [The Hindu; Indian Express 1; Indian Express 2]. The survey found that 22.86% of the 21,387 serology samples collected across 11 districts of Delhi had detected IgG antibodies against SARS-CoV-2. This implies that Delhi, with approximately 20 million (2 crore) people, had a total number of cases standing somewhere around 4.6 Million (46 lakhs) by July 10. Delhi has reported only 133,310 cases and 3,907 through July 29 [covid19india.org]. On July 10, the number of cases reported for Delhi stood at 109,140 and number of deaths at 3,300. This gives you an underreporting factor for case counts at 42; it tells you that only 2.4% of cases are being detected and also implies that the infection fatality rate (IFR) for Delhi is of the order of 0.07% (3300/4.6M) or 717 per million if we believe the reported death data. The IFR seems low compared to estimates worldwide [median IFR 0.27% across 36 studies worldwide according to Ioannidis 2020] which is indeed a good news. However, it may be reasonable to argue that just like cases, deaths could also possibly be largely unreported in India [Financial Times; VICE; Times of India] and/or the cause of death could be misclassified.

There are several questions this seroprevalence study is raising: Should the alarmingly high number of asymptomatic cases worry us or make us happy that we are closer to herd immunity? Does being antibody positive mean you have immunity to the COVID-19 virus and are not contagious or at risk of re-infection? Should we trust the reported death counts and take comfort in the projected low IFR, and let life unfold and resume normalcy in Delhi? Should we be cavalier about non-pharmaceutical interventions such as: social distancing, mask wearing, hand washing, quarantine and self-isolation upon potential exposure, avoiding large gatherings and crowded indoor spaces? Should we now feel complacent as the chance of an infected person meeting a susceptible person has gone down and you are more likely to meet an antibody positive person? Let us take a deep dive through the lens of data and mathematical modeling into these numbers and see what we can say.

Which tests were used for COVID-19?

Image for post
Image for post
Figure 1. Timeline of RT-PCR diagnostic test and Antibody test for SARS-CoV-2 infection.

Are these tests perfect?

Image for post
Image for post
Figure 2. Schematic explanation of properties of a diagnostic test. The same scheme applies to serological tests for presence of IgG antibodies.

Can we correct for these testing errors?

Image for post
Image for post
Table 1. True cases, reported cases, underreporting factors, case-fatality rates and infection fatality rates across various misclassification error rates.

At this observed IFR if 50% people in India (with a population of 1.38 billion) get infected and if we believe the reported death data, there will be 552,000 deaths. If we believe one out of 10 deaths are reported then there will be somewhere around 5.5 million deaths. Thus the country-wide unrestricted spread has to be arrested. Every death count is a life loved by others and a life lost. Let us do our best to persevere till scientists get to a vaccine and treatments for COVID with inspiring research that is moving at a war-time speed [COVID-19 vaccine tracker].

Is this seroprevalence in Delhi an outlier in the world?

Image for post
Image for post
Table 2. A summary of seroprevalence estimates for SARS-CoV-2 infections worldwide.

What does this mean about community transmission?

So now only herd immunity will save us?

While almost one quarter of Delhi is likely have some protection for the virus, there is still a large proportion of uninfected individuals who are susceptible. We also know little about how long the protection lasts and the contagiousness of Ab positive people. In short, anything that can be done to slow the spread of the virus so that healthcare capacity is not overwhelmed should continue to be done. India has1.38 billion people and while the curve is tapering off in states like Delhi, Mumbai, Tamil Nadu, we have several other states on an upward rise(see the metrics tab at covind19.org). With increased mobility and relaxation of lockdown, remote villages are now at risk with almost no testing and fragile healthcare infrastructure. Let us buckle up and do our best to be vigilant, socially responsible and cautiously optimistic based on these numbers .

What else do we need to know to understand the full implications of this study?

Most importantly, we do not know if individuals with antibodies have immunity (are protected from re-infection) or how long this protection lasts [NPR; Ibarrondo et al.]. We only know that people with antibodies are possibly protected in some fashion for some amount of time [Deng et al.]. We need to know more about the longevity of the ephemeral antibody response and the levels needed to protect us from re-infections. We also do not know much about whether an antibody-positive person is contagious or the severity of the clinical symptoms that they themselves may show. When in doubt, protect yourself and others.

Can models predict asymptomatic cases when we do not have a serosurvey?

Image for post
Image for post
Figure 3. SEIR model with false negative rate for the RT-PCR diagnostic test.

What we find under this model is a striking agreement with the seroprevalence study. This model estimates 4.8 million true infections (compared to the 4.6 million implied by the Delhi Seroprevalence Study) and 33,165 deaths (reported +unreported) on July 10 if we assume the RT-PCR test has a sensitivity of 0.85. We present model predictions for RT-PCR test sensitivities of 1, 0.85, and 0.7 in Figure 4. The underreporting factor for infections is between 35–53x depending on the sensitivity of the test.

Image for post
Image for post
Figure 4. Predicted total number of cases and deaths (reported+unreported) by SEIR model incorporating imperfect RT-PCR testing.

This is encouraging as seroconversions happen and seroprevalence studies need to be done repeatedly which is expensive in terms of cost and time. In contrast, fitting a model, solving equations, learning from data are much more affordable. Usually we cannot validate the estimate of asymptomatic cases in SEIR models as we do not get to observe it in reality. In this particular case the parallel seroprevalence data gives us a validation for our model. This model also predicts 8–13 times more death than have been observed, for which we do not have any validation data.

Conclusion

Image for post
Image for post
Image for post
Image for post
Figure 5. The reported case trajectory in Delhi and the effective reproduction number over time.

Though there is more hope with what we know now, there is no room for complacency. Each state in India has to reach a state of containment (defined as a few cases per million) for us to safely release the brake. Till then we will need to live a life of confinement, restriction and collective sacrifice. The task list is now known to all of us:

Government:

  • Testing and contact tracing
  • Protective gears and equipments for frontline healthcare workers
  • Symptom tracking
  • Centralized isolation and quarantine
  • Work with health care and public health experts
  • Ramping up healthcare capacity
  • Affordable access to healthcare and tests for the most vulnerable
  • Replicating/borrowing models of success from some states/low-resource communities in states where the curve is rising
  • Modulated-punctuated lockdowns in a data-agile way
  • Continue well-designed large-scale seroprevalence surveys
  • Most importantly, integrative leadership and coordination

The leaders and policymakers need to bring together health care, public health, social support, financial sectors and scientific experts to rally around our common good. We need a long term strategy, not headline management through discrete tactics.

Public:

  • Community engagement and participation
  • Trust in Science and Public Health
  • Wear masks, wash hands, and socially distance
  • Strike a balance between alarmism and denial while minimizing personal risks, acceptance of the long term nature of the pandemic is needed
  • Make collective sacrifices in terms of our social life to avoid large indoor gatherings and non-essential travel
  • Prioritize on well-being and mental health
  • Protect the most vulnerable in your own social radius

We are not defenseless against this virus. Let us buy scientists some time to get to the vaccines and treatments where there has been remarkable accelerated progress. Sacrifice, social responsibility, vigilance, resilience, acceptance, solidarity, discovery: lofty words, but history says that monumental crises have always needed these attributes from the human race. We are in this together, we can do better. We cannot take a fatalistic approach and surrender to destiny.

The COV-IND-19 Study Group is comprised of an interdisciplinary group of scholars and data scientists. The following members contributed to this piece:

  • Rupam Bhattacharyya — Department of Biostatistics, University of Michigan
  • Ritwik Bhaduri — Indian Statistical Institute, Kolkata
  • Ritoban Kundu —Indian Statistical Institute, Kolkata
  • Maxwell Salvatore — Departments of Biostatistics and Epidemiology and Center for Precision Health Data Science, University of Michigan
  • Bhramar Mukherjee — Departments of Biostatistics and Epidemiology and Center for Precision Health Data Science, University of Michigan

Contact Bhramar Mukherjee (bhramar@umich.edu) with questions and inquiries.

An interdisciplinary group of scholars and data scientists who use of data and modeling to generate timely reports and recommendations about COVID-19 in India

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store