The Gangelt study that surfaced this morning is interesting as it includes now more sound statistics using GEE models to account for household clustering (in a previous interview the lead author denied the value of statistical models). The PDF is only available an internal university server without any doi number and timestamp – not even a “preprint” at all.
Maybe I am a bit disappointed as it remains basically a cross-sectional analysis, without any virus phylogeny and without any description if and how containment measurements were followed under lock-down conditions. At first glance, although being performed at a hotspot, PCR results are not particular exciting. 439/12597=3.4% as measured by official surveillance and 33/919=3.6% as measured by the authors.
The claim to fame (besides some annoying reports about the accompanying PR campaign that made it even into Science magazine) are those 15% antibody positive results. Everything in this paper depends on the IgG antibody specificity to Sars-Cov2. It is reported
as of April 7, 2020, validated in cooperation with the Institute of Virology of the Charité in Berlin, and the Erasmus MC in Rotterdam, Euroimmun, Lübeck, Germany). The data sheet (April 7, 2020) reports cross-reactivities with anti-SARS-CoV-1-IgG-antibodies, but not with MERS-CoV-, HCoV-229E-, HCoV-NL63-, HCoV-HKU1- or HCoV-OC43-IgG antibodies.
which is a bit weak regarding current pre-test standards, neither in terms of selection of samples, numbers and reporting. The press briefing even adds more confusion
as this reference is not cited in the preprint. I assume it is the Lassaunière comparison (medRxiv preprint) that showed a specificity of 96% only which is n o t s o good with the low prevalence expected.
A further study on medRxiv reported a specificity of 99% using a “well-defined specificity panel of 147 serum and plasma samples” without any further description. Seroconversion data would also been helpful from Gangelt – why are those N=9 in the figure below not being retested after 2 weeks?
PCRreported overlaps with PCRnew as expected while I would like to see also the match of PCRnew with PCRreported negative results.
Unfortunately all consecutive plots stratify for infection rate only (combining IgG+ and PCR+) but do not show if the significant difference between carnival / no carnival is due to IgG+. Did IgG+ probands suffer from more symptoms? Why do the co-morbidities not show up here as in many other studies? Why is there such a low household secondary infection rate although the initial transmission is so high?
The contact persons outside of the household are ignored. Unfortunately, the paper also does not show the data promised in a previous interview, for example data on drug use, seating arrangement at the festival, infection chain and association with school closing at the end of January. Will that be published only as salami sliced?
Compared to the April 9 report, based on 500 study participants there are also major discrepancies
– the number of inhabitants in Gangelt increased by 68 for whatever reason
– Forsa is no more mentioned in the acknowledgment
– the percentage of PCR+ individuals was previously given as 2% but is now reported to be 3.6%. Either the first figure was completely wrong, or the additional 419 individuals must have contributed a phenomenal 5,5% PCR+ rate.
– the preliminary case fatality CFR was 0.37% based on 7 individuals. This figure remained unchanged even when moving to infection fatality IFR that should be lower as the denominator increased with more infections. Patients also continued to die after the end of the observation period, making the IFR estimate unreliable if not expanded by the 14-21 day usual symptom to death interval.
I tried to validate those 7 deaths reported in the manuscript for Gangelt until March 30. RKI reports 55 in the district Heinsberg until March 30. Did most of them really happen outside Gangelt?
According to the official statistics of the state department we may expect 11 deaths per month in Gangelt. So with the 7 reported cases we should find 18 cases by the end of March. According to the website https://www.aachen-gedenkt.de there are, however, 21 obituaries found in Gangelt eg 3 more than expected. Maybe there are some errors in my re-analysis as the obituaries do not always give the last address or not each death results in an obituary but we can assume that there was at least an excess of 10 and not only of 7 cases until March 30. For a final estimate we need to add at least 1 more case who died after the end of study. My estimate therefore is at least 11 and not just 7 cases.
– Why have the death certificates not been verified in a paper that has even “infection fatality rate” in the title?
– Why are there no virus tests in the victims?
There are few more but less important issues
– it does not make sense in Figure 5 for 1 person to be infected by 1 person
– the prevalence of 107 lung diseases in table 1 is wrong with the given percentage
– the “officially reported cases for this community 3.1%” in the abstract contradicts Fig 1A which gives 439/12597 or 3.5%
– a non responder survey is missing in particular as previously PCR+ individuals were underrepresented. Although not directly reported in the paper, I calculate the response to 407/600=67.8% which is acceptable but not top class.
Taken together, it seems that the study leaves us with a lot of open questions. What is the functional relevance of this particular Ig G+? Is there any Ig G+ reinfection? What do the N=20 in the diagram 2C mean – chronic carrier, false positives, re-infected patients?
The new FAZ headline published in parallel is clearly unwarranted as hotspot data can not be extrapolated.
15% of 81 Million infected? Only now I get the argument: the authors increase their infection rate from 15% to 20% due to some non-participation, then use the IFR based on 7 cases, relate it to the number of German inhabitants to obtain the number of infected ones in Germany. Breathtaking!
Commentary: While I think, it is fine to post a preprint ahead of a publication, this is not even a preprint, it is just a copy of a manuscript on a university server. Using this copy to legitimate a FAZ headline, means that the information released here can no more retracted. It will influence politics, it will influence the live of millions of people. It also means: peer opinion is not relevant for somebody who talks to the press without any peer comment. Streeck hat been warned after publishing the interim report while circumventing again standard procedures in science, means this is a misuse of science as pretext.