Hacker News new | ask | show | jobs
by jgeada 1334 days ago
So a likely extremely controversial paper being shared publicly to a non-expert audience prior to any peer-review.

Is this going to be yet one more of those “will be withdrawn after peer scrutiny but by then it is too late because the false meme has been injected into the public consciousness” things?

3 comments

They did share it with scientists. Here’s Francois Balloux saying he replicated the results, tried to find holes, couldn’t

https://mobile.twitter.com/BallouxFrancois/status/1583165259...

Here's another blue check immunologist on twitter with a substantially different take:

https://twitter.com/K_G_Andersen/status/1583252866394771456

The authors of this paper are confused about the technology they're using... it's not a good sign about their conclusions..

https://twitter.com/matias_kaplan/status/1583235087067336704

https://twitter.com/NoahOlsman/status/1583275862442807299

Oh dear... Yeah, the author affiliations on the title paper made me wonder if they knew what they were doing at all.
Their terminology would indeed seem wrong, but the WIV has apparently used a similar assembly strategy (leaving the sites in the final assembly) before:

https://twitter.com/jbkinney/status/1583267221047869441

I'd worry about their false discovery rate, for the same reason I worry about the large number of parameters in Pekar's epi model. It's still an interesting result, though.

As far as I've been able to read, those sites aren't in the final assembly in Shi's papers - just in the primers. And even more worrying than the false discovery rate are all of the missing genomes they should be comparing. I fear they've left them off because they punch big ole holes in the theory... e.g.

https://twitter.com/zhihuachen/status/1583258714340892672

It feels telling that when I click that link, the associated tweets are the kookiest of conspiracy theories about Pfizer execs, vaccine mandates and people screeching about things they clearly don't understand. I suspect in a few days, with Bloom and others reviewing the preprint they're going to be forced to pull it down and "rework" it.
It's incredible that the only sensible comments on this thread are this far down. The HN audience really has a massive Dunning-Kruger problem when it comes to science topics (especially true for COVID conspiracy theories).
As a pharmacologist reading the HN crowd arguing about hydroxychloroquine a year or so ago really highlighted 90% of this site regarding topics other than development or start-ups is at the same level as youtube comments, but with more arrogance.
Eh... That's why it's important to speak up and teach where you can. You never know who might learn something, and you may find yourself learning something in return.

Nobody gains anything in silence however.

I had the same experience a couple of years back when people started discussing AI. I try to keep this in mind but somehow I keep forgetting. It’s genuinely difficult to filter good from bad takes without expert level understanding of a topic unfortunately.
Looks like he deactivated his account. I would guess the response to these tweets might have something to do with it.
I sincerely hope not. From one of the authors:

"Scientists publish papers not because the paper is the end of science, but because it is a unit of research that is valuable to share with others so that others can use this brick of knowledge and either build with it… or find its weakness and break it down...We wrote our entire analysis in R and shared our code with the world. I tried SO hard to check every single line of code and make our pipeline clear & easy to reproduce. However, despite nearly giving myself stomach ulcers checking every line and stressing about these findings, it’s possible someone finds a mistake in our work. We don’t share this work happily - this is the saddest paper I’ve ever written. We’ve shared our code precisely for that reason: we want you to see exactly what we’ve done, and if we’ve done something wrong we are open to hearing it."

As to your original concern, it is a valid one. I wrote this is response to pre-prints popularized via the press earlier this year:

-> Make bold, unjustifiable claims in the preprint; -> Ensure widespread coverage in the science press; -> Walk back those claims during peer-review; -> Get published; and then -> Watch blue checks tout original claims as "Fact!"

Any publicity is good publicity. Sprinkle in some words about "this needs further study" and hope someone comes along to fund the next few years of your lab.
Lazy question. Is there a git url for the code?
To save you the two clicks, the code is at https://github.com/reptalex/SARS2_Reverse_Genetics
> Is this going to be yet one more of those “will be withdrawn after peer scrutiny but by then it is too late because the false meme has been injected into the public consciousness” things?

They only get withdrawn if they go against the narrative. Any kind of paper that says masks work, lockdowns work, or any paper suggesting Covid is worse than any virus ever… it’s totally cool to share publicly. Doesn’t even matter if it is poorly constructed or turns out to be false.