Hacker News new | ask | show | jobs
by tripletao 1365 days ago
We're making some progress, at least. I believe this site rate-limits deep threads, but doesn't cut them off entirely.

So I guess we were also talking past each other on "Separate". By "simulated phylogenetic tree", I've always meant "phylogenetic tree for one of their simulated pandemics", not a tree for the real pandemic. We also agree that Pekar's argument isn't based on the time necessary for the two lineages to evolve in humans, since at least that much difference could arise even (with p ~ 10%) in a single human-to-human transmission.

So to exclude evolution of the two lineages in humans, they needed something else. Loosely, that's the observation that (stochasticity of spread aside) we'd expect the earlier lineage A to have more and more diverse descendants than the later lineage B. Their epi model in "Separate" is a formalization of that, and if they could correctly and confidently model that spread then I believe it would be sound.

It seems like we disagree as to what forms the paper's core result, though. I'm taking my own cue from Worobey's Twitter comments, because (a) he's an author, so he presumably should know better than most, and (b) while I disagree with his conclusion, I do see the flow of his argument. In the thread that you linked and I quoted, he describes the result of that "Separate" model--which fundamentally depends on the epi stuff--as the crux of the paper. That makes sense to me.

I believe you prefer to think in terms of construction of the phylogenetic tree for the real pandemic, like to frame the question of number of introductions in terms of the number of roots for the tree. That's in a certain sense equivalent, but it seems much less intuitive to me. The "Separate" approach makes the epidemiological assumptions explicit. Those assumptions are obviously always relevant though, so they're still relevant when you frame the problem in terms of the real tree; they're just much harder to express in the parameters (R0, serial interval, dispersion parameter k, etc.) typically used to model a pandemic.

When they built the real tree, they observed that any single root fits badly. (Per your other comment, I agree that's what they did in "Inferring" with BEAST.) More roots would fit better; but that's always true for any phylogeny unless there's a penalty for each additional root, since more roots improves all the other usual measures of fit. Without quantifying what that penalty per additional root should be, it's not possible to say whether the poor fit is because the tree really should have two roots, or for other reasons (unmodeled stochasticity of spread, imperfect sampling, etc.). It's not too easy to convert those pandemic parameters into that penalty. So it makes sense to me that they didn't try, and instead switched to the SIR-type simulations in "Separate", which they're treating as their most important result.

As I've noted earlier, I don't believe it's possible to reach any confident conclusion (as to research-related vs. natural origin, the number of introductions into humans, or most of the other topics of major contention) from the evidence currently available. I'd have little objection to this paper if it were framed as exploratory work, whose speculative conclusions should not be trusted without further verification. That's not how Worobey and others have portrayed it in the popular media, though, and also not how you've initially portrayed it here.

2 comments

I think it might be productive to dive in on this part

> Loosely, that's the observation that (stochasticity of spread aside) we'd expect the earlier lineage A to have more and more diverse descendants than the later lineage B. Their epi model in "Separate" is a formalization of that, and if they could correctly and confidently model that spread then I believe it would be sound.

Yeah, that's the observation. However, you're invoking the epi model at the wrong time. If you read `Inferring the MRCA...`, all of this is already known and observed before the modeling is even run. The epi model doesn't contain these results. They constructed their SC2 tree, then brought it over to the epi model to play with it.

If you want a "formalization" of that observation, perhaps Table I will do.

The results are best read in order.

If you're trying to better understand the phylodynamic model, perhaps "Inference of Viral Evolutionary Rates from Molecular Sequences" by Drummond would be interesting.

I think you're failing to appreciate the reason why they built the "Separate" model. Their headline claim is that SARS-CoV-2 arose from two zoonotic introductions into humans. If you want to express that claim in terms of the real pandemic's tree, then the relevant tree is the tree in humans only, which would then have two roots.

The construction of such a tree inherently depends on our assumptions on the epi dynamics. For example, if you give me a hundred genomes and I propose a hundred roots, then that wouldn't usually be a very good tree; but if the disease in question were known to spread animal-to-human but not human-to-human, then that might be correct. Nothing in their "Inferring" model allows them to incorporate such obviously relevant information, so that seems like an obvious deficiency.

To put it another way, you write:

> If you read `Inferring the MRCA...`, all of this is already known and observed before the modeling is even run.

After "Inferring", I believe they know the real tree has structure that's obviously non-modal (i.e., not the most likely outcome) given any single introduction. I don't see how they'd know whether it's a p = 20% non-modal or p = 0.5% non-modal outcome without an epi model like "Separate", or some kind of ugly incorporation of the epi dynamics into BEAST that they wisely didn't attempt.

I believe that's why the authors built "Separate", and its basic form is good work. (If you don't, then why do you think they spent their time on that?) I just disagree with their parameter choices and excessive confidence in their result.

As to your other reply, I agree the 10% is a rough number, not considering mutation biases and such. That's just the probability in a single transmission though, and it's also possible (and more likely) that the two lineages formed in humans with intermediate lineages that went extinct before they could be sampled. I think we at least agree that timing alone is insufficient to exclude evolution of the two lineages in humans though, even assuming a December introduction? I'm just trying to confirm that none of the evidence you see for two introductions in "Inferring" comes from its tMRCA.

ploink

Enjoy your sealioning.

Sorry; maybe I'm too stupid or lazy, but I genuinely don't get your point. Is it just that when they construct the tree in "Inferring", it looks qualitatively surprising (non-modal) given any single introduction, assuming (as I do as well) that A predates B? But we've known that for literally years now. As I understand the paper, their novel contribution is to quantify how surprising that looks, whether it's p ~ 20% surprising (which wouldn't mean much) or their claimed p ~ 0.5%. That's what they do in "Separate", and it correctly and inherently depends on the epidemiological modeling that I don't trust.

Again, in the Twitter thread that you yourself linked, Worobey says:

> This [the real polytomy structure] is something that [we] DO NOT see in ~99.5% of simulations. That is the crux of the paper.

The simulations in question are the epidemiological simulations from "Separate". You've told me to disregard Worobey's comments here; but while it's possible that Worobey has misunderstood the significance of his own paper, it seems more likely to me that you have.

> (with p ~ 10%) in a single human-to-human transmission.

That math is absolute garbage. One, the odds of a C/T -> T/C double mutation in a single transmission for the clade-defining markers isn't the same as T/C -> C/T, so at the very least you need to state an ancestral lineage to do any math like this. It also doesn't take into account the different priors for reversions, synonymous mutations, and the C-T transition bias in humans.

> When they built the real tree, they observed that any single root fits badly.

No. Go read the paper again. ("Our unconstrained rooting strongly favors a lineage B or C/C ancestral haplotype...") It's when you try and root in lineage A that things go sideways.

> I believe you prefer to think in terms of construction of the phylogenetic tree for the real pandemic, like to frame the question of number of introductions in terms of the number of roots for the tree.

> More roots would fit better; but that's always true for any phylogeny unless there's a penalty for each additional root,

No, it's not multiple roots, they just place the likely MRCA of SARS-CoV-2 in animals. ("If lineages A and B arose from separate introductions...") It's one tree. With one root. However, that root is in an animal instead of a human.

You can calculate the MRCA for any portion of the tree, including the descendents from the two+ hypothesized introductions. This MRCA is distinct from the SARS-CoV-2 MRCA. Is this what you mean by multiple roots?

> It seems like we disagree as to what forms the paper's core result, though. I'm taking my own cue from Worobey's Twitter comments

If you're trying to understand the paper's core result, read the paper, not twitter.

The first paragraph in `Discussion` frames the crux of their argument I was trying to get across. Notice that they cite the paradox I'm trying to get you to understand, as well as citing genomic diversity as core evidence, as opposed to any argument about the exact timing of A and B samples, or the unlikelihood of multiple mutations.