[xcodevn]

For context, the author is Steven Johnson, one of the key people behind Google's latest hit, NotebookLM.

For those who are curious, how can we technically support really long context window (like in the millions or even billions)? The short answer is simple: we can just use more GPUs. The long answer is detailed in my recent note here: https://neuralblog.github.io/scaling-up-self-attention-infer...

[r_klancer]

I'd rephrase that as "the author is the author, Stephen Johnson, who is also one of the key people..."

I've read many of his books over the last 20 some years (and even watched a PBS documentary series he hosted). I was aware via his Substack that he was collaborating somehow with the NotebookLM team. But I was rather startled when he demoed NotebookLM at a Google all hands meeting a few weeks ago! Apparently he's a full time product manager now.

[xcodevn]

He plays an essential role as the model for NotebookLM. As Raiza Martin, the PM for NotebookLM, mentioned on a recent podcast, Steven is the product. The NotebookLM team essentially emulated his workflow, how he conducts research and compiles information on a particular topic.