[ottaborra]

My predictions:

1. state-space models make transformer based models obsolete

2. Cuda killer gets set loose by AMD

3. The world's first successful head transplant takes place

4. Children of Dune gets greenlit

5. Lex Friedman retires from interviewing

[p-e-w]

There's no such thing as a "head transplant". The person receiving the transplant is the one whose head it is. The transplant they receive is the rest of the body. Therefore, "full body transplant" is a more accurate term.

[RugnirViking]

Respectfully, I don't think you or anyone else alive right now actually knows how this would go down. The amount of interactions between organs, central nervous system, endocrine system, and brain means I'm not sure anybody involved would remain "them"

[solomatov]

> state-space models make transformer based models obsolete

We will see whether they work on a large scale pretty soon. I hope they will, but they might not be. There're models which might outperform more advanced models on the smaller scale, and I haven't heard how Mamba performs on GPT scale.

[runjake]

Which Lex? Friedman or Fridman? They both do podcasts and interviews.

[nebula8804]

Why do you think Lex will retire? Did he indicate something?

[bilsbie]

State space?

[nextos]

See https://srush.github.io/annotated-s4.

I also think state-space models will make a comeback.