It's called TinyToT: https://github.com/guilt/TinyToT
You basically get a LLM without any training/RL here.
See: https://x.com/i/status/2076344798525460581