[joennlae]

Trainable Llama-like transformer (with backpropagation) in numpy only (~600 lines)

https://github.com/joennlae/tensorli

[Zambyte]

The description says GPT-like, but is is just a GPT, right?

[p1esk]

GPT refers to the specific family of models developed at OpenAI.

[Zambyte]

It also stands for generative pretrained transformer, which this seems to be.

[p1esk]

It’s like saying SSD is a YOLO. Both are single shot object detectors, but only YOLO is “a YOLO”.