[bitwize]

There's a British comedy skit lurking in here.

"So it's a small large language model?"

"Oh yes, very small."

"How can it be small and large at the same time?"

"Well, it's small by the standards of a large language model."

"So it's large."

"Oh yes, very large."

"Large compared to what?"

"Small language models."

"And so something like ChatGPT, what would that be exactly? A large large language model?"

"Yes, precisely. An LLLM."

[janalsncm]

Standards have shifted as well. Gpt2 used to be considered “large” but it is half the size of this. Oh and also Sam Altman said it was too dangerous to release. At this point I consider anything too big to run on consumer grade hardware to be large, but an exact definition is a little silly to argue about.

[creshal]

"consumer grade hardware" is a rather loose definition too, what with RAM on consumer devices being anything between 2GB (low-end phones) and >100GB (high-end laptops/desktops) these days.

[a_wild_dandan]

Altman released GPT-2 despite expressing that doing so was a bad idea? That's wild.

[Alifatisk]

I think Altman meant it's too dangerous to open-source GPT-2, therefore locked it in behind a service.

[janalsncm]

It’s not locked behind a service though.

https://huggingface.co/openai-community/gpt2/blob/main/model...

[Alifatisk]

That’s only 124M param

[thatjoeoverthr]

Behold https://huggingface.co/openai-community/gpt2-xl

[_kb]

Australian. This is straight up Clarke and Dawe / Utopia.

[viraptor]

"Yes, a British Australian comedy sketch."

"So it's British?"

"By heritage."

"But Australian?"

"By production."

"Ah, so it’s satire."

"It was, until someone funded it."

[bitwize]

I must confess, I was inspired by "the front fell off".

[papichulo2023]

Do not mess with the Miniature giant space hamsters

[netdur]

it's big little planet or small big planet?