Hacker News new | ask | show | jobs
by fl7305 1140 days ago
If GPT-4 has 10 terabytes (10^13) of stored memories, how long are the sentences it has stored if there are 100 (10^2) different words to choose from?

Wouldn't that be a table of sentences less than 7 words long?

100^7 = (10^2)^7 = 10^14