" The reason LLM seems to have stalled a bit is because there just not enough compute."
lol okay mate.
There is literally not enough compute dude. If we had infinite compute we would see everyone building Mythos size models.
"Right.. and computers were once the size of a large room vs now fit into a pocket."
Yeah because we offload much of the compute to off device. You think we would have these small computers in our pockets if the internet didn't exist?
and yet now we have far bigger rooms with far bigger computers anyway
Hardware may improve exponentially, but demand for compute increases double-exponentially. we'll always need more, bigger computers
There is literally not enough compute dude. If we had infinite compute we would see everyone building Mythos size models.
"Right.. and computers were once the size of a large room vs now fit into a pocket."
Yeah because we offload much of the compute to off device. You think we would have these small computers in our pockets if the internet didn't exist?