Hacker News new | ask | show | jobs
by fc417fc802 7 days ago
> whether a transformer of sufficient scale is feasible on current hardware

Just because a particular approach (such as a neural network or transformer) can approximate something doesn't necessarily mean it can do so efficiently. However I share what I infer to be your suspicion that executive function can in fact be easily modeled. I think it's likely to develop on its own depending on the training methodology used.