Hacker News new | ask | show | jobs
by lelanthran 677 days ago
This is a nonsense test. There is no context, so the 'next' word after the single word 'The' is effectively random.

I'm pretty certain that LLMs are unable to work at all without context.

1 comments

They will "work", ie give a prediction, it's simply that it will have a pretty low probability of being the correct answer, which is a consequence of the highly limited context.

IMHO that doesn't make it nonsense, but maybe you are reading something different into the purpose of this test to what I am.