[lwhi]

What do you think context is, if not 'attention'?

[chickensong]

You can create a context that includes info and instructions, but the agent may not pay attention to everything in the context, even if context usage is low.

[3371]

IMO "Attention" is an abstraction over the result of prompt engineering, the chain reaction of input converging the output (both "thinking" and response).

[XenophileJKO]

Context is the information you give the model, attention is what parts it focuses on.

And this is finite in capacity and emergent from the architecture.

[lwhi]

So attention is based on a smaller subset of context?