[refulgentis]

Can control vectors replace RAG?

i.e. if I want the model to give me a summary of the news today, and the model was trained before today, can control vectors help?

[p1esk]

No technique can get you the news other than actually searching for and then parsing the published news.

[refulgentis]

Can a control vector replace system prompts?

i.e. can it do in-context learning without the context?

[jncfhnb]

It more or less is the same as a system prompt

[refulgentis]

So, no

[jncfhnb]

So, yes, but not in a meaningfully different form