If going against a datasource (like with Retrieval Augmented Generation), yes.
If the information is just part of the context window, no.