While the concern is valid, caching is entirely optional at query level, therefore it is totally valid to cache only certain "filters".