Hacker News new | ask | show | jobs
by journal 173 days ago
You only need that info if you know you need it in your rag. Over the last two years of usage I don't recall where I'd need those timestamps but I know there are cases. Still, this would have to be an option because otherwise it would be waste of tokens. However, we have to consider they are competing for the quality AND length of the response even if a shorter response is better. There's a pretzel of considerations when talking about this.
2 comments

Timestamps are conversation metadata and don't need to be fed to the LLM and require tokens.
Imagine you started having back pain months ago and you remember asking ChatGPT questions when it first started.

Now you’re going to the doctor and you forgot exactly when the pain started. You remember that you asked ChatGPT about the pain the day it started.

So you look for the chat, and discover there are no dates. It feels like such an obvious thing that’s missing.

Let’s not over complicate things. There aren’t that many considerations. It’s just a date. It doesn’t need to be stuffed into the context of the chat. Not sure why quality or length of chat would need to be affected?

This was me yesterday, verbatim