[Conscat]

At Nvidia, we have no limit for Anthropic or Open AI models (for now) and are heavily encouraged to use them as much as possible.

[mindv0rtex]

The fact that they've started promoting using the Caveman mode tells me that the unlimited usage policy is taking its toll.

[Conscat]

Fwiw, nobody has ever suggested to me that I employ token compression in my daily workflow. I don't pay full attention in all the AI workflow demos I'm supposed to attend, but I don't recall that even being discussed. Is this an Nvidia blog or tweet you're referencing? I'm actually interested to see what they have to say.

[andruby]

What is Caveman mode?

[soupspaces]

https://news.ycombinator.com/item?id=47639077

[checker659]

Please don’t tell me you’re writing RTL

[Conscat]

I'm not, I work higher level products. I've talked to a few people who do but I don't recall if they have different standards.