[CryptoBanker]

One of the biggest differences I noticed off the bat is llms includes prompt caching which I'm not sure I've seen in any other self hosted UI options

[asnyder]

I see Lobe and Chatbox both have prompt caching toggles, are you referring to something else?

[asnyder]

I've mistakenly given Chatbox a new feature, sorry :). In LobeChat, after you select a particular model, it enables a mini-settings menu next to the model that lets you set caching, deep thinking, and thinking token consumption.

[CryptoBanker]

Ah that must be new since the last time I tried lobechat

[CryptoBanker]

Where do you see that? I can't seem to find it in the web or desktop apps for lobechat.

EDIT: I also don't see it in Chatbox