Y
Hacker News
new
|
ask
|
show
|
jobs
by
sebzim4500
4 days ago
Presumably it drops back to 4.8 in those cases so it's not really worse
2 comments
bobbylarrybobby
4 days ago
If it switches mid conversation, this is a massive increase in token consumption because it has to re-read your conversation into cache, right?
link
tyre
4 days ago
yes. At the bottom of the release post it says that they are releasing two new features, one of which is customizing fallback behavior instead of blocking for restricted models
link