|
|
|
|
|
by OutOfHere
2 days ago
|
|
Like I said, the model quality is not a problem. They can trivially write professionally. Even a two year old model can. If they write poorly, it's because they are asked to appeal to the lowest common denominator of clickbait. |
|
The exact way in which the models are fucked up seems to depend on circumstances, but I think right now one thing I've noticed out of the latest versions of Claude Opus is that it really really likes to use the word "honest" in its summaries. "What Remains (The "Honest" Part)". I figured this was maybe something to do with it just repeating the system prompts but no. It turns out the word "honest" does appear in some fragments of system prompts in Cluade Code, but it doesn't appear to be anywhere where it would've been in the context of my recent runs.
I think this is a tuning issue and that eventually, someone will figure out a good way to prevent models from getting skewed this way.
Still, the bad prose quality is not really the biggest issue. In fact, it's kind of handy that the prose quality is shit because it makes it easier to tell when someone just doesn't seem to care about what they're writing. If the prose quality was really good, yet the amount of effort put in was the same, we would be having an even worse problem right now.