[valleyer]

Well, in part because the phenomenon has been discussed on Web forums that (a) have at this point made their way back into training data and (b) are accessible in Web searches that the model can invoke. And in part because the model can "know" what its initial instinct is and "decide" to go against it.

[jazzyjackson]

Still it’s like asking an image generator to produce an image without an elephant. Just tell it what you want.

[ninjalanternshk]

It’s like saying “make this bad animal drawing look better, and like someone else made it” without telling them what animal was supposed to be.

[ninjalanternshk]

Yeah this is about the worst way you could imagine to evaluate an AI model.

If you’d given it a real task you’d have been impressed.

I was floored by the day I spent with Fable. Got weeks of work done.

[valleyer]

Oh, I was also quite happy with Fable. I was just answering the question asked.

[cevn]

Same. It was one shotting unbelievably well compared to 4.8.

[jaapz]

And 4.8 on xhigh was/is already pretty impressive