[butwhywhyoh]

But you just said "no degradation".

[naillo]

Try it yourself ;) I haven't spotted any but I can't dispute the parents observations.

[mkaic]

My best guess is that I just did something wrong lol. Autocast seems to convert most of the model to fp16 anyways and that works great, so I'll just keep using that!