[dron57]

That's cool, but Mish is an activation function while SGD and AdamW are optimizers. Apples and oranges.