Hacker News new | ask | show | jobs
by jmalicki 43 days ago
Behold the softmax: https://docs.pytorch.org/docs/2.11/generated/torch.nn.CrossE...
1 comments

Behold the actual definition of cross entropy: https://en.wikipedia.org/wiki/Cross-entropy

It's true that the PyTorch API conflates cross entropy and softmax, but they are separate concepts.