Behold the softmax: https://docs.pytorch.org/docs/2.11/generated/torch.nn.CrossE... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		jmalicki 16 days ago \| parent \| context \| favorite \| on: Softmax, can you derive the Jacobian? And should y... Behold the softmax: https://docs.pytorch.org/docs/2.11/generated/torch.nn.CrossE...

canjobear 16 days ago [–]

Behold the actual definition of cross entropy: https://en.wikipedia.org/wiki/Cross-entropy

It's true that the PyTorch API conflates cross entropy and softmax, but they are separate concepts.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact