Glossary › Cross-Entropy Loss
Cross-Entropy Loss
The standard loss function for classification. For binary classification: -[y·log(p) + (1-y)·log(1-p)]. For multi-class: -Σ y_i·log(p_i). Penalizes confident wrong predictions much more than uncertain wrong predictions, which drives the model to be well-calibrated.