Entropy in Data Science
Marton Trencseni - Sun 24 October 2021 • Tagged with entropy
I discuss 4 uses of entropy in Data Science: (i) cross entropy as a loss function for training neural network classifiers (ii) entropy as a splitting criterion for building decision trees (iii) entropy for evaluating clustering algorithms (iv) entropy for understanding relationships in tabular data. 
















