In this video we present classification trees, a popular technique for classification that can model complex, nonlinear patterns. We explain how to build classification trees that fit a dataset and explain why this approach results in a discriminative classifier, discussing a connection with the concept of entropy.
Probability and statistics book: https://a.co/d/7k259eb
Website with free preprint, videos, slides and solutions to exercises: https://www.ps4ds.net
Slides for this video: https://github.com/cfgranda/ps4ds/blob/main/slides/regression%20and%20classification/classification_trees_handout.pdf
Code: https://github.com/cfgranda/ps4ds/blob/main/regression_classification/wheat_classification_tree.ipynb
https://github.com/cfgranda/ps4ds/blob/main/regression_classification/classification_tree_loglikelihood.ipynb