This module discusses decision trees, which are tools that support decision-making and rely on a tree structure. Decision trees provide a sort of flowchart, where you begin at the root, and answer question that correspond to internal nodes, leading you through the tree until you reach leaf nodes, which provide decisions. The leaves often provide numerical decisions, in which case decision trees can perform regression; classification is also possible. We can design decision trees with an MDL-style approach where we prefer not to have too many nodes while still working well on training data.
