Machine Learning 33: Gradient Boosting - Introduction

We motivate gradient boosting through a couple of shortcomings of AdaBoost. We present the gradient boosting algorithm in the simplest case of regression with least squares loss. This includes a discussion about fitting residuals and introducing a learning rate.