Learn about the Gradient Descent algorithm for the example of Linear Regression, its parameter initialization, update rule, derivation and introduction to Batch Gradient Descent, Stochastic Gradient Descent and Mini-Batch Gradient Descent optimization.