Knowledge Distillation in Deep Learning - Basics

Here I try to explain the basic idea behind Knowledge distillation and how the technique helps in compressing large deep learning models. Part 2 : https://youtu.be/rNOuDKWtrAE