References:
SimCLR Google presentation: https://docs.google.com/presentation/d/1ccddJFD_j3p3h0TCqSV9ajSi2y1yOfh0-lJoK29ircs/edit#slide=id.g88de1f3f96_5_797
Amit Chaudhary tutorial: https://amitness.com/2020/03/illustrated-simclr/
SimCLR paper: https://arxiv.org/abs/2002.05709?ref=hackernoon.com
Pytorch Lighting Code: https://github.com/PyTorchLightning/pytorch-lightning-bolts/blob/master/pl_bolts/models/self_supervised/simclr/simclr_module.py
LARS: https://paperswithcode.com/method/lars
Cosine similarity: https://en.wikipedia.org/wiki/Cosine_similarity
Outline:
Intro: (0:00)
Amit tutorial: (04:46)
Google slides: (18:55)
SimCLR paper: (30: 20)
SimCLR code: (38:50)
Outro: (45:30)