Transformers Neural Network explained and implemented using PyTorch.
Code Repository: https://github.com/tgautam03/Transformers
References:
The blog post by Peter Bloem (https://peterbloem.nl/blog/transformers) is where I started and is one of the best resources for learning about Transformers out there.
Music Credits: Moonlight by Kris Keypovsky (https://freemusicarchive.org/music/kris-keypovsky/single/moonlight/)
00:00 - Introduction
00:26 - Overview
01:09 - Data Preprocessing
02:30 - Word2Vec
03:31 - Self Attention
04:50 - Positional Embedding
05:25 - Bringing ML to Self Attention (Query Key Value)
07:50 - Multi-Head Attention
08:53 - Coding Self Attention
09:50 - Coding Transformer NN
10:15 - Training Transformer NN
10:30 - Conclusion
#transformers #neuralnetworks #naturallanguageprocessing #chatgpt #deeplearning #machinelearning #attention
