Back to Browse

5.9 EXAMPLE 2 : Context Vector of "python" in "Tech" Layer

6 views
Apr 10, 2026
8:57

Get this FREE COURSE @ 3aayaam - https://3aayaam.graphy.com/courses/GenAI-Foundation---Mathematics-of-Transformer-Architecture-69cbeba3893240d78444c9f3 In this course I will be explaining the pre-requisites for my course "GenAI Continuum". This course covers mathematical concepts, terminologies, jargons that are needed for deep understanding of GenAI (Foundation) Models. This course is divided into 4 sections as mentioned below: GenAI Prequel - AI, ML & GenAI; Type & Nature of data; Scalars & Vectors; Mathematical equations in AI Models. The Original ML Story - Model Training; Gradient Descent; Types of ML Models; Underfitting & Overfitting; Deep Neural Networks; Epoch, Batch etc. Arrival of Transformer - Transformer Architecture; Tokenization; Vector Embedding; Vocabulary; Self-Attention & Masked-Attention; Encoder & Decoder. Nerd Attack - Mathematics of Self-Attention & Masked-Attention. NOTE : This is an optional pre-requisite course for Application Development using GenAI. But I would recommend everyone to go through this if you want to understand the mathematics behind transformer architecture, which is the foundation of current GenAI models. Get this FREE COURSE @ 3aayaam - https://3aayaam.graphy.com/courses/GenAI-Foundation---Mathematics-of-Transformer-Architecture-69cbeba3893240d78444c9f3 In this course I will be explaining the pre-requisites for my course "GenAI Continuum". This course covers mathematical concepts, terminologies, jargons that are needed for deep understanding of GenAI (Foundation) Models. This course is divided into 4 sections as mentioned below: GenAI Prequel - AI, ML & GenAI; Type & Nature of data; Scalars & Vectors; Mathematical equations in AI Models. The Original ML Story - Model Training; Gradient Descent; Types of ML Models; Underfitting & Overfitting; Deep Neural Networks; Epoch, Batch etc. Arrival of Transformer - Transformer Architecture; Tokenization; Vector Embedding; Vocabulary; Self-Attention & Masked-Attention; Encoder & Decoder. Nerd Attack - Mathematics of Self-Attention & Masked-Attention. NOTE : This is an optional pre-requisite course for Application Development using GenAI. But I would recommend everyone to go through this if you want to understand the mathematics behind transformer architecture, which is the foundation of current GenAI models.

Download

1 formats

Video Formats

360pmp46.8 MB

Right-click 'Download' and select 'Save Link As' if the file opens in a new tab.

5.9 EXAMPLE 2 : Context Vector of "python" in "Tech" Layer | NatokHD