In this video we will see how to train a small LLM a base GPT2 with 117 Millions of parameters ina local computer and discuss somo of the challenges of training LLM,s from scratch and why nobody , except the big ones do it
Notebooks:
https://github.com/olonok69/LLM_Notebooks/tree/main/llms/training