Rethinking LLM Training through Information Geometry

This video explores the paper "Rethinking LLM Training through Information Geometry and Quantum Metrics" (https://arxiv.org/abs/2506.15830). We explore statistical manifolds and the fisher metric. We learn about how the fisher metric tell us how about the sensitivity of parameter changes during training. We finally look at quantum metrics.