AI setups require quite a sophisticated data centre with a network that will not become a bottleneck.
This video is a high-level overview of why network architecture is such an important part of a modern AI-focused datacenters. I'll review NVLink and UALink, InfiniBand, RoCE, and an overall approach to building a network, depending on your scale and budget.
00:00 - Intro
00:29 - Why network is a big deal
02:14 - NVLink
07:38 - UALink
09:19 - InfiniBand
11:26 - NVidia Infiniband switches
12:22 - RoCE
14:52 - UltraEthernet
15:10 - Infiniband vs RoCE
16:27 - Storage and Management networks
17:04 - AI datacenter network designs
18:30 - Outro
