Parallel Routines

1.13K subscribers

27 videos

View on YouTube

“Parallel Routines exists to make the hidden world of GPUs and computing feel simple and exciting. I break down complex architecture, scheduling, memory syst...

Latest Videos

Recent Developments in AI (2024–2026)

Recent Developments in AI (2024–2026)

Parallel Routines

240 views·4 weeks ago

GPU Partitioning Explained MIG vs Virtual Compute Server

GPU Partitioning Explained MIG vs Virtual Compute Server

Parallel Routines

694 views·2 months ago

Why GPU Programming Feels Hard The Cost of Moving Data

Why GPU Programming Feels Hard The Cost of Moving Data

Parallel Routines

575 views·2 months ago

GPU Programming Model Explained Architecture, Compilation, and Thread Hierarchy M2L5

GPU Programming Model Explained Architecture, Compilation, and Thread Hierarchy M2L5

Parallel Routines

1.5K views·2 months ago

GPU Warp Divergence Explained Why Branches Kill Parallelism (Visual Deep Dive) M2L4

GPU Warp Divergence Explained Why Branches Kill Parallelism (Visual Deep Dive) M2L4

Parallel Routines

895 views·2 months ago

GPU Warps Explained How SIMT Really Works Under the Hood (Visual Deep Dive) M2L3

GPU Warps Explained How SIMT Really Works Under the Hood (Visual Deep Dive) M2L3

Parallel Routines

1.5K views·2 months ago

GPU Memory Hierarchy Explained Registers, Shared Memory, L2, HBM, and PCIe (Visual) M2L2

GPU Memory Hierarchy Explained Registers, Shared Memory, L2, HBM, and PCIe (Visual) M2L2

Parallel Routines

1.4K views·4 months ago

Persistent Kernels – Dynamic GPU Work Distribution Explained

Persistent Kernels – Dynamic GPU Work Distribution Explained

Parallel Routines

766 views·4 months ago

GPU Architecture Deep Dive From HBM to Tensor Cores (Visually Explained) M2L1

GPU Architecture Deep Dive From HBM to Tensor Cores (Visually Explained) M2L1

Parallel Routines

3.3K views·4 months ago

Why GPU Shared Memory Becomes Slow Bank Conflicts Explained Visually

Why GPU Shared Memory Becomes Slow Bank Conflicts Explained Visually

Parallel Routines

1.3K views·4 months ago

Amdahl’s Law Explained Visually Why Parallel Programs Hit a Hard Speedup Limit M1L3

Amdahl’s Law Explained Visually Why Parallel Programs Hit a Hard Speedup Limit M1L3

Parallel Routines

643 views·4 months ago

The Highway Analogy Why GPUs Need 40× More Memory Bandwidth Than CPUs M1L2.3

The Highway Analogy Why GPUs Need 40× More Memory Bandwidth Than CPUs M1L2.3

Parallel Routines

399 views·5 months ago

The Factory Analogy How GPUs Beat CPUs Through Sheer Parallel Workforce Power M1L2.2

The Factory Analogy How GPUs Beat CPUs Through Sheer Parallel Workforce Power M1L2.2

Parallel Routines

188 views·5 months ago

CPU vs GPU Silicon Layout Why Their Floorplans Reveal Two Opposing Compute Philosophies M1L2.1

CPU vs GPU Silicon Layout Why Their Floorplans Reveal Two Opposing Compute Philosophies M1L2.1

Parallel Routines

355 views·5 months ago

GPU Acceleration Explained How Parallel Processing Transforms a Simple Photo Filter M1L1.3

GPU Acceleration Explained How Parallel Processing Transforms a Simple Photo Filter M1L1.3

Parallel Routines

344 views·5 months ago

Latency vs. Throughput The Real Reason CPUs and GPUs Behave So Differently M1L1.2

Latency vs. Throughput The Real Reason CPUs and GPUs Behave So Differently M1L1.2

Parallel Routines

375 views·5 months ago

Why GPUs Took Over The Fall of CPU Speed & the Rise of Parallel Computing M1L1.1

Why GPUs Took Over The Fall of CPU Speed & the Rise of Parallel Computing M1L1.1

Parallel Routines

417 views·5 months ago

GPU Memory Coalescing Explained Warp-Level Optimization, Alignment Rules, and Cache Behavior

GPU Memory Coalescing Explained Warp-Level Optimization, Alignment Rules, and Cache Behavior

Parallel Routines

1.4K views·5 months ago

Optimized Reduction Kernel Explained CUDA Warp and Block Reduction

Optimized Reduction Kernel Explained CUDA Warp and Block Reduction

Parallel Routines

477 views·6 months ago

How GPU Reduction Kernels Work Threads, Blocks & Shared Memory Simplified

How GPU Reduction Kernels Work Threads, Blocks & Shared Memory Simplified

Parallel Routines

1.7K views·6 months ago

CUDA Simple Counter Visualizing the Execution Flow in a GPU

CUDA Simple Counter Visualizing the Execution Flow in a GPU

Parallel Routines

811 views·7 months ago

Parallel Routines - Channel Intro

Parallel Routines - Channel Intro

Parallel Routines

139 views·7 months ago

Parallel Routines - NatokHD | NatokHD