Documenting these video comparisons for posterity. Each level of Athlete increases underwater movement speed by 6.25% for all directions of Caveman and Dolphin swimming (though the water dash is unaffected).
Additional video comparisons were done for each direction of swimming for 3 levels of Athlete on both the Caveman and the Dolphin, but I only included the relevant ones here.