It turns out unscaledDeltaTime isn't going to solve our problems all by itself. We need a way to pause the game (including the animation). In the end, a custom time scale is going to be required for this.
No download links available.