Exactly. It's entirely possible to implement fast wakeups, but it requires thoughtful design. Smartphone go to sleep opportunistically whenever you shutdown the screen. Even an Intel CPU could probably do this in less than 500ms (and that is a boatload of cycles).