Handoff going to last track played not the passed track

I have a HomePod and iPhone 11 with an Apple Music sub - when I try to handoff from the phone to the speaker, the speaker goes back to the last played track on the speaker, not the one on the phone. The phone then pops up a dialog saying multiple devices playing and invites me to upgrade to a family sub.

It’s very irritating and I’ve resorted AirPlay - any ideas?