HomePods randomly decide where they want to play

We currently have two Apple TV's 4K and six HomePod mini's. Two HomePods are in separate bedrooms, one in basement office, another in living room (with Apple TV 4K), and two in TV room (with another Apple TV 4K).

If I am in a particular room, such as at my desk in the basement (no other HomePods around) and ask it to play music, it arbitrarily decides to play throughout the entire house. I have to use my phone to turn off the other HomePods or just tell it to stop.

I can ask a HomePod in either bedroom, living room, or TV Room to play music and it will also play throughout entire house. I can sometimes tell it to play to play in XYZ room only and sometimes it will only play in that room. It seems to be very random.

If watching TV and using HomePods for stereo audio (in TV room), it will randomly decide to play to all home pods in the house. The only option is to revert back to TV speakers or go into setting to uncheck each HomePod.

I have also turned off hand-off in my phone. Has anyone found a proper solution? Apple's support suggestion was have you tried to unplug your devices. SMH!