You can try resetting HomePod,
the 5 second count (done twice) as instructed below is very important
Reset HomePod:

Press the top of HomePod to reset it
If you can’t remove HomePod from the Home app, you can press the top of HomePod to reset it to its factory settings. Here’s how:
- Unplug HomePod, wait 5 seconds, then plug it back in.
- Wait 5 seconds, then touch your finger to the top of HomePod and hold it there.
- The white spinning light will turn red. Keep your finger down.
- Siri will say that your HomePod is about to reset. When you hear three beeps, you can lift your finger.
If you still see HomePod in the Home app after you reset it, then you'll need to manually remove it from the Home app.