Homepod 2 volume won't decrease all the way
I have a Homepod stereo pair in the living room with an Apple TV 4K (3rd Gen) but the volume won't decrease all the way with the remote. When we press the volume down button on the remote the volume bar appears and we can decrease the volume until the bar is empty but there's still very audible noise coming from the speakers.
What can we do to adjust this so that we have better control of the volume?
All devices are currently up to date (16.6).
Apple TV 4K