Homepod Mini delay, Sync with M1 Mac mini

My new Homepod Mini works fine with iPad, iPhone. But it has two seconds delay (syncs correctly) when I pause and play from MacBook pro- which is not the experience I expect after spending this much money.

When I connect to my new M1 mac mini, it has the same two-second delay as well as has a two-three-second delay in the audio SYNC. I had to restart my Mac mini every time I wake from sleep to avoid this SYNC delay, which is really inconvenient. What is wrong with the Mac OS or Homepod Mini?