Cannot Complete HomePod Setup

So, I have a HomePod Mini that I have set up just fine on my Wi-Fi, but the HomePod I just purchased does not. I was issued a replacement HomePod thinking maybe it was an internal issue which I just received today and am getting the same issue. I have an iPhone and 2 Apple TVs along with the HomePod mini and they all connect just fine. Is there something I'm missing? I tried to troubleshoot on the original HomePod I had, making sure I was on a 2.4Ghz network and removing all autojoin networks, my wifi does not have IPv6 enabled anyway so I didn't need to disable it, I "forgot" my wifi network then restarted my phone then factory reset the HomePod and reconnected to my wifi and it still says "Cannot connect to wifi". I would really like to keep the HomePod, but it's a very expensive paperweight right now. Any help is much appreciated. Thanks.