Mac Mini won't recognize my 4K monitor in HDMI port

I just got a 2020 Mac Mini, I have two Samsung 4K UR55 monitors. The first couple weeks I had my Mac the monitors were working fine. I was using the built in HDMI port for one Monitor and an HDMI to USB-C adapter for the other monitor. But now when I try and connect the monitors to the HDMI port the Mac will not recognize the display. I've tried changing the HDMI cable and I've tried both monitors in the port. Both monitors work in the USB-C adapter so it's definitely an issue with the HDMI port. I've checked other TVs and the HDMI port works fine on other monitors, its only these two Samsung 4K monitors it wont connect to. I've tried resetting NVRAM and SMC. I've tried the "Detect Displays" setting in Preferences. I cannot find a solution. Any ideas?