Intermittent black screen on external monitor connected to M1 MacBook Pro originally only for some external HDMI adapters, now with all

Apple silicon M1 and the external monitor randomly goes black for a few seconds when connected through a USB-C to HDMI adapter.

On MacOS Ventura 13.1, it would only happen with adapters that did not support 4K at 60Hz. With the latest update to MacOS 13.2, it is not happening with all my 4K HDMI adapters. Before Ventura, all external HDMI adapters worked fine.

The built-in HDMI port does NOT seem to have this issue, but that forces me to have to plug multiple cables when I move my computer.