Mac mini: Auto display detection HDMI/DP at startup

Switching between HDMI and Displayport before log-on.

I have a Mac mini M4. Main display is on Displayport (Via USB/Thunderbolt)

I also have it plugged into my TV via HDMI. Currently the HDMI goes via a switch cable, as I do not want the TV switching on automatically every time I start the Mac. The switch is a two port device, one leading to the TV, the other left empty.

I mostly use my main display (Displayport) but sometimes want to use the TV as a display. I do not want to mirror or extend either of them.

I want to be able to start the Mac (usual keyboard press to wake it up), and if it detects the TV, then switch on the TV and use that as the monitor. If it does not detect the TV, I want it to detect and use my usual monitor.

The HDMI switch has a physical (logic) button to toggle between the two outputs, and when I am using my normal monitor I keep it switched to the empty output, so there is nothing to detect. When I want to use the TV I will push the button on the HDMI switch to set it to the TV output.

I know I can switch on my normal monitor, go through the screen choices etc, but I wish to avoid this as it is not only tedious, I would still need to toggle the HDMI switch anyway.