M1 Mac Mini, Displays wont turn on after wake from sleep

Disable Sleep, it’s unnecessary on later Macs, all pain, no gain. To disable, set your Energy Saver settings to as shown: 

Separately, avoid manual sleep, use screen lock instead or let the display switch off/auto-lock on timer. For long or overnight absences, shut.