Save your energy, been there, done that. To ALL that's having this problem, here's what I've already done with my 16" 2019 MacBook Pro to troubleshoot/resolve this issue:
1.) Checked Disk Drive via Disk Utility First Aid (from Recovery Partition)
2.) Reinstalled macOS from Recovery Partition
3.) Worked with Apple 1st-line support, ran hardware diagnostics (all components pass)
4.) Reset SMC and PRAM/NVRAM
5.) Total erase of drive and re-install of macOS. Recovered data from backup and manually re-installed my Apps
6.) Upgraded macOS 10.15.4 With Supplemental Update released within last 24 hours
I did these things, in the order listed, and still the idle-screensaver-reboot issue reoccured. My conclusion - This problem is rooted in the bowels of the 10.15.4 update. It is NOT triggered by any single App or hardware component (ex. I use a 4K and 5K LG Monitors connected to MacBook, along with 2 external 2T disk drives for storage and backup).
On phone now with Apple Senior Tech Advisor. WIll update this post with results.