Not sure if people are still experiencing this issue but I finally did another clean install. As of last week the XProtectRemediatorSheepSwap whilst running was killing my computer and was running all day to a point if my computer went to sleep it could not wake up without shutting down and getting the message 'Your computer shut down because of a problem' constantly. I did a clean install for the second time and for the last 3 days I have had no issues at all. The first time I did but this time I didn't. I am slowly but surely adding all my files back along with apps. In fact I don't even get the dreaded XProtectRemediatorSheepSwap coming up at all and I have been monitoring this with Activity Monitor open. I haven't completely put everything back on my computer but slowly but surely I am building everything back up. Is it annoying to do this yes because of the time it is taking but compared to what I was putting up with, it is definitely the better option.
So for those that are still having this issue I want to confirm everything I tried before I did the clean install to no avail.
macOS Ventura 13.6.4
Closed all apps so no apps were running - no difference
Booted in Safe Mode - No difference.
Logged in under another user - No difference.
Did a re-install - No difference
All apps were up to date - No difference.
Removed AVG anti-virus - No difference.
Toggled 'Install Security Responses and system files' off - No difference
Did PRAM/NVRAM/SCM - No difference
Tried going back to another Time Machine date - No difference
Tried to do a hardware diagnostics test - Couldn'tt do it which turned into another headache so left that one alone quick smart.
Did a clean install which didn't seem to work the first time but was desperate enough to try it a second time. As Luis Seequeira1 pointed out, doing a restore from backup brings issues back so decided to give it another crack. Voila, computer is running smoothly for the 5th day in a row.
So on that note, good luck with anybody trying all the methods I tried above before doing a clean install. For me everything simply was not working. Glad I tried the clean install again knowing the pain I was going to endure but it was worth it in the end 😉. If it starts to go pear shaped again I will be sure to post it here. Good luck everybody. 👍🏻