I had this problem too after upgrading to Ventura and it was driving me ABSOLUTELY INSANE!!!
But I found a fix...
I had searched and saw that others had this problem with older MacOS versions, and it seemed to be related to having multiple iCloud email accounts in your user account. I had an old xxx@me.com email account that I didn't really use any more but was tied into my main iCloud account so I deleted that old email account and the problem went away. I had also noticed that other user accounts that I have on my iMac Pro didn't have this issue, and they didn't have the old xxx@me.com as one of the email accounts either.
As I mentioned, others seemed to have this issue with older MacOS versions, but I didn't have it until I installed Ventura, but it seems just fine now.
This old account did not seem to cause any issues with my iOS devices (i.e. iPhone and iPad)