500 error while adding Google account to iPhone Contact

I reset my iPhone 15 pro recently and I have been trying to add a Google account to my iPhone Contacts (I usually store my contacts in Google). Each time I go through the auth flow, I get a 500 error from Google saying "There was an error...". Tried adding contact manually via iCloud with vcard from Google, but that does not work too.

Google support says they don't see any issue with the account nor anything wrong with the service. Any suggestions?