I got this when I wanted to change an invited event from a gmail event to an icloud event.
I found that it went away by opening up my gmail account in a web browser and manually deleting the event from there.
I have now set my default calender as an icloud event.
The google interaction with ical has never been that clever. I now do not use google calender at all.