Calendar - Receiving Invite Notifications and Accept / Decline Prompts for Shared Calendars

We are using G Suite in the company and have our personal calendars shared between people to view availability. We have our Google accounts added to MacOS.

Whenever I've been invited to an event, my colleagues that I've shared my calendar with (view only), also receive the notification and can Accept / Decline the invitation on my behalf. Is there a setting to overcome this inconvenience?

Thanks,

Boris