Disable "Exchange Password Required" Notification

This notification constantly pops up because I have added a work email account to Mail. I can only access this account when signed into my work VPN. When I am not signed in to the VPN, I am endlessly asked for the Exchange sing-in credentials credentials. Now, those credentials are already saved in Internet Accounts, and when I am on the VPN, there is not a problem with the Exchange sign in. How do I stop Mail from repeatedly asking for these credentials when I am not on my work VPN.

The answers I have received about this have not been helpful. Things like "disable your notifications" or "sign into your work VPN" are obviously not what I am looking for. So without reducing the functionality of the OS, and without adding a bunch of extra clicks, how do I disable this notification?