MDM Profile Nightmare

We used to use Meraki for MDM and the company phones came in the door through DEP, so the Meraki stuff was already primed to install when you opened the box.

Our company has been acquired. The new company uses Microsoft conditional access, which doesn't get along with the Meraki MDM. We're removed the phones from the Meraki console and from the DEP (now through Business Manager). If we take a phone that the Meraki stuff on it, reset it and set it up as a new phone, the MDM profile doesn't come back. However, if we reset a phone and restore from a backup on the way back up, the Meraki MDM profile is still there (still keeping us from installing conditional access). The MDM profile doesn't have a "remove" button.

My user community isn't too excited about losing all of their data as part of embracing the new company, so wipe without a restore isn't my first choice.

Suggestions?

Thanks!