Air Pods in use by other device

During the day I use my Air Pods on my work phone and every time I open my personal phone (iPhone 15 Pro) a notification pops up at the top of the screen that says, "Air Pods in use by other device", and you cannot dismiss the notification, you must wait for it to dismiss itself. It is really annoying because it blocks the top of the screen where there is information I need and I cannot swipe down to open the control center until the notification dismisses itself. Is there any way to turn off this ridiculous notification setting?