AirPods Pro 2 case green light and sound

My AirPods Pro 2nd gen case makes a continuous beeping sound for about 10-15 seconds along with a flashing green light every time I pick them up or the table they're on moves. This is very annoying because it happens to me even when I'm out. Does anyone know how to turn it off? The AirPods aren't connected to the "Find My" app, and the option to turn off the case is grayed out and can't be turned off.

Thank you so much.