AirPod unpairing with new firmware

AirPod Pro keep unpairing from my phone since update to 4E71. They just stop working and remove themselves from my Bluetooth device list. They are completely unusable like this. Sometimes I get 10 minutes and sometimes 10 seconds. My son's are also doing this.

It's not my phone because after this started I bought and set up a new phone. Does it with both phones. I did a factory reset on the AirPods (and removed them from Find My) and did a hard reset on my old phone. They are fully charged and I didn't change any settings for them.

My son's AirPods are having the same problem with his phone and mine.

Any ideas? I guess there's no way to go back to the old firmware?