Airpods Pro 2 Custom Transparency Mode Concern

I find the base transparency mode on my airpods pro 2s to be not quite the amount of passthrough I want, so I have the custom transparency mode enabled at 75% amplification, but every time I take them out of my ears and put them back in, it goes back to being quiet, and shuts the custom transparency mode off. This only started happening recently. Previously they would maintain the transparency mode

I've reset my airpods a few times and tried a bunch of different "solutions" I have seen on reddit, such as turning on background sounds but lowering the volume to 0, turning off adaptive audio etc. I only noticed this after getting the ios 18 beta a few months ago, and was hoping it would be fixed when ios 18 was released, but no such luck.

I don't think it's an issue with the actual airpods themselves, because when the custom transparency is enabled it works great and I have no issues, but only when I take them out and put them back in I have to toggle on custom transparency every time. I've seen lots of other posts about this on reddit so I know I am not the only one having this problem. If anyone has a fix for this it would be greatly appreciated, it's annoying to have to toggle custom mode on every time I put my airpods in. I fear if I was to replace them I would see the same problem, and be out another $330 CAD.