Camera Mode Preserve Setting Broken

I was changing the camera settings on my iPhone 13. In Settings>Camera>Preserve Settings I enabled Camera Mode (Preserve the last mode, such as Video, rather than automatically reset to Photo.). But I don't like that feature and I would like to turn it off, but when I turn it off it's still enabled in my camera.

I tried restarting my phone and updating it to the newest version (17.5.1), but nothing.

I also tried to change some other settings like Mirror Front Camera, and Grid and those settings apply immediately, but this one is still enabled whatever I do.

Can I somehow fix it without restarting all my phone settings?