Incoming call screen freezes sometimes

I am running the latest iOS 17.3.1 on my iPhone 15 plus. When the phone is in pocket and a call is received, the entire screen freezes, even the face id doesn’t work. Only thing that can be done is to double press the power button to turn off the screen (that also hangs up the call) and turn it back on.

It feels like the pocket touch prevention doesn’t reset after I get it out of the pocket. Anyone else have faced the same issue?