Pocket dial with face ID on locked phone.

I'm having problems with my iPhone XR. Face ID is on. Screen is locked. Phone is in my pocket. Even so my phone wants to do business on its own.

Random things it wants to do while I'm out walking:

-Skip to next song in Music.

-Take photos and/or videos of the inside of my pocket.

-Going into calendar, find random peoples birthdays and then face time them from there. (pretty advanced I have to say)

-Making calls to random people.

-Going into emergency lockdown - "wait a minute and try again later"

This is pretty ridiculous, my face is nowhere near my pocket (trust me I'm not that agile), why is my phone unlocking and doing things on its own without my face being present?

Facing the screen outwards in the pocket seems to reduce these actions somewhat.

Anyone have a proper solution to this? The whole thing with face-ID is to only allow your face to unlock the phone, no?!