Face ID unlocking issues

When I first started using my iPhone X, Face ID worked surprisingly well and I did not have any issues with unlocking my phone using it. However lately when I pick up my iPhone and swipe up, the padlock icon will show as unlocked and the screen will appear as though it is unlocking but will hang up and not unlock and I have to swipe up several times even though the padlock is showing the phone as unlocked and I swiped up far enough that the home screen should appear. As I said I did not have this issue when I first bought the iPhone X and this is the only issue I’ve had but it seems to get worse the more time has gone by. Anyone else have this issue? I do have Attention Aware enabled if that has any effect which I don’t think it should.