How to secure hidden Photos with only Face ID on iPhone?

when face id to access hidden photos is not recognised, the device automatically allows the user to input the phone password instead and gain access. is there any way to ensure only face id is used to access the folder and device password option doesn't pop up in case the user isn't recognised? for example, if someone who knows the device password tries to access the hidden section, they can do so even if their face id isn't registered - and i would like to disable that option.

[Re-Titled by Moderator]