Remove/De-authorize users from using "Approve with Apple Device" notifications

Hi, I appreciate the recent AppleTV updates to include the "Approve with Apple Device" for ease of access. However, I realize that other family members can also approve app installations and purchases without my consent. How can I remove/de-authorize users from using this feature? Is it in my family settings somewhere? Or is there a way to turn it off? Thanks!