Restricting individual HomePods available accessory access.

How do I restrict a HomePod from accessing all accessories in my home?

I have three HomePod minis in my BnB. Two of them are outside and in places where someone, not a guest, could command everything in the house. A bit freaky for the guests and could be dangerous. The exterior lights are only accessible via HomeKit.

I need the capability to restrict what accessories those two can access like the outside lights (two sets) and music only.

Suggestion to the HomePod team if they are looking for the next xx.xx.2 upgrade.

Thanks