Without knowing a lot more about the details we can't give full advice. However, the most frequent cause for problems like this is two humans sharing a single Apple ID, and as far as their devices know they are the same person just using two different phones. This is almost always due to a well meaning but misguided attempt to share data like photos, or simply that one user has upgraded and passed their old device to their partner without a full reset.
The correct methods for Apple ID are either:
Each human has their own unique standalone Apple ID, which can be shared between all the devices that single human owns
-or-
Use Family Sharing if it is desired to share data automatically between family members.
Set up Family Sharing - Apple Support
Unfortunately if the problem is multiple users on a single ID, it is likely one of you would need to completely erase their iPhone and start by setting up again from scratch with a new Apple ID
There is another less common and less friendly possibility which might be suggested by your post, that you each already have your own Apple ID but your husband knows the login credentials for your ID. In that case (if you consider it safe to do so) you could consider simply changing the password for your Apple ID.
Change your Apple ID password - Apple Support