Greetings goodtimes4us2,
Welcome to the Apple Support Communities!
From your question, it sounds like the audio on phone calls with your husband is coming out of the iPhone speaker, not the receiver. Do the both of you have iPhones or is he the only one with the iPhone? Is the sound coming from the speaker on your phone, his phone, or both?
If the sound is coming from the speaker on the iPhone and not the receiver, I would suggest making sure the speaker is turned off while on the call. This setting is on the display of your iPhone while actively on a call. The iPhone User Guide attached below has information on the different settings available while on a call, speaker being one of them (page 53).
https://manuals.info.apple.com/MANUALS/1000/MA1565/en_US/iphone_user_guide.pdf
If this is not the issue, please let me know more about the situation.
Cheers