I want to stop seeing contact suggestion in Air Drop

I live in a condo, so there are neighbors within 10-20 feet of me often but I'm not in the same room as them. However, my phone suggests them in AirDrop. (They are in my contacts.) I have turned off AirDrop receiving, but I can't figure out how to turn it off completely or just not have them always pop up in suggestions. I don't want to accidentally tap and send them something random. I'd also prefer not to tell them to turn off receiving, since "my neighbor might accidentally send me something" doesn't seem like a good reason for them to change how they use their phones.

Is there a way to turn my AirDrop off completely or tell my phone to not show those specific people in the suggestions when I start to share a link or picture?