Conversation becomes gargled and robotic when I am on walk, always in the same locations?

I am using Airpod Pro 2nd Generation, SW version - 6A321

I will be on a call or listening to music/podcast and every time I get within a certain distance of someone's home or apartment - my call will become gargled and neither myself nor the person I am on the call with will be able to understand what the other person said for a period of about 3-5 seconds. Same happens with music/podcast, where the sound will just stop playing through the headphones for about 3-5 seconds as if the song was paused, but then you realize that the song kept playing in the background, though it could not be heard through the headphones!

This happens e v e r y t i m e I walk by these buildings when walking my dog and it is the most frustrating thing to have to rewind/ask the person to repeat themselves bc I have faulty headphones... but these are not faulty headphones, as a matter of fact, these are kinda the best/most useful hands free tools I have had a chance to use on a daily basis!!

Could this be due to my Airpods linking up with other Apple devices in those homes/apartments to log the "find my Airpods" data??

I have tried disabling "find my Airpods" to see if this would fix the interruptions, but no luck so far... does anyone have a fix for this??