How to disable contact location in Apple Maps

This has been driving me insane since a recent update. Say I have a contact named John and I want to navigate to his home address. I open up Maps, and start typing John. After the update, it shows me the contact, but it says "Location Just Now and 2 Other Addresses". The vast majority of the time, I'm looking to navigate to that person's home address, not their live location. However, when you click on their contact, it will say "Refreshing Location" which can take some time. I do not want to stop seeing that person's location, I just don't want to have to refresh their live location to navigate to their home. Surely this is an oversight from the dev or feature team, it's incredibly frustrating.

iOS 17.1.2

#Maps #AppleMaps