How can scammers know my location?

I just got this obvious phishing scam-

The thing is I did drive past that location a few days ago. It’s not somewhere I often go, and is quite a distance away. I am not on “social media”, I don’t have any chat apps, and do not advertise my location in any way, other than using Apple Maps for directions if it’s an unfamiliar location, and allowing wifi settings to stay on. How did this scammer know I had travelled past that location only a few days after I actually did? What exactly is going on here? This is making me paranoid.

[Edited by Moderator]