Is there a way to set your location for Siri without using WiFi?

I have a Mac mini at my desk connected to my network via Ethernet. Any time I use Siri on the Mac to get the weather it tells me it doesn't know where I am and wants me to turn on WiFi.

Is there some way around this? I want to leave my WiFi off on this computer.