Loacte Cellular Apple Watch without LTE activated?

So this is something that I didn't think about until I was having a discussion with my friend. But I wanted to know if it is possible to locate your GPS & Cellular capable Apple Watch for Find My even if you haven't activated LTE on your Apple Watch yet. Currently I use it with my phone being paired to it. But lets say it gets lost or stolen and its nowhere near my phone, would it be possible to locate?

I know you are able to locate it with LTE active but, I was curious to know to opposite. I looked on forums and people are constantly comparing the non-LTE model to the LTE model and are always assuming you have it activated and or connected to Wi-Fi.