Is there a way to pause the distance tracking on Apple Watch?

I like to use my series 8 watch for fitness tracking, but I'm on a riding lawn mower a lot at work. I always pause fitness tracking in the watch app under privacy so mowing doesn't mess with my step count (which is annoying, but I can live with it) BUT even with fitness tracking disabled, it still tracks distance. I'm pretty sure I didn't actually walk 7 miles in 4k steps lol. Anyway, is there a way to pause the distance tracking?

[Re-Titled by Moderator]