apple watch won't stay in Watch Face, workout keeps opening

this has caused me to stop using the Workout App.

a) I start a Workout

b) go back to Watch Face

c) 3 minutes later the watch goes back to displaying Workout App, by itself.

d) I push the crown and it goes to Watch Face, 3 minutes later Workout opens again

I DO NOT WANT TO LOOK AT THE WORKOUT APP ALL THE TIME. I WANT TO SEE THE WATCH FACE, BECAUSE, YOU KNOW, IT'S A WATCH.

I have have looked everywhere for a way to stop this in Settings. This might be what some people want, by why am I being forced to see I've walked another 0.2 miles since last time I looked at the Watch, as opposed to SEEING THE TIME ?

I thought maybe the little running man complication was causing this, but no, if I use a Watch Face with no Workout complications, still does it.

I I leave the Podcast App open, it just stays in Podcast, doesn't open Workout

Why can't I just see my Watch Face and leave Workout in the background ?