Delete Workout exercise "target" accidentally set

During the Workout Outside Walk function on my Apple Watch 6 it looks like I have accidentally set some sort of target for my workout. The icon turns blue and the watch tells me half way through, and at the end of this imaginary target that the goal has been reached. I don't need this distraction. How do I delete this accidentally set "goal" (which looks like it may be time of workout related)?