Poor activity monitor sensitivity

My Apple watch activity monitor keeps asking if im done in the middle of a brisk walk. This is getting worse over time - it can happen three times during a 20 minute walk!

Also it used to notice when I start a new exercise and now it almost never does.

I would suspect a wrong setting, but the thing is that these errors occur sporadically and when I have made no edits to any settings.