I have the same issue also with compass app .
I am using infograph modular face so I thought may be I am pressing the shortcut by mistake so I changed the face still doing the same thing with all the faces I tried
Tried to rest by pressing crown and side button both until Apple logo appears but it solves the issue for 24 hours than the same situation is repeated
I even tried to stop the App background refresh from my IPhone’s watch app but still not solved
Apple need to solve this issue ASAP
By the way I noticed that every time I fix it by rest it will do the same again the next day at afternoon and always starts in the afternoon.