Workout app taking priority over scoreboard app

How do I stop the workout app from taking priority over my squash scoardboard app?

since updating to watchOS 8 and little but before aswell when playing racquet sports I use a score keeper but every time I lower my wrist the workout app ( tracking my exercise at the same time) takes priority and every time some scores I’m having to switch back to the scoreboard to add a score. It is very infuriating. I have tried turning always on on but this does not help and neither does turn the workout app of in the show apps section