When attempting to use the object tracker feature to track a moving speaker, it tracks the speaker relatively well, but is shifting vertically. Is there a way to prevent vertical movements with the object tracker?

My organization is recording a speaker give lectures. Throughout the video, the speaker will move across the stage left to right or right to left. We're hoping to have the Final Cut Pro software track the speaker as he moves using the Object Tracker feature. I have successfully used this feature and am tracking the speaker, however the end result has the frame moving vertically up and down in addition to the left and right motion tracking. The fact that there is this kind of up and down motion makes the end results look shaky and unwatchable rather than a smooth left to right.

Is there a way to limit the object tracking feature to only move horizontally as to prevent this shaky output?