Magic Mouse - Random Zooming in... and sticking!

Randomly my Magic Mouse 2 (and this happened a few times with my previous mouse) will zoom in when I scroll up. But then, my screen STAYS zoomed in and you can't fix it unless I refresh the browser. It's especially annoying when I have worked on something, then I have to start again.

I saw someone post the same issue posted in 2009. I think it's a rare problem, but it does happen, and I guess Apple has never addressed it.

I think it's something to do with the OS as well. It's really obnoxious and it's happened a few times since I upgraded to Big Sur.

Anyone else have this issue? Is there a fix or work-around?