There are at least two different way this could happen.
The first is screen zoom. Hold down the CNTL key as you scroll, one direction zooms, the other unzooms.
Second is the Smart Zoom feature of the Magic Mouse. Double-tap with one finger on the Mouse and it will zoom in Safari and other apps that support the gesture. (Tap, not click)