I had the same issue like most people: on Mavrick 10.9.3 (MacBook Pro), my Magic Mouse with Swiping between pages on Safari kept freezing! Very frustrating. So I just performed the following fix:
1) Closed all programs and left Safari open and System Preferences open.
2) Go to System Preferences > User & Groups > Login Items tab and selected third part programs to delete (using the [-] button)
3) Then went to Username > Library > Preferences and delete com.apple.systempreferences.plist
4) Restarted computer
5) After logging in, I opened Disk Utility and selected My Harddrive and chose Repair Disk Permissions.
6) After waiting to finish that, check that the swiping between pages feature is on in the System PReferences > Mouse menu
7) Opened Safari and tested - BAMM! works like new.
Let me know if that solved/fixed your computer.