That's the way all Mac programs work since the Mac OS began. All palettes and windows float. Though in CS5 and forward, you can make PS behave like Windows, where apps are confined to their own frame. In PS, choose Window > Application Frame. This will simulate how programs normally display in Windows.