The new iTunes 11 has changed where your device is located. You can change it back to the classic view by pressing Control-B for the menu and Control-S for the sidebar. This will restore the view that will allow you to eject the device. You can eject the device in the current view but the placement has changed. I have included the article that outlines the changes device location changes.