Make sure you look on the iTunes window, in the sidebar along left side, under DEVICES.
If you are connecting it to a USB hub, try a port that is directly on your computer.
If that does not help, try shutting down (powering off) your computer. Reset the iPod shuffle using this procedure
Then, start up your computer, with shuffle NOT connected. Run iTunes. Connect shuffle.