Although the question is answered here, there are still some cases, where this won't work. Some TV sets do not give an audio output unless there is a video output streaming along with it. For this you can use your iPod as a Photo slideshow presenter, hook up your Apple iPod video cable (or buy another one with replacing color sockets respectively) and start a slideshow of a small amount of photos. When the slideshow ends, the iPod will still play music but your last photo will remain on screen (unless you choose to repeat the slide show in the photo settings on your iPod). This way you can get visual feedback on the volume level but you won't be able to skip songs, since the back/fwd button are kept for changing photos, not music. I would recommend choosing your playlist before starting your photo slide show. Also make sure in your photo settings to choose a playlist or simply 'now playing' if you already were playing that playlist you want to listen to on TV. Remember that this will consume the iPod battery at a higher rate than only playing music.
PowerBook G4 12" Mac OS X (10.4.9) For Older TVs.