Am I overlooking anything to get multiple playlist windows open.
You cannot have more than one window.
And a quick way to get from a song to the album
While the song is playing, move the mouse cursor to the LCD window at top of iTunes.
Click the arrow after the song name then Go to Album.
Sugggestions here -> http://www.apple.com/feedback/