The subject and body of your post don't seem to agree. The subject mentions "Backing up with TIme Capsule for the first time". Has your Mac done at least one successful Time Machine backup? If not, I wouldn't expect Time Machine in the Dock to be able to open.
If you open the Time Machine panel of System Preferences, what do you see? Have you configured Time Machine?