As usual, Apple's help page (deauthorize all computers) is awful, but I figured out how to find the Deauthorize All button, so I figured I'd pass it on and hope those who search for how to do it will find this post.
- Launch iTunes 12 (have not tried Windows version, FYI).
- Under Store menu, select View Account (you may need to sign in first).
- Click View Account button.
- You should see the Deauthorize All button at the bottom of the first section ("Apple ID Summary"). It will only appear if you have more than 1 authorized device.
I hope that helps.
MacBook Pro with Retina display, OS X Mavericks (10.9.5), Intel i7 2.5 GHz