how to deauthorize old computers from iTunes library

I cannot get my iTunes library on my new Mac Air. It says I already have 5 devices but I currently have only three. It must still have my old computers which I no longer have. How do I look at the list and delete what I no longer own? I already looked on my current devices under Apple ID and it just lists my current 3 so how can I look at the others?