Address Book Confusion

I believe that when addressing an e-mail the address is taken from a file. I first thought it came from my ADDRESS book but later found there is another place where e-mail addresses are stored. I believe this file is used with frequent addressees. If I am correct how can I access this file? I have removed an address from my address app but it still comes up when addressing an e-mail.