Completely deleting an old email address

I set up my original apple id using an email which is now no longer accessible. I want to keep a track of my expenditure on apps but Im not getting the emailed invoices to the new email i changed over to. i suspect theyre still going to the old email which I can not access any help please? I’ve already changed my Apple ID email to my new one but still no invoices.