Can't access my end to end encrypted data of icloud onto my new phone

So I got the new iphone today, after not having an iphone for a while. I made sure my icloud was all updated and it had me use my previous iphone password to fully access my icloud. I typed my password, however, it kept saying it was incorrect, even though I knew that was the password. I kept trying and looked for ways to try and fix it. I saw something about removing the old phone off of my account and trying again, however, when I input my new password to access the end to end encrypted data it just says delete past icloud data to continue using icloud. Now I obviously don't want to get rid of my old messages and photos, so is there any way I can fix this or did I mess up by deleting my old phone off my account?