Scam phone call from Apple

I just fell for the phone call from apple scam saying my iCloud account was compromised and pressed 1 to speak to a representative. Spoke to someone for about 5 seconds and then they hung up on me (Probably because they had what they needed from me at that point). That’s when I realized that was a scam and I fell for it like a complete idiot! What do I need to do to secure my phone now? I already went and changed my login password, erased all of the saved login info for websites, cleared my browser, etc... I also logged out of my square account. I do not keep my credit card info on my phone. Should I erase my phone completely?