I popped in, again, to explain further, so I'll do it as a reply to you. Some of this you probably know, and most is intended for shameer0786.
The OS is now split into two volumes, one for the OS and one for data and third-party software.
If you reinstall without removing the old - Data volume, you will end up with a new one. The old one just becomes another volume which is mounted to /Volumes. The true Data volume is mounted to /System/Volumes/Data.
The symptoms presented look to be an orphaned Data volume from the previous owner who did have FileVault enabled. The orphaned volume is encrypted, hence it asking for the password to decrypt and mount. The previous owner probably just erased Macintosh HD, not knowing his data was on the Macintosh HD - Data volume. At least it was encrypted.
One thing I missed previously is having the old AppleID still somehow attached to the Mac. So, I definitely recommend erasing the drive completely as you suggested at the outset.