The BIG MISTAKE for me was updating to Big Sur from Catalina on iMac (Retina 5K, 27-inch, 2019) w/ 1 TB Fusion Drive + 64 GB Memory. It went from < 30 sec. startup to 3-5 minutes+, but realistically it was 10-15 minutes before everything (macOS background, Desktop, apps,..etc) would settle down. I can hear the HDD working hard during that time.
I was also successful, twice, with performing a clean install of Big Sur on internal HDD and external SSD (also booting from it), but in both situations it reverted to the slow startup after migrating and manually transferring my user account and apps.
All I want is my iMac back to how it was before Big Sur, and to figure out what in my user account is causing it. I shouldn't have to deal with this. I spent two separate weekends trying to fix it (15+ hours alone with the last attempt).
I am planning to get the new iMac Pro, but worried this issue will carry over once I migrate to it.
The only positive from this is that startup has improved a little bit, and I was finally able to get my Mail "On My Mac" Mailbox Storage mailboxes to list alphabetically in sidebar after removing and reimporting mailboxes following years of unsuccessful attempts to fix it.