I have this problem since Catalina was installed. I have 164106 pictures and 1463 videos. Upon install, the "gathering favorites, detecting duplicates, curating best photos, composing layout" process got stuck after one day or so. I let it run for one week, days and nights, without the progress bar showing any progress. I then killed the entire library and restored it fully from iCloud. The "gathering favorites, ..." almost went to the end and then Photos crashed and started to restore from scratch again. 3rd attempt from yet again a clean restore is stuck at about 15% of "gathering favorites, ..." (see screenshot below). The progress bar has not moved in almost 2 weeks. The people face process goes all the way in about a week. I saw that some of the users recommended to watch for videos, so I deleted all the video files > 2 minutes, then rebooted: the progress bar is still not moving. The migration to Catalina is a nightmare, at least for Photos. I have a powerful MacBook Pro, lots of RAM and as fast an Internet access as you can find in the US. Seriously, Apple? Interestingly enough, the iPhone does not seem to mind and completed the whole process in a few days.
