OK-- I fear that there are some problem files that are not being recognized-- essentially a corruption of the Library. I imagine that you can still use it from Photos where it is as long as you don't chance on those particular files. It could take a long time to figure out which ones are the problem pictures. You can stop the rebuild and start it again-- I've seen it work better with a second try.
But, here's another idea. Since all your pictures are in iCloud, they are OK there. So instead of copying the Library you have that seems corrupted, you can create a new Library and populate it with the pristine pictures already in iCloud. The only downside to this is that it may take a week to finish.
So--create a new Library, probably on the new hard drive. (Or, it could be created anywhere, and then you'd just copy it to where you want it.) You make a new Library by closing Photos and then option-clicking on the Photos icon. You get a dialog showing current Libraries and offering to switch or create a new one.

The dialog shows what your current System Library is, and you can find the path of each of your Libraries. I have a bunch.
You create a new Library where you want it, and then make it your System Library. That's on option in Photos>Settings>General

"Use as System Library" is grayed out for me, because that Library is already my System Library. The System Library is the only one that syncs with iCloud, and it's the one that pops up for email, messages, and so on.
Then connect this Library to iCloud:

Select "Download Originals," since this is a backup. ("Optimize" loads only smaller versions of the images.)
Then sit back and let Photos copy all the pictures from iCloud to your new Library. Could take a week. Probably you should leave the computer on with Photos running in the background-- a lot can happen at night.
When it's through, you can switch back to the other Library (if it works,) or you can copy this one and use it. You will have to tell Photos which Library you want to use as your System Library-- there can be only one.
This new Library should be pure and un-corrupted, but it probably won't have the pictures or videos that caused problems with the other one-- or it may have them from before corruption happened. I don't think I'd erase the original until I was sure it was of no use.
Let me know!