Ok just to confirm, MacPro here with Crucial 500GB SSD and NVidia GTX 680 2GB card installed. Runs Mojave well.
Did you do all the pre install checks.
Make a full back up of your Mac first. Use Disk Utility> First Aid to check for errors. If errors are found you will need to boot to your Recovery HD and run Disk Utility> First Aid until no errors are found. Is there plenty of free space on the drive, at least 20GBs.
Open System Preferences> Users & Groups> Login Items, if there are any third party apps in the login items highlight them and click the minus sign to remove them.
If still having problems boot to Safe mode and try installing from there, Use safe mode to isolate issues with your Mac - Apple Support
Make sure your Mac High Sierra installation has all the necessary updates installed prior to trying the Mojave install.
Has your Mac been running fine on High Sierra, if not is better to resolve the problem first before upgrading.