Try booting to Safe Mode. That boot up takes minutes and clears caches and other things that may resolve your problem.
How to use safe mode on your Mac - Apple Support
Delete the existing Monterey install redownload the installer and try again.
Do you have enough free disk space?
If upgrading from macOS Sierra or later, your Mac needs 26GB of available storage to upgrade. If upgrading from an earlier release, your Mac needs up to 44GB of available storage.
Also uninstall any antivirus and "cleaning" apps before trying installing again.
Some users have experienced problems with skipping macOS versions, even from not completely update Big Sur until try to upgrade to Monterey. You say you are at 11.4 so I would update to 11.6.2 before going to Monterey.
Are you using File Vault to encrypt the disk? If so turn it off and then try after the de-encrypting is complete. That can take many hours.