System Extensions Dialog?

The Startup Security Utility is still available on the M-series Mac. You need to access Recovery Mode by holding the power button while powering on the laptop. You will encounter a boot menu where you need to select the "Options" icon which will proceed to boot into the online macOS installer. Just quit the installer "File --> Quit". You will now see the traditional utilities screen for Recovery Mode. You will find the "Startup Security Utility" on the Utilities menu of the menu bar.

Edit: It sounds like you are using some software that has not been properly updated to work properly with later versions of macOS or later versions of Apple hardware. You may want to reconsider the use of that software, or contact the developer of that software to make their app adhere to the current Apple methods so that you do not need to reduce system security like this for just a single app. Sooner or later that app will likely cause you problems due to using outdated methods.

Hi there,

It sounds like an application on your device is trying to install a system extension when you boot up your Mac. Do not enable kernel extensions if you do not expect an application you trust to need one. You can learn more about system extensions here: About system extensions and macOS - Apple Support

Consider checking the Login Items of your Mac for software you don't recognize. The following support article can help you find and disable Login Items: Change Login Items settings on Mac - Apple Support

Additionally, check your Applications folder in Finder for unwanted software and uninstall it. The following support article can help: Uninstall apps on your Mac - Apple Support