Sequoia turns off many sharing options on startup

Recently bought a new Mac Mini M4. Works great but macOS Sequoia (updated to 15.2) seems to have issues with sharing options. I need SSH and Remote Management turned on all the time, but every reboot turns off File sharing and remote login. Remote management appears to be enabled, but it doesn't work until I disable and re-enable it.

I tried disabling SIP, no luck. As a dumb workaround, I had to install TeamViewer, so I can access the machine and enable what I need. This is really annoying.