Just DO NOT enable System Preferences -> Sharing -> Remote Managment.
Also DO NOT enable System Preferences -> Sharing -> Screen Sharing, AND Remote Login, AND Remote Apple Events.
Also do not install software that would provide remote screen sharing, this includes Skype, Google Talk, TeamViewer, LogMeIn, GoToMyPC, etc...
As long as the software is not running, no one is going to be able to use it to connect to your system.
By default none of these services are enabled. Out-of-the-Box, Mac OS X does not enable services that would allow remote systems to access it. You have to intentionally enable them.
Also if you use good secure passwords on all accounts, it is unlikely anyone would break into your Mac, even if you enabled some of these System Preference services.
What I wanted to know was what would be the result of deleting the entire thing.
You are just asking for problems if you remove standard Mac OS X software. Stuff that you do want to use may have shared libraries. Future software updates may not work correctly if it cannot find the old versions to replace. Or a future software update may just add it back in, which means you are just getting a short term false sense of security.
I will never , ever, use this, and, if it poses, A, serious security risk, (as I have read) there is no reason for me to have it in my system.
If you do not enable it, then it is not going to be a security risk.
In all the years of participating in Mac related forums, I have only seen remote desktop access invasion happening when someone was using very poor passwords AND they had Screen Sharing or Remote Management enabled, or someone convinced a novice to install TeamViewer via a SCAM and gained access that way. I have never heard of anyone being broken into when no remote services were enabled.
Oh yea, and when an X-spouse or X-Boy/Girl friend used insider knowledge to gain access. But a Cold break-in just does not happen with Macs.