First please understand that slathering your Mac with layer upon layer of so - called "anti-virus" utilities is not going to protect it from the intrusions you fear, and will only result in degraded performance, system instability, data loss, or manifestations of the odd behaviour you describe. For example, I noticed the exact same display anomalies and system instability you described after installing Intego, another completely worthless product.
Next, please understand "spyware" is a very broad term encompassing everything from innocuous tracking cookies necessary for website navigation to targeted advertisements to keyloggers. None of those examples are considered malicious software. All of them can certainly be used for malicious purposes, but since they are not malicious in themselves, your search for a third party product to search for and eradicate them will be fruitless.
The term "spyware" is generally applied to the above when they are installed without your consent, but when confronted with a dialog box requesting your consent to install something, or a checkbox indicating acceptance of terms and conditions prior to installing it, approximately 100% of Mac users will gleefully agree and install whatever it is without lifting a finger to read or comprehend the consequences of their actions.
You asked about keyloggers. While I know of no "anti-virus" utilities that seek to hide their presence on a Mac, keyloggers are another story. There are ways of checking for the presence of specific keyloggers, but there is no method short of an exhaustive, hands-on inspection of your Mac to be absolutely assured that one does not exist on it.
When someone asks about the possibility of a keylogger having been installed on their Mac, their reasons for concern become critical information. For example, it is not uncommon for keyloggers to be installed by a future former spouse for purposes of entrapment in divorce proceedings.
Physical access to one's Mac makes literally anything possible, including hardware modifications that cannot possibly be determined by anyone using this site. The only way of providing absolute assurance that a software keylogger does not exist is to completely erase your Mac and configure it from the ground up.
Bear in mind that physical access to your Mac implies physical access to your surroundings, in which case implanted wireless bugs or cameras can be installed far more easily than modifying your Mac.
judahman wrote:
And this brings me back to my core question: What is the BEST mac security app available (free or affrdable, that is, for Barracuda is well beyond my fiscal reach).
Using a computer or mobile device always involves an element of risk. Threats to your personal information security are the consequences of using those devices to accomplish your daily work. There is no way to eliminate those threats, but there are ways to mitigate them and reduce the risk to an acceptable level.
Delegating risk management to one single all-purpose Mac "security app" to accomplish that goal will be ineffective, and is frankly irresponsible from the perspective of information security. OS X was designed from the ground up to be a secure operating system specifically intended to protect one user's activity from another. Its security features have improved with every succeeding version, and it protects itself very well on its own. How you use your Mac, and how much personal information you agree to share with others, is up to you.
OS X already includes everything it needs to protect itself from viruses and malware. Keep it updated with software updates from Apple.
A much better question is "how should I protect my Mac":
- Never install any product that claims to "speed up", "clean up", "optimize", or "accelerate" your Mac. Without exception, they will do the opposite.
- Never install pirated or "cracked" software, software obtained from dubious websites, or other questionable sources. Illegally obtained software is almost certain to contain malware.
- Don’t supply your password in response to a popup window requesting it, unless you know what it is and the reason your credentials are required.
- Don’t open email attachments from email addresses that you do not recognize, or click links contained in an email:
- Most of these are scams that direct you to fraudulent sites that attempt to convince you to disclose personal information.
- Such "phishing" attempts are the 21st century equivalent of a social exploit that has existed since the dawn of civilization. Don’t fall for it.
- Apple will never ask you to reveal personal information in an email. If you receive an unexpected email from Apple saying your account will be closed unless you take immediate action, just ignore it. If your iTunes or App Store account becomes disabled for valid reasons, you will know when you try to buy something or log in to this support site, and are unable to.
- Don’t install browser extensions unless you understand their purpose. Go to the Safari menu > Preferences > Extensions. If you see any extensions that you do not recognize or understand, simply click the Uninstall button and they will be gone.
- Don’t install Java unless you are certain that you need it:
- Java, a non-Apple product, is a potential vector for malware. If you are required to use Java, be mindful of that possibility.
- Disable Java in Safari > Preferences > Security.
- Despite its name JavaScript is unrelated to Java. No malware can infect your Mac through JavaScript. It’s OK to leave it enabled.
- Block browser popups: Safari menu > Preferences > Security > and check "Block popup windows":
- Popup windows are useful and required for some websites, but popups have devolved to become a common means to deliver targeted advertising that you probably do not want.
- Popups themselves cannot infect your Mac, but many contain resource-hungry code that will slow down Internet browsing.
- If you ever see a popup indicating it detected registry errors, that your Mac is infected with some ick, or that you won some prize, it is 100% fraudulent. Ignore it.
- Ignore hyperventilating popular media outlets that thrive by promoting fear and discord with entertainment products arrogantly presented as "news". Learn what real threats actually exist and how to arm yourself against them:
- The most serious threat to your data security is phishing. To date, most of these attempts have been pathetic and are easily recognized, but that is likely to change in the future as criminals become more clever.
- OS X viruses do not exist, but intentionally malicious or poorly written code, created by either nefarious or inept individuals, is nothing new.
- Never install something without first knowing what it is, what it does, how it works, and how to get rid of it when you don’t want it any more.
- If you elect to use "anti-virus" software, familiarize yourself with its limitations and potential to cause adverse effects, and apply the principle immediately preceding this one.
- Most such utilities will only slow down and destabilize your Mac while they look for viruses that do not exist, conveying no benefit whatsoever - other than to make you "feel good" about security, when you should actually be exercising sound judgment, derived from accurate knowledge, based on verifiable facts.
- Do install updates from Apple as they become available. No one knows more about Macs and how to protect them than the company that builds them.
Summary: Use common sense and caution when you use your Mac, just like you would in any social context. There is no product, utility, or magic talisman that can protect you from all the evils of mankind.