Well, we shall have to agree to disagree.
FWIW, changing system installed folder icons hasn't been available for a couple of OS versions (can't remember if it was ML or Mavericks when I first noticed it). And, as an example, you can easily change the appearance of the Applications folder icon by putting an empty folder with a colorful icon of your choice inside the App folder with a name beginning with a 0 or 1 (so it shows first) - that folder always displays the first app entry in the App folder, so you can change that without having to mess with the system. As well, SIP may not be perfect, but it makes perfect sense for an average user keeping them safe by not allowing certain installs.
or you'd have to inadvertently download something
That is not entirely correct. MacKeeper hacked into my (web) Yahoo account (inbox); when I returned to that tab to check my mail, it took over Firefox and redirected me to a Russian website while proclaiming that I had 8,964 viruses on my Mac and the only way to get rid of them is to enter my credit card info below. This was before you were able to NOT have previous windows automatically re-open (it was a shortlived feature of Lion which was quickly discontinued in ML after many explicit bug reports were sent in), so every time I quit FF and re-launched it, the same page loaded again and again. The only way out was to yank the modem cable out of the wall and then do a complete erase and install. So, you can have a problem without downloading something - not saying that SIP would have prevented that, I'll go for all available safety (and the resulting privacy) any day over being able to change a folder icon. I wouldn't call that "preventing me from doing something I want" - it simply isn't important enough to disable a safety feature.