Generally, you're going to find the Mac world 99.9% problem-free. This looks like a glitch and it will probably be fixed in reasonable timeframe. I would suggest, though, that you provide Apple with feedback on this (
http://www.apple.com/macosx/feedback/) particularly as you are coming from the PC world and this is your first experience of the Mac. Try to be very precise in describing what happens: what folders did you remove etc.
If you bought the Mac at a local Apple store, go in and explain the problem to them. They might suggest simply replacing it (it's new, so shouldn't be causing problems). It could be a hardware fault in your case (it happens, even on Macs) and they would be able to test it very quickly.
Whatever you do, don't panic and start using those Windows fixes you're used to like reinstalling the system!
Gavin