Yes, it is safe. Shut down all running applications first. Restart immediately after putting cache files in the trash.
It will actually slow you down initially. The whole point of cache files is faster access to frequently used data. The OS and your apps will have to "relearn" your habits.
Yes, each user will have to be done separately.