You should be OK with 4 GBs of RAM. Obviously more is better, but you should be OK.
There are people using the entire CS5 suite in 4 GBs of RAM. It's slow going but it works. PS should be fine by itself. Keep an eye on your RAM usage with Activity Monitor which should help you determine if RAM is getting tight.