(Presumably you regularly empty your Safari cache by deleting the following file: Home/Library/Caches/com.apple.Safari/cache.db and also clear your History)
One reason for a slowness in page loading may be the 'DNS Pre-fetching' feature of Safari 5.x as is described here: http://support.apple.com/kb/TS3408?viewlocale=en_US
You can cancel DNS pre-fetching by going to Terminal and typing:
defaults write com.apple.safari WebKitDNSPrefetchingEnabled -boolean false
You have to restart Safari for it to take effect.
If Safari seems to hang for ages:
If you have a lot of tabs open and/or a lot of pages running Flash, Safari can sometimes 'hang', requiring a restart of Safari. This can often be inconvenient, and as it is rarely Safari itself that is hanging but merely one of its plug-ins, usually Flash, there is a way using Terminal to restart the plug-ins (without restarting Safari and losing your tabs) by quitting the WebPluginHost process:
Open the Terminal from the Utilities folder in /Applications and type killall -9 WebKitPluginHost
Note that this command kills all Safari plug-ins, not just Flash. All plug-ins should start back up when you reload the page. Then go back to Safari and refresh any pages that were using the Flash plug-in. This also fixes the Beachball of Death. Try this whenever Safari gets slow or freezes. The latest versions of Flash 10.1 and later appear to have improved the situation somewhat, but haven't completed eliminated it.
For this and other reasons Apple switched their websites to HTML in January 2011: http://www.appleinsider.com/articles/11/01/26/apple_revamps_its_public_website_u sing_html5.html
The main reason I mentioned your ISP is that their servers may be too busy, which is why I suggested Open DNS.