What happens when you "disable caches"?

Since upgrading to Safari 9, there are up to 100 sites, mostly google, twitter, facebook and ad related, invading my cache every time I open Safari. I do not want these sites leaving their stuff on my computer. If I empty the caches, they go away, but they return every time I open Safari. Would it do any harm to disable the caches?