How is your free stage space? Do you have a separate drive for your llibraries and media?
In the Viewer Display dropdown, set playback to Better Performance.
Open up Activity Monitor to see what's going on with memory while this playback issue is going on.. Check the swaps info,
4 GB is cutting it close with 10.1. If your model permits, increase that to 8 GB.