Apple Music slowing down iTunes

I recently started using apple music and I noticed every time a song ends and it switches to a different song iTunes completely freezes. I can't do anything for a good 20 to 30 seconds while its trying to switch songs. Is there a fix for this or should I just ditch apple music?