How do i turn off videos automatically playing in full screen on a mac?

This may sound like a silly question, but i cannot seem to find the solution anywhere.

While doing homework and stuff on my Mac, I have iTunes playing. However, whenever a music video comes on the iTunes goes into full screen and plays the music video. When i escape the full screen, the video stops, or if i hit "next" the next song will be playing in full screen with some sort of background, I'm not sure how to describe it.

Anyways, my question is, how do I turn off the automatic full screen? I don't mind if it just plays in the iTunes window because i can minimize it and still hear the audio, but when I'm typing a paper and it keeps popping into full screen every time a video comes on, it gets a little irritating. Any ideas?

Note: i already tried Preferences and there is nothing of that sort under "Playback", it only covers music things. Thanks!!