Just play audio and no music video in Apple Music/iTunes?

Hi all,

New to Apple and Apple Music.

I don't know how I did it, but I downloaded a bunch of music-videos, and not just audio music and put them in playlists.

Is there a way to delete the video portion, or set the video playback to "off" so when I stream to my external device from my machine, it doesn't play the video for those items?

I'd like to just use "audio" all the time with no video files, whether on my iphone or PC (using iTunes).

Thanks!