Music skipping in Spotify and Music only when using headphones

I'm at a loss here. For context, I have an Iphone 12mini and I'm using iOS 16.3. I have redownloaded my whole iOS, I've restored my phone. I've turned it off and on. I've redownloaded apps. I have done everything I can think of short of trying to revert my iOS to an older iOS. This all started around December when 16.2 dropped.

For some WILD reason, my music will start skipping forward about 30 seconds. I doesn't matter if I'm listening to the music I have hard downloaded to my phone via the music app, or if it's Spotify. The audio will skip, it will also just randomly stop, even mysterious turn itself back on. But ONLY when I put my headphones in. If I listen through my speakers on my phone, bluetooth or through Carplay, it works just fine.