Hello txnyy,
To clarify, are you saying that this happens when you toggle Shuffle to on/off while playing music? How to shuffle music on your iPhone - Apple Support
"How to shuffle an album or playlist
- Open the Apple Music app.
- Open an album or playlist.
- At the top of an album or playlist, tap the Shuffle button.

"
If you haven't yet, use the steps in this link to back up and update to the latest iOS version: Update your iPhone or iPad - Apple Support
If that doesn't help, we also recommend isolating this by testing to see if it happens with streaming content, downloaded content, or both.
Let us know.
Take care.