Music App on I Pad

You may have Repeat turned on. Check your Music settings. If it does not help try resetting the Music App. Close Music completely from the app switcher window by double clicking the Home button and swiping up the Music preview pane until it disappears from the screen. Then do a forced restart. Hold down the Home and Wake/Sleep buttons at the same time for about 15-20 seconds until the Apple logo appears.

It sounds like you have one song on repeat. Touch the song that keeps repeating in the Music app. It will start playing. A bar will appear across the bottom with the music controls on the left, the song title in the middle, and three dots on the far right. Touch this bar. It will open all the way up. In the lower left, you will see two arrows that almost make a circle. It's probably blue with a number 1 on it. Touch it until it goes gray (touching it once will probably disable it).

As for your other albums, are you using Apple Music?