music app always on?

What do you mean by "the music app will not shut off"?

If you double click the home button and then press and hold on the Music App at the bottom of the screen, a little minus icon ➖ appears. Click that and it will close the Music App.

As long as the Music app is not playing music, it's as "off" as it needs to be.