Welcome to Android Central! Which music app are you using, and how are you shutting it down? If you're only tapping the Home or Back button, most music apps will continue playing in the background, since the assumption is that you want to continue listening to the music while you're doing something else. You usually have to tap the Stop or Pause button for the music, then exit the app.