Something happened with a recent update to one of the Google products. Never used to show up for me, but all of a sudden started to show up like it is for you. I just ended up disabling it in the Application manager.
Settings >> Application manager >> ALL >> Google Play Music
First you have to uninstall updates before the disable button will appear.