I use Google Play Music all the time, as my only music player, so I don't want to disable the app.
I looked at the settings, there is nothing in the download queue, and I disabled "Automatically cache" and even enabled "Download via Wi-Fi only", but it still requires a "Force Stop" to cease...