When you're in the Google Play Music app:
1. Click the menu button in the top left corner
2. Scroll all the way down to settings (second to last thing from the bottom).
3. Under "Downloading" press "Manage downloads."
4. From there on out, uncheck the orange checkmarks to remove your downloaded...