Get rid of music controls

[Sim Harbert]

Does anyone know how to stop the music control from coming up on Android Wear?

It is annoying and I don't know how to remove it. I constantly have to swipe down and then later it shows up again. It stays there long after I have quit listening to music. And I can't swipe the controls away. And because it stays there I am constantly accidentally starting my music when I hit the screen and don't realize it.