Update:
I removed my phone case and listened to music with my headphones. And guess what - nothing happened! I am puzzled now, but I think my phone case is to blame because it does something for the headphones as I concluded from what happened after I had removed it