Phone goes crazy

[AC Question]

So I have an Samsung s6 and for some reason it goes crazy seemingly when I have ear buds in the Jack and it always seems to be late when I am listening to music while I read but my actual headphones don't seem to have this problem so I would use them the only thing is they are big and bulky and really uncomfortable to use while I am reading and by crazy I mean it goes into the Google voice thing turns media and sound volume up and down and is really annoying as sometimes I will be watching a video and it stops that and does it's own thing any help