I have had exact same problem. I actually returned one and got new one with same issue. I plug it into charger and remove and the problem goes away.
With Samsung S3 and S4 I also have many problems with blue tooth and no voice coming in and/or going out.
Facebook
Twitter
Instagram