HI and welcome to Android Central.
What Android device do you have? What headphones are you using? By any chance are your headphones originally from an iPhone or designed for iPhones? iPhones use nonstandard headphone configurations, and many headphones designed for iPhones won't work properly on anything but iPhones.