Did you try to lower the volume on your headset (call volume)? Not the ringer volume. The call volume is the volume that is adjusted when your talking to someone.
If you are using a Otterbox Defender case, I have the same issues. I finally cut off the plugs that protect the headphone jack, mic and the charging port and it has helped, but didn't eliminate it.