For info if it is of any use to anyone.
I have the exact same problem intermittently with an LG G3 on Three Mobile in the UK. (Quite often caller rings me, I answer, they can hear me, I can't hear them, they ring back second time or I ring them and everything works perfectly).
I'm 99% certain...