I always have to switch hands when I'm talking. It's usually on one side where they can't hear me. I have no problems with the speaker phone. This has been an ongoing problem with each of my Nexus 5s. I have own about 5 of these devices, and each time this has happened.
Posted via Android...