What device do you have? Is it low when your listening to music or YouTube as well? My guess is it sounds distorted, maybe crackely, and your speaker is blown.
Welcome to Android Central! Either that, or there's something clogging the earpiece speaker opening. Can you hear the caller normally if you change to speakerphone, or use a wired or Bluetooth headset?