Check the mic le (usually at the bottom) to see if there's lint or dirt packed into it. If there is, clean it out with a small pointed wooden toothpick.
If not, try speakerphone. If that works, you probably need a new mic. If not, talk to your carrier.