I had also this frustrating issue. 100% working solution for me (S4 with 5.01 Lolipop) was de-activating "driving mode". With driving mode activated phone transfers mic & voice to Bluetooth or headphone jacket...disabling main speaker & mic. Google "disable driving mode" or "Remove Hands Fee...