Just found this, and it worked for me.
http://forums.androidcentral.com/samsung-galaxy-s4-google-edition/311795-s4-proximity-sensor-issue.html
... the proximity sensor collects dust and you need to shoot the earpiece (which the sensor is connected to) with a can of compressed air. $5 for the...