I own an s4 and I think I found the cause off this. When making a call on an app (such as WhatsApp) it will make audio play through the call speaker. For some reason it was stay like this. As stated above if you force close the app it should go back to normal.
Facebook
Twitter
Instagram