Welcome to Android Central! Is it a regular S5 or S5 Active? You posted in the S5 Active forum.
If the headphone icon doesn't go away, that usually means a problem with the headphone jack, and the phone thinks you have headphones plugged in. Inspect the jack carefully and see if there is any debris in there.