When I turn off my S4 and plug in the charger. The phone behaves the same as jojowoodo describes. But when it has been left in the charger for a while so the phone actually been charged. When I turn it on, but it runs very slowly.
I plugged in the USB PlayStaion to see if your phone charged...