Trooperxxx had the solution for me, it was the cable.
"I experienced the same issues after getting the S4. The solution: You MUST use the USB cable that came with the phone. If you use another USB cable, it will charge but will not connect to a PC. Once I used the supplied cable that came with...