If wiggling the plug where it connects to the phone makes it charge, if even for a second, then yes, the port is loose. And if you don't want to end up with a large repair bill, get that fixed sooner rather than later. (Every time the loose connection connects and disconnects, it makes a very hot spark, which damages a little bit of the board that the port is connected to.)