Thats an odd issue to have. Does the battery come loose enough to disconnect the power from your phone? I could see why this could be a problem. If its serious and there arent any signs of damages done by you, it sounds like you can have tmo replace it under a manufacturer defect.
Otherwise id just suggest wedging a small sliver of tape between the battery and the port to keep it secured.