I think your battery is dead. It's a quote old phone and batteries can only do a certain amount of charges before they lose their power.
Edit. OK I was quick to reply, missed that after you changed it the problem didn't go away. Thought it did and then came back.
Weird issue though, but to me...