In my case, here's the culprit
Notice the black plastic that house the power connector from the battery. The thing are not soldered. It simply does contact between surfaces. Which held by some pin mechanism. Because of the nature on how it works, this thing are very susceptible to damage over time, right off the bat. Since the location of the housing are prone to pressure.
Mine simply gets bent. Either the black plastic housing or the PCB itself, I have no clue. I only notice it doesn't contact as it supposed to anymore. It require bit more pressure to achieve it. So, the solution I did was apply some duct tape to force it return to its position.
I did bought an extra battery, but apparently after I did this there are no more sign of battery degradation. No more overheating. Everything runs normally. The replacement battery never gets out of its box after all.
Before this, I was frustrated on how the battery status not match between power off and on. When I turn it off, it always stated that the battery was somehow still contain bit more juice than what it stated while power on. Everything are so conflicting. The problem was rectified by simply turning it off for about 5 hours. No clue what happen then. Then it happened again. The same thing. For five times before I did this. The whole thing happen about 3 months ago.
It's been a week since I did the duct tape now. Not only I avoid my phone warranty as I pry it open myself, I also somehow destroy its SIM jacket. It no longer detect my SIM or any other SIM until I find out some of its copper connector inside the jacket got damaged. Later on I find out that replacing SIM jacket involves soldering. Now this, I'd leave to professionals to handle. The thing is dirt chip anyway. So I assume it would be relatively easy to work too, so it must not be expensive as to say, buying a new battery.
Considering how old my phone is by now, I realize annoying stuff like this is only a matter of time. I have no regret.