Thanks for the replies.
I used iPhone 3gs before upgrading to N4. I didn't notice such heat issue with the 3gs (maybe because I was using a hard case).
After a call, the battery temperature on my N4 is 29C which is pretty normal. However, it is still a little warm in the hand. The battery...