Welcome to Android Central!
Did you purchase a Samsung battery - one made by them, specifically designed for this phone? Or did you buy some third-party knockoff from eBay/Amazon/Flipkart/Alibaba?
Even if you purchased a new battery that's made for this phone and carries Samsung's branding, there's no guarantee that it's authentic. Even if it IS authentic, there's no telling how long it's been sitting around on a shelf in a warehouse, or even if it's really brand-new.
If the battery is definitely new, then there's something wrong with the power management circuitry in your phone, which would require repair or replacement.
If you need additional help or have more questions or details to share, please join the site so you can reply in this thread. See
this link for instructions on how to join Android Central.