You press the home key and it turns off or the power button after highlighting factory reset?
It might have a software or hardware issue being that old , can try flashing with Odin the stock firmware but you would need to find what firmware it's on and where to download like sammobile, I have a funny feeling that probably won't help but can try