Hello. That's a little unclear.
You had used that S4 before to log in to your Google account (on a browser, Gmail, or Android Device Manager?), but it was never set up to be a device on your account?
Now you have come across it again, and you find it has access to your Gmail? or it is fully set up with your Google account so it can use your Play Store etc.
Who uses it. You would need to either demand access to remove your Gmail account, or fully reset it if it works off your Google account.
If it is set up with your account, you should see it as another device here -
www.google.com/android/devicemanager
A little more info please.