Yes. As said above... it's a scam, scam, scam.
Hopefully you never told them any account numbers to your actual bank or credit/debit cards. Or followed them to a site to put that information in - that would be a fake site.
Call your real bank directly and stop any transactions that may have been initiated.
says, that is a very common phone scam. They'll tell you all kinds of things to get you to buy gift cards, that are then put in a Paypal account or Amazon to buy something through a site they suggest. Those sites would be fake and are used for you to put in your real information that they swipe. Or, put in an amount that, by accident (yeah, right), is suddenly several thousand dollars more than it was supposed to be. Then, they will tell you how to reverse that but it never works. And more money is gone.
Next time, if anyone calls you and says there is a problem with some account and you don't know about that account - it's a scam - hang up.