Welcome to Android Central! Does this persist after a reboot? If so, then go to the App Manager, select Contacts and Contact Storage, and Clear Cache for both.
If the problem persists, then you could also try Clear Data in the App Manager, but this would only be if you keep your contacts saved to your Google Contacts in the cloud. If the contacts are only saved to the local Phone account, then don't try this, because you could lose all of your contacts.