Possibly easier solution: clear data for the Contacts Storage app (not Contacts -- you need to mark "Show System" for this app to appear in the list). Then just wait for next sync.
At least it worked on my Moto G which had this same problem after upgrading to 6.0. Wipes call history as well...