I've been getting this problem, it started shortly after the Verizon update for my phone; of course this might not be the problem, but it is a coincidence.
Even though I get "Unfortunately Google Contacts has stopped"; clicking on the message, and waiting a short time will make it available...