Have you read the permissions of Google Play Services? It can read your contacts. Now whether it does, and calls home with that information, I have no idea. Regardless, Google has access unless you turn off Google Play Services and a few more Google apps. Basically, it's a little late to be worrying about it since you probably have already used Google Play Services for one thing or another.
Then again, perhaps you haven't stated your full concerns.