This was frustrating me also...
you can solve the problem by going into phonebook via the dialler app on your home-screen then swiping over to people and at the top left hand corner under 'phonebook you can choose which contacts are available...
by only choosing your google account now...