After being frustrated I decided to do one last thing, remove my Google account and add it again. I then went one by one seeing the sync time and data required by all the Google sync-able information.
Most thing App Data, Calendar, Books, Google+, Google+ Photos, People Details, Drive were...