I got it working, someone in the XDA Forums managed to do it, so here is the solution:
Lets start from scratch to make it simpler.
Remove Google Contacts via the apps section of the phone
Download Google Contact Sync APK and install it (Even if you already have it) get this one...