In Gmail (on the web) most of the 'not assigned contacts' (as you find them on your gmail-synced android device) are kind of hidden: in the contacts area: hovering over the groups on the left will reveal a group 'other contacts'
that contains a great deal of these 'unassigned' bastards. Here...