yes, its very annoying. I have the same problem.
but I can not find what you suggested in the google mail web page like: " the section labeled all other contacts (or something, it's not exact)" to delete these contacts...can you help and give more specific instructions?