I had the same dilemma just yesterday. I had contacts that were just emails, either from facebook or yahoo (I think). I couldn't long press and delete like a regular contact so I just ended up linking them to the facebook or google contact I already had since most were already on my phone as regular contacts. This made my contact list a lot cleaner.
Would be nice to know if there was a way to just delete though.