I have the black, as the colors weren't offered by my MVNO. Shortly after I got it I dropped it, removing a tiny, tiny bit of black on the edge by the front camera. Other than that the finish has held up very well.
I just like Apple's approach to this issue better. It yields a feeling of higher quality. However, the issue is easily solved by going with silver. If the'd just made the silver version with the black trim I'd have (had?) an HTC One by now. I guess I'm one of the few that think black and silver look better than white and silver...but Apple went with white and silver so I suppose HTC didn't have much of a choice, eh?