I would say that rooting is the simplest way, its one of the reasons i rooted my first android phone. That way you can use something like titanium backup to remove any file you don't want.
There may be a way to do it without root but i'm not familiar, and rooting is so easy these days...
Rooting is something of a corporate taboo, so trying to avoid that.
However, I did discover if you "Uninstall Updates" for the bloatware that is Google Goggles, it then reports as zero size in the application list. So you can't remove the corpse, but you can drain all its blood. Unfortunately, it keeps showing up in my market list of things to update, but I can ignore it there as much as I ignored it everywhere else.
