With Seidio coming out with a 3800MaH battery soon (almost twice the extended Verizon battery) the only downsides to the Nexus (for me) are the Camera (somewhat mitigated by alternative camera apps) and the signal in certain areas (hopefully fixed in a updated ROM).
Other people have reported other issues, but battery/camera/signal are the only ones i've seen mentioned by an overwhelming number of people. Personally, I love it.
Except that Seidio battery is fugly.