I'm currently working on selling my Xoom to get a Nexus 7. Originally, I wanted the Xoom to replace a laptop, but it doesn't quite hit the mark for that use case, I mostly use it as a glorified E-reader. I also feel that a 7" would work for an E-reader better than a 10.1" would. So, despite the fact that I do like my Xoom, and I do use it often, I feel that the Nexus 7 will be more suited for my needs. I'm also a bit tired of Verizon blocking my updates and having to flash ROMs just to get the latest OS at a reasonable time...
So, it really depends on what you want/need. If you aren't using your Xoom now, there is a pretty good chance you won't use your Nexus 7, unless the reason you don't use the Xoom is size/weight.