I am 6'4" and I find the Note 3 to be ridiculously oversized. I'm coming from a GS4 Google Edition, which I'll be passing down to my wife as soon as the case for my Nexus 5 arrives. Don't get me wrong, the Note 3 is an excellent device, loaded with top-notch specs. However, it's definitely not for everyone. To me, the GS4's/N5's 5-inch displays are the absolute limits when it comes to screen size. Moreover, I prefer stock Android and the speedy updates that come with it to any manufacturer overlay, particularly Sense (HTC) and TouchWiz (Samsung).
Another big point of contention is the display technology used by various manufacturers. It's largely a matter of preference, but Samsung's SAMOLED displays are vastly superior to all other displays I've seen, including the N5's. If my wife didn't need a new phone (her S3 is beginning to show signs of age), I would have held on to my GS4GE. With that being said, if I had the TouchWiz variant of the GS4, I definitely would have gotten rid of it.