I am a current Note 3 owner. Tried out the Moto X after I got my Moto 360. I liked the feel and the concept of Pure Vanilla. But after using it for about 3 days, I found myself looking for apps that started to make my Moto X into a mini Note 4. Wound up returning it because the battery life was starting to become a concern.
Now, here is the strange part or at least my rationale for not going with the N6. With the Note 4, I will have a broader choice of wearable tech to go on my wrist. I am a watch wearer so, I am used to wearing something on my wrist. Although, I like the Galaxy Gear watches, I like the Android Wear watches as well. By getting the Note 4, would allow me to use the Galaxy Gear watches and Android Wear in case I want to go with the Galaxy Gear versions in the future. One thing that the Galaxy Gear watches have, is the ability to make and receive calls on the watch along with the texts. Also, when picture texts came through, they would open on the Galaxy Gear instead of the Android Wear that comes through as an attachment.
For me, I work in a Computer lab so, the stylus proves useful to me on occasion or when I need to write something down and I do not have paper to write it down. Btw, I hate writing on paper now, I would rather do things electronically. I know someone who has the Note series and will never leave it as she has everything integrated into that phone.
Have you tried Nova Launcher? I found that to be better than the Google Now launcher. Also, with the Nova Launcher, you can save your settings to an exterior storage place so, that when you buy another phone its all set up for you. Or, if you want to buy a tablet and have it all the same you can do that as well.
The most recent Android Central podcast talks about the N6 and the Note 4 and which they prefer and why. It was the podcast from yesterday. That further convinced me that the Note 4 was a better choice.
Also, keep in mind that if you on Verizon, they only allow one return and then you are stuck with the unit.