Have fun! It's nice to have choices. I thought about the Nexus 6 (mainly because of quicker updates as in Lollipop right now & no bloat), BUT I don't care for the size, I personally don't need the front facing speakers, no S-Pen like features for such a huge screen, Note's screen is sharper to me, Note"s camera is better for me and no expandable storage on the 6).
I guess I feel I'd get more bang for my buck with the Note series mainly because of the S Pen and "some" Touchwiz features. I actually use the pen much more than I thought I would because of it's new software and better implementation then in previous Notes. And then for me the Note 4 is "one upped" by the Note Edge as I feel like I'm getting everything! I still have the best camera with great camera software to complement it. I lose a little battery life wich hasn't been an issue for me so far. I actually use many different edge panels at different times. I appreciate that fact that you can use the edge features (timer, countdown, ruler, record & play voice notes and so on) while the phone is locked. This is a feature often overlooked. And I love the Note Edge night clock! All in all I believe that the Note 4 & Edge make better use of the size than many other big phones.
Just my opinion.
Thankfully we have so many choices now.
As an also: My buddy just told me that Samsung makes the screen for the Nexus 6. If so how ironic.