One consideration is the difficulty in rooting the Note 4. Currently the T-Mobile and Developer Verizon versions are the only ones.
My Note 2 was getting slow, so I took a couple days to tweak and fine tune it months ago. It still runs great.
My first attempt was a bloated Verizon Note 4--great...