Yea thats what I was thinking. Get a Lumia 520 or something and then prob just keep it for a spare.
The specs are substantially better. However, if you haven't used the Moto X you wouldn't know how well its optimized. The phone is wayyyy smoother then the S4 and even faster then the One. I'm at a point where specs shouldn't matter if the software is optimized. The Note does have a lot of software features that are unique to it and they intrigue me. The S4 had some, but they were gimmicky as hell. The Note's S-Pen functionality though is something I can see myself using.