Size.
I have a Nexus 5.
When the Nexus 6 first came out, I got it and used it for about 2 weeks. The size drove me crazy, too big. I could not one-hand it. Returned it to Sprint and went right back to my Nexus 5.
I'd still use my nexus 5, however I've already replaced the screen on it 3...