Size.
I've been using the 5X for about a week now and it's about as large a phone as I'm comfortable handling (coming from a 2013 Moto G). Doesn't fit well in my front left pocket and that's always been where I've kept my phones. I would have gotten the Moto X, but it's just too large. The 5X...