I'm in the same boat. Wish they'd made a Nexus 5P. Had to 6P's and went to a 5X twice because of the height of the 6P.
I'm often tempted by the larger phones - another 6P etc. When I think about getting another large phone I think why? Gaming - I have a PS4. Watching films - I have a Chromecast. Everything else - 5.2 inch is fine, particularly for a runner.
The only big phone that appeals to me is an iPhone 6+ for the battery life, but I've learned it's not worth being uncomfortable for the sake of a bit more battery life.