I don't know what your talking about. There are all sorts of sizes out there. Maybe one manufacturer doesn't make a size that one person might want, but that hardly means we have no choices.
The OP asked if phones were getting too big. That's like asking if tennis shoes are getting too big because Nike makes a size 18? People with big hands might want big phones, and that's OK as long as they keep making other sizes too.
We haven't had a 4.3-4.5 compact size with top of the line specs to be considered a flagship. The Moto X in some respects is a flagship and the new Sony Experia Z1 Compact is also a flagship, but before those 2, all "mini" smart phones were considered "low end" for the emerging market. It is somewhat changing a bit now, but no, there haven't been choices in every size. That's why ppl gravitate toward iphones instead. As Android users that love choice, I'm surprised how those of u that love big phones because of the choices..... don't support having flagship choices in a smaller size for the rest of us. You seem to want the bells and whistles in your Notes and GS4s, but when it comes to 4.3in screen size, you wonder why we don't think the downgraded specs is "good enough!"
Lets see how Well a Note 4 sells with a dual core processor with 720 res screen at 5.5 inches and a meg of ram. It won't sell at all! So tell me again why this doesn't matter for us, but matters for you phab fans?