I don't think that many people think everyone shouldn't care about the camera quality.
Personally I virtually never take pictures with my phone. As long as the pictures I do take are reasonably clear then I really couldn't care less. I am a horrible photographer myself so I've never been one to share any of my photos (even with great cameras). I use my photos to remind myself of my experiences but the enjoyment of them are gained from reminescing about events I have no pictures of, so I really don't care much about how the actual picture looks.
That said, I am not willing to purchase a phone that I feel I am making tons of sacrifices for for no reason other than to get a very slightly better camera, or to try to put pressure on the manufacturer that they MUST put the best camera in the industry in their phone.
I personally think that Motorola deserves much more praise for making a phone with the best ergonomics bar none in virtually any phone to date while still having very good battery life, performance, and with breakthrough technology allowing a mobile device to monitor its surroundings and provide necessary information for its user when the user needs to know it and is ready to assist the user anytime they ask for assistance.
For those reasons I have no qualms about purchasing a Moto X even though it has an acceptable (albeit unreliable) camera. Those people who have camera quality as a top priority can feel free to purchase a phone based on their own needs, and its no skin off my back, but I'm sure the camera is more than acceptable for the vast majority of users desires and actually ideal for some if picture speed is a priority and I feel that people read that the camera quality is slightly less than that of its competitors so then automatically think it is a horrendous camera that should have never seen the light of day.