My wife does this all the time and it bugs me to no end. Hold the camera in the correct orientation. Why are you holding it sideways? Back up if you need more real estate. You have plenty of pixels to crop to if needed.
We have 25% of our digital family photos sideways, and it bugs me to no end.