Today I turned up the brightness on my S4 and turned on location services, and the battery started dropping.
Turning off location services and dropping brightness and I should be back to a solid 8+ hours of battery with heavy usage (phone, text, internet.)
So what is turned on really matters.