How much time were you getting on average with the Note 4? The S6/S6 Edge is going to well below that (assuming your apps, usage, carrier, etc. haven't changed significantly since you used the Note).
Remember the S6/S6 Edge are smaller phones with smaller batteries, so even if battery life...