How much time were you getting on average with the Note 4?  The S6/S6 Edge is going to well below that (assuming your apps, usage, carrier, etc. haven't changed significantly since you used the Note).  
Remember the S6/S6 Edge are smaller phones with smaller batteries, so even if battery life...