I agree, it's not an issue when we're at our desk all day or next to an outlet. Since I am on the road between clients on some days, a fast charger wouldn't suffice. On the wknds, I like to be outdoors, so carrying an external power source or a bulky battery pack is not feasible. I was at the beach today using my Note 4; the spare battery came in handy. With the Note 5, I set an alarm at 3p these past 2 wks to remind myself to charge it before I leave my office.
The only other reason to return my Note 5 is my HDMI/MHL 3.0 adapter does not work; can't connect to my TV.
If the Note 4 won't be getting Marshmellow, I would most likely keep my Note 5. It's an awesome phone.