So I have the Note 4. I've only fully charged it twice so far. But both times it did not charge as fast as advertised. I did this while the device was powered off, and the screen confirmed the fast charging by saying just that, "Fast Charging." So last night I powered the device on during the charge. GSam battery monitor showed the battery charging at 1120 ma. Wow, really? My old S4 charged faster than that. I know there is only certain conditions that allow a battery to be charged quickly. But what are they? At the time of charging, the battery was 84 degrees. That's pretty normal for any battery. Are there other things besides temp that the phone and charger are taking into account when charging the device?
Try swapping USB cables from another device. My fast charging stopped working a couple of days ago. I read a post on XDA about some Note 4 USB cables going bad. After reading that, I swapped cables from my Nexus 7. That fixed my issue.