Sorry for the delay but I was kind of "off the grid" (on a cruise in the Caribbean). My Note 4's battery drain IS tied to the device and to the use of uSD cards (micro-SD card... cheating by using "u"
.
During the shore visits and with extensive data usage (thanks to T-Mobile's free international data roaming), my Note 4 could last 20+ hours every day (I would charge it after 16 hours and it still had ~40% left). When I got back home, I re-inserted a freshly FAT32 formatted 32GB Class 10 uSD card and 4 hours later, the battery was almost dead and the phone was hot. "indexService" was consuming over 75% of the phone's processor time.
I know that it's not happening across the board but it seems to be a fairly common issue tied to the Note 3 and 4. Unfortunately, I have not found any post from Samsung telling us how to resolve this. By the way, it's NOT Wi-Fi as on my Note 4, Wi-Fi is always OFF unless I want to connect.
So, my action plan is:
Test 1: Test the uSD card formatted to exFAT.
if that fails...
Test 2: As I did NOT perform a new "factory reset" and this is something I will try after my next busines strip.
With regards to exFAT, I did NOT think that Samsung's Note 4 supported the exFAT format. Additionally, that format is typically mandatory for 64GB+ uSD cards/sticks so I didn't try to use this format with just 32GB. My nVidia Shield tablet uses 32GB FAT32 formatted cards without any problem.