Alright. Did some more testing today:
1: Normal usage of phone. Bluetooth, wifi, location (battery saving) all on.
2: Safe mode, no location or bluetooth
3: Safe mode, location and bluetooth on (sharp drop is a hangouts call)
4: Normal, location and bluetooth off