After trying everything else, nothing worked. I also couldn't find the Google App in my app drawer.
I did try booting my Galaxy Note 4 into Safe Mode (holding Volume up and down and home down as device powers on). After the phone fully powered on the option to turn UPSM off finally appeared...