Ok, turns out the Optimizer app is actually responsible for some features I didn't realize. Like blocking calls from strangers, changing app notification settings, and closing background apps. Disabling it isn't an option. As soon as I re-enabled it the notification came back.
Is there any way...