I got the issue figured out on my random restarts. I uninstalled Light Manager app and it hasn't restarted since. I noted after that was uninstalled, I don't even get the normal white notification light. I'm wondering since newer phones don't tend to have that LED notification light anymore if they stopped coding around it in Android 11.