I got the issue figured out on my random restarts.  I uninstalled Light Manager app and it hasn't restarted since. I noted after that was uninstalled, I don't even get the normal white notification light.  I'm wondering since newer phones don't tend to have that LED notification light anymore if they stopped coding around it in Android 11.