Yesterday I did a factory reset through the settings and via recovery for good measure and wiped cache also. I then setup the device manually app by app via the Google play store and only downloaded what is essential after reading other people on previous Samsung devices had battery life issues after using Smart Switch. The only items I restored via Samsung Cloud was call logs and SMS messages.
I have the device on Optimized and Adaptive power saving turned on. I have put probably 80% of my apps into Deep sleep. I have also setup Bixby Routines to keep Mobile Data turned off while at home and to only use Wi-Fi, on top of keeping Bluetooth and NFC turned off and changing AOD to tap to show, instead of always show. I am using 120hz and FHD+ on a a factory Unlocked 128gb Note20 Ultra, snapdragon 865+.
With all of that said and while the device still says "learning usage patterns" I still have only got 4 hours and 52 minutes of screen on time with 10% battery left. I am truly at a loss and have no idea how to make the battery of this device any better.