Will I just be able to take my SIM card out of my Note 9 and put it in the Note 20 Ultra or will I need to call ATT and change SIM due to the 5G network?
If your Sim card is relatively modern it should be able to be provisioned for 5G by AT&T. If it is an older sim card you may need to request a new one. Either way try your current sim in the Note 20 and see what happens.
I don't SIM control 5G band. However, I always called my provider to reprovision when I swap the phone with previously used SIM. I often go to the store and get a SIM replacement just for the hell of it. LOL