You are correct. I have a Galaxy S5 from Verizon that was given to me and all I had to do is pop in my AT&T SIM card and add AT&Ts APN data settings and the phone is good. Yes, you get the annoying "SIM card is not from Verizon" notification. Not sure how to get rid of that.
On another note...