I am using S4 and I felt lagged. I used Note 2 LTE(Asia Version) and S3LTE(Asia Version).
Many articles talked about how Samsung reduced the Usable Storage Memory but I haven't found one that talked about reduced usable RAM.
My S4 took up a lot more RAM than S3 and Note2.