Hey guys I figured it out.
I had the triple tap to zoom option enabled so I believe this will lag your presses as it is waiting to see if it's a triple tap. Once I turned this option off the lag stopped. Hopefully Samsung can improve this as I like having the triple tap to zoom feature...