I think what's happening is when you swipe you lay down your finger on the screen and touch it on a bigger surface. That's registered as a palm cover and sends the watch to stand by. Make sure you only touch the screen with the tip of your finger.
EDIT:
I take this back. Tried it on mine and...