Sounds a lot like me. I just need to go through and turn off all notifications on the watch except for calls and texts. I'm still getting them silently so I have to swipe them away every so often.
One bug I've encountered is when I switch the animations to .5 in the developer options, after a little bit, they will automatically switch back to 1. I'm not sure what is causing this to happen. It's not a big deal as it only affects the animations when swiping away notifications and not in swiping to different widget screens.