I have had this problem on occasion, I find the watch gets very warm while it is happening. I restart the watch and that seems to cure it which suggests that there is indeed an app running in the background causing it. The battery stats never reveal anything, though.