That happens to me as well occasionally. Usually its just some process on the watch that is stuck in some sort of loop, which causes the battery drain. A simple reboot/restart of the watch corrects it.
If not, then it could be something in that watch face your using. Try using a different (and...