I am using ADW Launcher EX. I can't be entirely sure when it started to happen and it is quite irregular, maybe happens once every few days. I also have the brightness set to auto, I can't imagine that would cause this.
Perhaps I will try a factory reset and see if this helps, I just don't wanna :(