I've had this problem also, not sure exactly what's causing it though. It really is annoying, i've had to actually turn off the setting for pulling the time from the network as it would also change my time on my phone when it changed location like that.