As a follow up to the accuracy question, even if you have high accuracy enabled, GPS can still be inaccurate. Buildings and mountains can impede the satellite signal, causing degraded performance. This might explain your hiking observation.
Also, if your network signal is relatively poor, AGPS...