If your GPS and wireless network location systems are off (both can be found in Settings > Location on most Android phones), you'll be fine. The fact that your phone's connected to a GSM/3G/4G radio tower means that your phone can be tracked to some extent with a precision of about a kilometre's radius or so when the radio's being used, which has more or less been the case since the cellphone's inception.