Welcome to Android Central! Are you talking about the little pushpin location icon? Which phone do you have? Is it in the upper right part of the status bar?
Look in your Location or Wi-fi settings to make sure Wi-fi Scanning is off. The menu location for this depends on the phone.