If it's always showing, yes, it's draining your battery (to what extent, though, depends on what it's using to set the location). Maybe a weather widget updating?
Try switching the Location Services switch off and then on again (or going into Airplane mode and then out of it), sometimes that helps to rectify rogue apps polling for location and that, somehow, got stuck.