Thanks everyone for all the replies. Looks like you guys are correct, it is something using location, but I cant figure out what app is using it.
I tried closing all my running apps, one at a time to see if any of them shut down that icon. But it never went off.