Are you using a third-party phonecall app? The always on feature is always looking at the built-in app. So to remove it you have to open this app in order to remove the icon. Very disturbing and I don't know how the change it to look at the third-party app, any ideas?