When it is turned off yes it will say it's going back to the factory version. But it will also put it in the turned off folder and should remove it from the home screen and app window. follow through with the instructions and it should go away. The only way to get it back is to go back to app manager and turn it back on. I did this for a lot of the bloat apps I don't use. Hope that helps you.
Brandon