If you have multiple keyboards installed and enabled, the phone will show this every time you open up an input field so you can choose the one you want. There may be an option in Language and Input (in Settings) to turn this off, but I'm not certain. If not, and you always use the same keyboard, uncheck everything but the one you normally use. That should make the notification go away.