That's definitely a 3rd party app, and to stop it you'd need to know which one it is (and disable it from its settings or uninstall it). One way you can try to find out is to see which apps have the permission to 'draw over other apps', or sometimes long-pressing the floating pop-up will yield some sort of menu or indication on which app it is.