I think manually is the only way. I don't see how the phone would know if the app you are using is a game or an app like instagram. Unless you can find some sort of third-party app in the play store that would allow you to white list apps you want at specific brightness is my best guess else you'll need to manually disable it.