Easy answer - it will depend on the app! Think about the purpose of the app and whether it is critical for the app to be receiving information from the Internet while you are not using it. If it is critical, don't turn off background data. If it is an app where you don't mind waiting a couple of seconds for it to refresh itself when you next use it, you should be safe to turn off background data.