The only other app i use frequently when I'm talking to people is Discord (basically Skype) and I just tested it to the exact same result. My phone went off after the first message, but I wasn't aware of the next two until I checked my notifications.
Not sure about safe mode, but I'll look...