Drives me nuts, too. You have to stop the audio message first before exiting or the audio will play in the background. It's an app 'bug' (and I say 'bug' because it looks like it to me, but they've done weird actual app choices before, so it might be just how the devs intend this to work).