That's not the case for the Note 4. I have been plagued by this bug because I listen to podcasts every day. I am hit by this problem no matter what is connected to the phone, either bluetooth speakers, headphones plugged into phone, car hands free kit, etc. After a lot of frustrating experimentation, I have narrowed the seemingly "random" events down to:
1) This bug is associated with the notification system
2) Having WiFI turned on activates the bug
3) Certain bluetooth events can trigger it.
4) Location has a very definite role and my phone can be operating perfectly normally, but when I arrive at certain locations the bug appears without fail.
So the best way that I have found around this is:
a) Turn off all your wifi and bluetooth
b) In certain locations you won't be able to avoid it, just give up there
If I manage the crack the location issue, will repost. It may be that turning off GPS helps as it will prevent the phone from detecting where it is.
At the heart of the problem is the notification system. The problem occurs when certain notifications such as wifi networks present occur. It may be that there is a way to turn off or change notifications in which case the bug will probably disappear. I am guessing that the problem exists because Samsung want to protect users from loud notification noises but the system is just too dumb to understand volumes across apps and focus its reduced volumes on simply notifications. So it kills everything.
This bug appears to be in the Note 4 and related devices, other people I know with Note3 and other older handsets don't have this bug.