I found a solution that works on my phone! My problem was specifically when I was using headphones. The beeps would be almost painfully loud while the media sound would be alright.
The solution was to unplug the headphones, turn down the media volume without them and then plug them back in.