It seems that every time the app gets automatically updated, this gets reset to the default. Despite what the toggle says, it is ON, and has to be toggled on and off again to make it stop.
There's is an option in Ringtones and in Default Sounds for 'none.'
You'd never have a sound from your phone though unless you go back in and out it back.
Maybe there's yet another app for that ;)