"volumes" is the wrong screen.
Up one level or so in the settings menus, there should be something called "sound profile" or something like that.
From there you can pick: sound, sound and vibrate, vibrate, silent.... Depending on the options available.
That is for the phone in general. Many apps have their own notification settings that override the phone settings.