I just spent HOURS with the same issue and I finally figured it out. Try this-
-From the screen where you're seeing the "Allow or deliver quietly", select "Notification Categories" (should be the last option.)
-Under "other", you'll see three categories. Select "New Messages". Don't toggle it...