Sure -- go to Settings>Apps, select the app in question, then Notifications, and then tap the words of the notification channel (e.g. "Incoming messages"). Don't tap the toggle switch -- it's important to tap the words instead. On the next screen, if you want the app to give you an icon notification but no sound, select Silent.