On the Galaxy S8 long press on the icon (also called a badge). A submenu will appear with several options such as Uninstall, App Info, Remove shortcut, and clear badge. The last one is the one you want. I'm not sure what phone you have but, like I said, that's how it is done on the S8.