I also have a Samsung S6 and have had that problem. Have someone call you and leave you a message. Go to your Voicemail and listen to the message normally. When the voicemails asks you if you want to delete the message. Delete it - the notification will disappear.