If Frank's suggestion doesn't work, have someone leave you another voicemail. I had this happen to me once about 2 months ago. Had to do it a couple of times and it cleared the notification. Has not happened since either. No idea what made it do it, nor why it hasn't happened again.