This was driving me nuts lately on my S4. Not sure why it happens but I got rid of the erroneous unread icon notification, until the next time it happens. I sorted by read/unread and deleted the unread. I know for sure that one of the offenders had in fact been read and deleted on my computer...