Message not sent error but message went through

[Android Central Question]

I constantly reply to texts from the notification bar and never clear that. However, when I go into the actual conversations with people, under each message it says "Not sent. Tap to try again." I find it really annoying since they show up under each message, even when I know they have gone through because the other person has responded. Without tapping each message again, because it's months worth of texts that I know have gone through, how can I fix this?