How do I turn them off? I get so annoyed with the little number there constantly reminding me I'm ignoring someone
I don't have that phone, but go to Settings>Apps>All and see if there's an app called Badge Provider. If so, then see if you can Disable it.