I have just found the problem last night. I fixed it by accident this afternoon (definitely not an Android Jedi, so if this doesn't work for you sorry I cant help)
Open your email account
select the Settings button (On the Samsung S4 Lower LH button)
Select the account
select Security Options...