Employer accessing my Note 4 through Microsoft Exchange, how can I stop this happening?

[AC Question]

Employer accessing my Note 4 through Microsoft Exchange

I recently downloaded my email for my work on my note 4 and I was reading forum after I accepted the terms and conditions of releasing all the security to my phone. If I delete the email account on my phone does that remove the access and rights the employer has to my phone?