Most likely you can delete it from your phone by going to settings > personal > accounts & sync and choose Microsoft exchange then delete it off device. Not entirely sure on the details of when you reach it but it should be simple once you get to Microsoft exchange