Swipe at the name of the email rather than long-press?
Or, in the settings app, find the account, tap it. Tap the three button menu control top right, tap remove account?
(When I say the settings app, I don't mean the settings in the email app itself. I mean home, open list of apps, find settings, your list of accounts should be in there.)