Not sure if this is it or not, but: On your home pc, if you use an e-mail client, it will download then delete the email off the server, thus deleting it from your phone.
If you want to delete it yourself, you'll have to change a setting in your PC's email client to not delete the mail off the server.