How can I delete live.com emails from my phone (AT&T) and the server?

[GalaxySamsung2]

I have the generic email app on my phone connected to my live.com email address but once I delete an email off the phone, the message stays in my live.com box (on my computer). My question : Is there anyway to delete if from both my phone and the server? Where do I go? I contacted AT&T regarding this issue and they were no help. Thank you in advance.