In Gmail, you open the account, push "menu" button, select settings, signature.
On regular mail accounts, I'm not so sure if you can do it from the servers end, but I have been unable to find this option on the phone itself when it comes to anything other that gmail.