I have a Droid 2 with Weather Bug Elite running. It says to long press the location name at top of screen and you get a menu and delete is an option.
You can hit the Menu key and choose locations and add any location you want. Also in preferences you can set "my location" which will show weather where ever you happen to be at the moment.