Wallpapers exist as photos, or Live wallpapers which are applications.
It should be listed in your installed applications list, and you should be able to uninstall it.
Something has to show on the screen - long-press a blank spot on the screen, choose Wallpaper, and choose a wallpaper - even if it's a blank black (which is best for the battery with an AMOLED screen).