Grab "Album Art Grabber" from the Market (free) and you should be all set. For the albums it doesn't automatically find you can manually grab it (you'll understand when/if you have the situation). If you do, I've found the selection of Last.FM to always have what the app missed.
X