Programs such as Slide2Play will usually download any missing album art, but not always. Get Album Art will scan your music directory and download album art as well.

http://forum.xda-developers.com/showthread.php?t=465102

This article is over 2 years old — the linked page may have changed, moved, or been taken over since then.