That will work but you might just want to "Hide" the albums you don't want to see.
Go to the "Albums" view in the Gallery, long press an album to select it, press the Menu button and select "Hide Items". To keep my Gallery manageable I regularly delete screen shots etc. I don't want any more...