When you say "Menu" button, are you referring to the Home button?
The home button doesn't really close the Apps., to close the Apps. press the recent button (bottom left). This will enable you to close all Apps. or you can just select individual Apps. to close.