Lower buttons...home menu back and search

Are they supposed to be lit all the time or during certain apps only?

Depends on the amount of background light in the room. The light sensor that is built into the phone will cause them to light up if there is not alot of light around. Although there are some apps that just turn them on when the app is in use.