Are you using the gmail app or having it pulled with the mail client?
If you are using the gmail app, just make sure it is running and you should get notified. (If you are running a task killer for some insane reason, make sure the gmail app is ignored when killing off apps. Or better yet, stop using the TK.)