Turn off Gmail notifications in the Gmail App itself. Gmail > Menu > More > Settings > Click your account > Scroll down to Labels to notify > Inbox then either uncheck Email notifications or change the Ringtone to Silent. This is the way I have it (Silent), so I still get email notifications on my status bar and the LED flashes but with no ringtone or vibrate.