Here is what worked for me. Go in to gmail to settings:
Account > Labels to notify
I had both Priority Inbox and Inbox sending notifications. Uncheck one of them and the duplicates are gone.
I think I had both because I have two gmail accounts receiving emails on my phone.