To accept invite right from Gmail Android app you can use Invitation Plugin application. It allows to click on the ics attachment and open event details in calendar.
Check it out...
There is a free application open email attached ics files directly in Google Calendar application - Invitation Plugin. Android 4+ (ICS) is required to run this application...
Facebook
Twitter
Instagram