On your main Contacts screen, tap your user profile pic at the upper right. If you see "Contacts from all accounts" at the very top, then tap your Google account instead, which should be just below it. That will change the main account that Contacts shows to your Google account (which should now show up at the very top of that menu), which should then give you access to your group labels.