How do you filter contacts on Phone App contacts?

[AC Question]

I've just updated my Sony Xperia Z5 to Android Nougat 7.0 and have notice that the contacts page in the native Phone app now displays everyone I have ever contacted via email. Previously I was able to filter the contacts page to display only my Google Contacts, and the Contacts app itself still allows me to do this, but for some reason if you access your contacts via the Phone app this feature doesn't seem to be available. Is there a way of filtering contacts on the native Phone app?