Make sure that your Device Assistance App in Default Applications is set to Google App.
Mine was set to Home Launcher so I could press the home button to immediately activate voice control.
I had completely forgotten about this until this morning when I went into the Google App settings and...