Yep. Took me a month to figure this out, even with your comment... Moderately pissed off.
I had to:
1. Toggle 'Use Screen Context' off (since it was on already)
2. Toggle 'Google Assistant' off
3. Go back to the previous page
4. Re-enter the phone's voice settings
5. Toggle 'Use Screen Context'...