I have a couple of problems too, though I don't consider them deal breakers - but number 2 in my list is the worst.
1) "Ok Google" - not. It will plain ignore me even when I'm yelling at it. I've noticed this occurs when the phone hasn't been used for a bit. It's like Assistant has gone to...