Was cleaning out the sump pump, needed to know where a tool was in the house was, called wife using "ok google now" without touching the phone or taking off the rubber gloves.
Yeah, that has the same correct work place as it does when i do it from a web browser.
What I did was tell my phone that the wrong place WAS my work address, then I went back in and edited back to the right one and it seems to be working.