I feel your pain
Same experience here. Your post brought the problem back towards the top of my "issues to be resolved" list. Would this work? Install the google voice setup widget. It allows you to quickly change between options. Those options are: "Ask for every call," "Use for all calls,"...