Yes, this is the problem alright.
I've come to realize though that for me, it's really only a problem when I am on a call which requires me to keep the dial pad on the screen, like when I am picking options like "for customer service dial 1" etc. Normally when making a regular call, the dial pad...