After more experimentation I can be more specific about what I am observing and, yes, I will have to live with it:
When you are starting a new word - not when you are in the middle of a word - if, by accident, your finger rests on the up-arrow instead of the first letter of your word, Gboard...