I had this problem (voice dictation/speech to text stopping after I spoke a few words) on my Note 4.
I had discovered that uninstalling all of the updates to the Google app and then letting it update fixed this for me - but only for a while.
For reasons that I couldn't figure out, this fix...