DITTO - I wish I would have come across this a few months ago. I ended up taking my original S4 back to AT&T and getting 2 replacements. My problem is not as horrible as it once was...it only occurs about once a week, whereas it used to happen daily, almost hourly.
Prior to reading this thread, I thought the culprit was Waze GPS app - an app that I love and truly enjoy and therefore, never turly gave it up. My issues now (with my last replacement S4) only occur randomly. I hope your solution will solve it once and for all!
Sidebar - if you really want to use OK Google and don't want to enable the feature MAYBE you might consider using Nova Launcher Free...it allows the OK Google phrase to be used even though I have it disabled in under "Ok Google Detection" in Google Now settings. Just a thought...not sure it won't re-create the problem.