Any way to delete/turn off the Voice Dialer?

[Vance14]

I know I could freeze it with Titanium if I was rooted, but I am not yet. This Voice Dialer app is useless to me since Voice Search does a better job, and my inline remote commands keep triggering it when I want those commands to do something else.

Is there a way to delete it short of rooting? Can I change the settings at least so that it won't be triggered by remote commands?