A quicker way to disable Samsung Voice without jumping through too many hoops is by going to Settings > Apps > Show System Apps. There are two listed under Samsung Voice (one's that Bixby thing). Disable the one with the microphone icon and you should be good.
Whether it stays after software...