Any fix for this yet that doesn't involved throwing security out the window? (last post suggests to disable lock screen...)
My results:
Disabling the 3 S-Voice things and S-Voice entirely had no effect.
Removing SD card seemed to improve slightly, but going from a 1.5 sec delay to 1 sec delay...