So I think I figured this one out... I have been having the same problem since updating to Android 4.4.2.
On your phone, go to Settings > My Device > Accessibility > Press and hold delay.
Mine was set to Short (0.5 seconds) and I changed it to Long (1.5 seconds).
I had to reboot afterward...