Running Swype 1.8.7 keyboard under Android 4.3 (Jelly Bean), I just removed a word from the built-in dictionary by holding the word (as described above) and it worked perfectly.
I haven't had any trouble at all with Swype. And it's fast. Maybe you have phone problems?