When mine is set to silent, it doesn't vibrate. I use this mode for church, concerts, etc., when even a vibration would be annoying.
The only way I can get the slider to show a vibrate symbol is to use the widget I mentioned to change to vibrate mode, then lock the phone.