I figured out a (less than ideal) way to get it to stop talking on reminders. It appears that it is controlled by the media volume, not the ringtone/notifications. So if media is set to 0, and the phone is set to vibrate, then it just vibrates to let you know you have a reminder.