I would look in notifications and see if you can disable that because mine doesn't do that. Are you using the stock app or one from the market
Edit
Just looked through settings for display and messaging and I didn't see a setting for this. Looks like you found a bug if your using the stock app