Hello,
Welcome to the forum. Since I don't know what Android phone you have, it would be kinda hard explaining how to do this. I am only familiar with the steps on HTC phones. Tap on the time on the big weather application, then Tap the alarm clock icon and unchecked the alarm notification in question.
Best of luck.