For Android 6:
Alerts are now found in Apps on your main screen, not in settings. Select Apps at the bottom of your screen, it will take you to the page(s) of apps you have installed. Look for Emergency Alerts, the icon is often a triangle with an exclamation point. Touch it, then select More -> Settings in the top right.