Definitely clear the cache. Hold both volume buttons and the power button down (when the phone is off). When you get to a little green guy with his chest open hit both volume buttons. Then go into recovery, then clear cache.
You'll have to do this every few days or so after ICS. Well, at least I have...