The full wipe worked so far. I thought that just wiping the cache and dalvik cache would be good enough but apparently it wasn't. Thanks
Sent from my Galaxy Nexus using Android Central Forums
As it turns out, it had nothing to do with the ROM, I had to uninstall AdFree. It must have been interfering with it. I'd rather have music than no ads.